Inside theSoftware Factory
On deck

Okta logoOkta's AI gateway: LiteLLM with SSO and PII redaction

Okta's AI gateway routes all external AI usage through LiteLLM with SSO, phishing-resistant MFA, PII redaction, and audit attribution.

What they built

A unified AI gateway that routes all external AI usage at Okta. The gateway is a LiteLLM-based service in Okta's private cloud, acting as a proxy for every AI interaction from developer code-generation calls to the internal web UI.

How it works

Access is gated by Okta SSO with phishing-resistant MFA, and only managed devices can connect. A PII redaction layer scans prompts before they leave the trusted environment. Zero data retention agreements with model providers prevent Okta data from training external models. All interactions are logged and routed to the security team for auditing. Because security is handled centrally, teams can integrate new models without repetitive security reviews.

People

Dennis Henry Productivity Architect

Related patterns

More On deck

We're keeping an eye on Okta. On deck companies aren't yet placed on a maturity level. With more detail on their whole setup, they'll get a full profile and a level.
Sources (1)