
SecondStack
liteLLM
Portkey
Merlin Unified API
OpenRouter
TrueFoundry AI Gateway
VoidLLM
ZenMux
Otari
OpenRouter
liteLLM
Eden AI
APIPark
VoidLLM
OfoxAI
Portkey
SecondStack gives an entire organization access to AI without handing its data to third-party clouds.
The platform ships three end-user workspaces โ Chat for everyday work, Code for engineering teams, and Agent for automation โ running on top of an enterprise LLM gateway that connects to the model providers you choose (OpenAI, Anthropic, Google, and others). Platform and security teams manage everything centrally: who can use which models, what each team spends, and where data lives โ inside your own infrastructure.
Because SecondStack is self-hosted, prompts, files, and knowledge bases never leave your environment. For teams that prefer not to operate it themselves, a managed deployment run by the SecondStack team is also available.
Pricing is not per-seat, so rolling AI out to the whole company does not multiply the bill. Deployment and operations are backed by an ISO 27001-certified implementation partner.
Otari is an open-source LLM gateway and control plane you self-host. It puts one OpenAI-compatible endpoint in front of 40+ providers, so your applications keep a single stable API while you swap models behind it. It also speaks the Anthropic Messages API, so Claude-native clients work without changes.
Because Otari runs on your own infrastructure, prompts and responses never reach Otari's servers. Only metadata is stored. That suits teams with data-residency, privacy, or compliance requirements that rule out a hosted third-party hop.
What it does
Otari is built on any-llm, which calls each provider through its official SDK instead of reimplementing the interface. That keeps compatibility close to the source and reduces breakage when providers change. It is released under Apache 2.0.
For teams already running a proxy, migration is direct: point your existing OpenAI-compatible SDK at Otari's URL, and your keys and environment carry over.
Self-host it from the repo, or use the hosted platform at otari.ai if you would rather not operate it yourself.
SecondStackliteLLM - One library to standardize all LLM APIs
OpenRouter - A router for LLMs and other AI models
Portkey - Build production-grade & reliable AI apps with Portkey
Merlin Unified API - One Super API for all AI models (with 90% less error rates)
Eden AI - Regrouping the best AI APIs for 10mn integration in your code
APIPark - โจ#1 Open Source AI Gateway & API Developer Portal