Portkey Alternatives
AI gateway for routing to 1,600+ LLMs with observability, guardrails, and prompt management
Portkey is an AI infrastructure platform with an open-source AI gateway at its core.
Explore 65 alternatives to Portkey across 2 categories. Each tool listed below shares at least one category with Portkey.
Top Portkey alternatives at a glance
- AI Gateway HQ. LLM gateway built around spend limits enforced before a request reaches a provider
- AISIX. Open-source AI gateway in Rust with one OpenAI-compatible API across 100+ LLM providers
- 2kw.ai. EU-hosted AI integration platform combining a provider gateway, document extraction, evals and cost observability
- TrueFoundry. AI gateway for routing across 250+ LLMs with fallbacks, rate limiting, guardrails, and RBAC
- Vercel AI Gateway. Unified API for hundreds of AI models, with built-in rate limiting and key management
📊 Observability & Analytics
Comet Opik
Comet provides an end-to-end model evaluation platform for AI developers.
Agenta
Open-source prompt management, evaluation, and observability for LLM apps
Dunetrace
Runtime reliability and failure detection for AI agents
Braintrust
Stop building AI in the dark.
RAGAS
Open-source evaluation and testing framework for LLM and RAG applications
Presidio
Microsoft open-source SDK for detecting and anonymizing PII in text and images
Guardrails AI
Open-source framework for adding input and output validators around LLM calls
NeMo Guardrails
NVIDIA toolkit for adding programmable guardrails to LLM conversational apps
✍️ Prompt engineering
PromptFoo
Open-source CLI for testing, evaluating, and red-teaming LLM applications
Prompt Mixer
Open source app for prompt testing
.png)
Fixie
The fastest way to build conversational AI agents
Superagent
Prototype and deploy agents powered by large language models.
Frequently asked questions
What are the best alternatives to Portkey?
Based on category overlap and popularity, the top alternatives to Portkey include: AI Gateway HQ (LLM gateway built around spend limits enforced before a request reaches a pro...); AISIX (Open-source AI gateway in Rust with one OpenAI-compatible API across 100+ LLM...); 2kw.ai (EU-hosted AI integration platform combining a provider gateway, document extr...); TrueFoundry (AI gateway for routing across 250+ LLMs with fallbacks, rate limiting, guardr...); Vercel AI Gateway (Unified API for hundreds of AI models, with built-in rate limiting and key ma...). See all 65 alternatives compared on this page.
Is there a free alternative to Portkey?
Yes. 59 alternatives to Portkey offer a free tier or free trial: AI Gateway HQ, AISIX, 2kw.ai, TrueFoundry, Vercel AI Gateway, Langfuse, and more. Use the comparison above to find the best fit for your use case.
Are there open-source alternatives to Portkey?
Yes. 29 of the 65 alternatives to Portkey listed here are open source: AISIX, Langfuse, Comet Opik, Arize AI, Traceloop, Helicone, and more. Open-source tools can be self-hosted for full control over data and infrastructure.
What is Portkey?
Portkey is an AI infrastructure platform with an open-source AI gateway at its core. It routes requests to 1,600+ LLMs across 200+ providers through a unified API, with automatic retries, fallbacks, load balancing, and caching. The platform adds real-time observability with cost tracking and late... See 65 alternatives to Portkey across 2 categories.
Work on a Observability & Analytics product? Feature it at the top of this page.
Is your product missing?