TrueFoundry
AI gateway for routing across 250+ LLMs with fallbacks, rate limiting, guardrails, and RBAC
TrueFoundry is an AI gateway that routes requests to LLMs across providers (OpenAI, Anthropic, Gemini, Mistral, Groq, and others) through a unified API. It adds latency-based routing, weighted load balancing, automatic fallbacks, and per-user or per-team rate limits and token or cost quotas.
The platform includes observability for token usage, latency, and error rates, built-in guardrails (PII filtering, toxicity detection), and governance via role-based access control with per-team API keys. It can run in a VPC, on-prem, or air-gapped, with no request data leaving the customer environment.
Pricing: Free / monthly subscriptions
TrueFoundry Alternatives
Explore 52 products in the Observability & Analytics category. View all TrueFoundry alternatives.
2kw.ai
EU-hosted AI integration platform combining a provider gateway, document extraction, evals and cost observability
AISIX
Open-source AI gateway in Rust with one OpenAI-compatible API across 100+ LLM providers
Weckr
Tracks LLM cost and margin per end customer, with spending caps that fire before the call
EidoStack
Browser workspace for comparing LLM responses side by side using your own API keys
Work on TrueFoundry? Feature it at the top of Observability & Analytics.
Is your product missing?