Home / Frameworks & Stacks / llmkit

llmkit

Open Source Free Trial

One LLM client API for 20+ providers, in Go, TypeScript, Python and Rust

llmkit is a multi-provider LLM client SDK that exposes one consistent API across Anthropic, OpenAI, Google, Bedrock, and 20+ other providers, including local models via Ollama and vLLM. The same features and surface are available in Go, TypeScript, Python, and Rust.

It covers text generation and streaming, tool calling, batch prompting, prompt caching, reasoning effort control, file uploads, and model catalog introspection. Middleware hooks let you observe or veto requests. Developers use it to switch providers without rewriting application code.

Pricing: Free

HQ 🇫🇮 Finland

Visit website →

Screenshot of llmkit webpage

llmkit Alternatives

Explore 35 products in the Frameworks & Stacks category. View all llmkit alternatives.

Anycloud

CLI and Python SDK for running AI jobs, services and VMs across your own AWS, Azure, GCP, Lambda and Vast accounts

Free Trial From Free under USD 1,000/month of cloud compute spend

LocalAI

Open-source, self-hosted OpenAI-compatible API for running models on your own hardware

Open Source Free Trial

vLLM

High-throughput LLM inference engine with PagedAttention for efficient GPU memory usage

Open Source Free Trial From Free (open-source)

LiteLLM

Unified OpenAI-compatible proxy for 100+ LLM providers with cost tracking and load balancing

Open Source Free Trial

Jan

Open-source desktop app for running LLMs locally with a clean GUI

Open Source Free Trial

Ollama

Run large language models locally with a single command

Open Source Free Trial From Free (open-source)

View all Frameworks & Stacks tools ≫

Work on llmkit? Feature it at the top of Frameworks & Stacks.

Is your product missing?

Add it here →