vLLM Alternatives
High-throughput LLM inference engine with PagedAttention for efficient GPU memory usage
vLLM is an open-source inference and serving engine for Large Language Models, originally developed at UC Berkeley.
Explore 50 alternatives to vLLM across 1 category. Each tool listed below shares at least one category with vLLM.
🤖 Inference APIs
Beam
Open-source serverless GPU cloud with sub-second cold starts and auto-scaling
Open Source
Free Trial
BentoML
BentoML is the platform for software engineers to build AI products.
Open Source
Free Trial
Ollama
Run large language models locally with a single command
Open Source
Free Trial
Is your product missing?