BentoML
BentoML is the platform for software engineers to build AI products.
BentoCloud provides fully managed infrastructures for deploying BentoML, OpenLLM, or any model, optimized for performance, scalability, and cost-efficiency. Supporting models like Llama 2, Stable Diffusion, Flan-T5, Segment Anything, and CLIP.
Pricing: Pay-as-you-go
Resources
BentoML Alternatives
Explore 79 products in the Inference APIs category. View all BentoML alternatives.
IONOS AI Model Hub
OpenAI-compatible API for open-weight LLMs and image models, hosted in IONOS EU data centers
Opper
EU-hosted AI gateway serving 300+ models through one OpenAI-compatible API
CheapestInference
Flat-rate unlimited inference on open-weight models, sold in daily 8-hour windows
Lyceum
EU-hosted inference cloud for open-source models, OpenAI-compatible
vLLM
High-throughput LLM inference engine with PagedAttention for efficient GPU memory usage
Work on BentoML? Feature it at the top of Inference APIs.
Is your product missing?