Anyscale
Fast, cost-efficient, serverless APIs for LLM Serving and Fine Tuning
Anyscale Endpoints offers fast, cost-efficient, serverless APIs for serving and fine-tuning Large Language Models (LLMs) with a focus on production-readiness. Users can start with common LLMs, including the Llama-2 family and Mistral 7B, and fine-tune them for specific applications.
Pricing: Pay-as-you-go
Anyscale Alternatives
Explore 79 products in the Inference APIs category. View all Anyscale alternatives.
IONOS AI Model Hub
OpenAI-compatible API for open-weight LLMs and image models, hosted in IONOS EU data centers
Opper
EU-hosted AI gateway serving 300+ models through one OpenAI-compatible API
CheapestInference
Flat-rate unlimited inference on open-weight models, sold in daily 8-hour windows
Lyceum
EU-hosted inference cloud for open-source models, OpenAI-compatible
vLLM
High-throughput LLM inference engine with PagedAttention for efficient GPU memory usage
Also listed in
Work on Anyscale? Feature it at the top of Inference APIs.
Is your product missing?