Discover AI Infrastructure Tools

Meta's open-source library for efficient similarity search and dense vector clustering

Open-source PostgreSQL extension for vector similarity search alongside relational data

Open-source search and serving engine combining vector search, keyword search, and ML ranking at scale

Serverless vector and full-text search engine built on object storage for cost-efficient scale

Vector search and kNN queries built into the established Elasticsearch platform

AI gateway for routing to 1,600+ LLMs with observability, guardrails, and prompt management

Open-source CLI for testing, evaluating, and red-teaming LLM applications

Open source app for prompt testing

Collaborate on prompts, evaluate, and optimize LLM-powered Apps with Klu.

Eliminate risks of biases, performance issues & security holes in AI models. In <10 lines of code.

LLM observability platform with quality monitoring, guardrails, and evaluation workflows

Open-source ML and LLM evaluation with 100+ built-in metrics and CI/CD integration

LLM tracing, evaluation, and prompt monitoring built into the Datadog APM platform

LLMOps platform for logging, debugging, and improving LLM-powered applications

AI evaluation and observability platform with hallucination detection and real-time guardrails

Run AI models at the edge on Cloudflare's global network with serverless inference

Ultra-fast inference on custom wafer-scale hardware with OpenAI-compatible API

Custom AI chip inference platform with purpose-built hardware for high-throughput LLM serving

Open-source serverless GPU cloud with sub-second cold starts and auto-scaling

GPU marketplace for renting compute at market-driven prices with per-second billing

Open-source agent development kit from Google for building multi-agent systems

TypeScript-first AI framework for building agents, RAG pipelines, and workflows

Multi-agent LLM framework using message-based task delegation inspired by the Actor model

Spring framework for building AI-powered Java applications with portable model and vector store abstractions

Microsoft's SDK for building and orchestrating AI agents in .NET, Python, and Java

Open-source fine-tuning framework for 100+ LLMs with a web UI

PyTorch-native library for fine-tuning LLMs on consumer and enterprise GPUs

Hugging Face library for training language models with RLHF, SFT, and DPO

Declarative deep learning framework for building and fine-tuning models with YAML configuration

Enterprise LLM fine-tuning platform with Memory Tuning for near-zero hallucination

Fast speech-to-text API with real-time transcription and speaker diarization

Low-latency text-to-speech API built for real-time conversational AI

Enterprise speech-to-text API supporting 55+ languages with high accuracy

Open-source text-to-speech and voice cloning with low latency in 13+ languages

Empathic voice AI that detects and responds to human emotion in real-time

Official OpenAI framework for building production AI agents with tool use and guardrails

Lightweight Python agent framework from Hugging Face where agents write Python code instead of JSON tool calls

Framework for building stateful AI agents with persistent memory, formerly MemGPT

Tool integration platform connecting AI agents to 1,000+ apps with managed auth and execution

Type-safe Python agent framework with Pydantic validation, tool calling, and dependency injection