Discover AI Infrastructure Tools
The directory of AI infrastructure products for building and shipping AI applications.
🗄️ Vector databases
Microsoft managed search service with vector, hybrid, and agentic retrieval for RAG
Open-source search engine in Rust with full-text, semantic, and hybrid search
Open-source typo-tolerant search engine with built-in vector and hybrid search
✍️ Prompt engineering
Prompt engineering IDE with quality scoring, automated tuning, and side-by-side model comparison
AI gateway for routing to 1,600+ LLMs with observability, guardrails, and prompt management
Open-source CLI for testing, evaluating, and red-teaming LLM applications
📊 Observability & Analytics
Real-time detection and remediation of incorrect, unsafe, or non-compliant AI agent responses
API-first runtime security for LLM apps and agents, prompt injection and data-leak defense
🏗️ Frameworks & Stacks
Build stateful AI agents and applications as state machines, with a built-in tracing UI
Framework-agnostic TypeScript library for AI chat, streaming, tools, and structured outputs
Build agents and graph-based multi-agent workflows in .NET and Python
AI-powered browser automation framework with natural language actions, extraction, and observation
Open-source agent development kit from Google for building multi-agent systems
🧠 Fine-tuning
PyTorch-native library for fine-tuning LLMs on consumer and enterprise GPUs
Hugging Face library for training language models with RLHF, SFT, and DPO
🔊 Audio
Open-source framework for building real-time voice and multimodal AI agents over WebRTC
Is your product missing?