NeMo Guardrails

NeMo Guardrails is an open-source toolkit from NVIDIA for adding programmable guardrails to LLM-based conversational applications. It supports input rails (filter user messages), dialog rails (steer the conversation), retrieval rails (for RAG), execution rails (tool and action safety), and output rails (filter responses).

Guardrails are defined in Colang, a Python-like language for modeling dialogue flows. It installs as a pip package and can run as a guardrails server or Docker container. Apache 2.0.