Back to projects

RedDial

Open-source harness that stress-tests conversational AI agents

RedDial

What it does

An adversarial simulation and evaluation harness for conversational AI agents. It spins up difficult customer personas (angry escalators, prompt injectors, policy probers), runs them against a target agent in parallel, and grades each transcript with deterministic decision-tree judges for task completion, tone and policy, and groundedness against the target's own documents. Built on LangGraph for parallel multi-agent orchestration and LangChain for the model layer, with a small RAG pipeline that catches hallucinated prices and policies, and a self-contained HTML report that draws each judge's decision path. TypeScript, tested with Vitest, on npm.

Built with

TypeScriptLangGraphLangChainRAGDAG evalsVitest

Live links

© 2026 Henry Okonkwo