AI Decision Routing Engine
Overview
Conduit is a high-performance decision routing system that classifies and triages unstructured payloads in real-time using a two-layer AI stack: a lightweight local ModernBERT router (Laya) for zero-cost on-device inference, and Groq-hosted llama-3.3-70b for complex reasoning.
Support and operations teams drown in unstructured ticket floods. Manual triage is slow, inconsistent, and doesn't scale. The challenge was building a system that routes tickets to the right priority (P0–P3) with confidence scoring and graceful uncertainty escalation.
FastAPI backend with async request handling. Input sanitization via BeautifulSoup4. Dual-model routing: ModernBERT for cheap local classification, Groq LLM for full reasoning. Pydantic v2 enforces strict JSON schema on every response. React + Vite enterprise dashboard for real-time triage visualization.