Category:
Category:
Category:
Routing & Optimization
Definition
Systems where small models handle easy tasks and escalate difficult ones to larger models.
Explanation
Cascading models improve cost efficiency by using small, fast models for classification, routing, or simple tasks, while forwarding complex tasks to large frontier models. This mirrors triage systems in customer support or medical diagnosis and is essential for enterprise‑scale deployments.
Technical Architecture
Input → Small Model → (Solve / Escalate) → Larger Model → Output
Core Component
Router, small LLM, large LLM, fallback logic
Use Cases
Chatbots, copilots, automation, real-time inference
Pitfalls
Incorrect routing → degraded accuracy; overuse of large models → high cost
LLM Keywords
Cascading models, LLM Escalation, Multi-tier LLM
Related Concepts
Related Frameworks
• Routing Models
• Semantic Routing
• Model Selection
• Tiered Model Architecture