Tag

routing

2 results tagged "routing"

Projects

↗
route-switch Go

Research into cost-quality optimisation for LLM routing. Implements MIPROv2-based automatic prompt tuning and model selection.

MIT MIPROv2 code

Articles

LLM Cognition

Intelligent LLM Routing: Spending Compute Where It Matters

How route-switch uses MIPROv2 to automatically select the right model for each query — balancing cost, quality, and latency.

routingMIPROv2cost-optimisation