llm router instead of just retrying
rate limits kept killing chat. built a router.
# llm
4 posts tagged with "llm"
2026
-
-
why we built a multi-model LLM router
Google's DSQ started throttling us mid-event
2025
-
designing a transcription format for LLMs
every field you add has a token cost
-