Cinq
Some smaller, specialized models can outperform larger models on specific tasks.
Core trick
Routes each prompt to specialized small models via an OpenAI-SDK-compatible endpoint, selecting the best model per query.
Tags
Description
Some smaller, specialized models can outperform larger models on specific tasks. What if we have enough coverage from these specialized models to outperform larger models on general tasks? This becomes a routing issue. I present autorouter, a publicly served API, compatible with the OpenAI Python SDK that you can use right now. Achieves state of the art.
The linked repo returns 404, so it was deleted or made private.