feat: add API Route as an LLM Advisor provider - #8965
Open
DennyHo0917 wants to merge 1 commit into
Open
DennyHo0917 wants to merge 1 commit into
DennyHo0917 wants to merge 1 commit into
Conversation
DennyHo0917
requested review from
Kurt-von-Laven,
bdovaz,
echoix and
nvuillam
as code owners
September 18, 2026 01:21
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Add API Route as a first-class LLM Advisor provider, following the same OpenAI-compatible integration pattern already used by OrcaRouter.
API Route is an OpenAI-compatible multi-model gateway that exposes GPT, Claude, Gemini, Kimi, Qwen, and other models behind one API key and base URL.
Changes
add ApiRouteProvider backed by ChatOpenAI
use https://global.api-route.com/v1 as the default endpoint
add API_ROUTE_API_KEY and optional API_ROUTE_BASE_URL
register LLM_PROVIDER: api-route in the provider factory and lazy imports
default to gpt-5.6-sol while allowing any API Route model through LLM_MODEL_NAME
add provider documentation, provider tables, MkDocs navigation, and changelog entry
The implementation intentionally reuses the existing langchain_openai dependency and keeps the provider-specific surface minimal.
References:
https://www.api-route.com/
https://www.api-route.com/pricing