llm-router-server

Here are 2 public repositories matching this topic...

Continuum-AI-Corp / OrcaRouter-Lite

Self-hosted LLM router with a managed safety net. OpenAI-compatible. BYOK. Single-workspace. Streaming. For more advanced routing choose hosted OrcaRouter

openai one-api gemini-api openai-api portkey byok litellm ai-gateway llm-router anthropic-api openai-compatible llm-router-server ai-gateways orcarouter ai-model-gateway

Updated Sep 4, 2026
Python

LLMSystems / LLM-Router-Server

Star

LLM Router Server is a high-performance routing service designed for multi-model deployment scenarios, used to uniformly manage and orchestrate multiple local Large Language Model (LLM) services, Embedding models, Re-ranking models, and other inference services.

asyncio multi-model inference-server load-balancing model-serving fastapi llm llm-serving vllm llm-router ai-infrastructure llm-router-server

Updated Mar 28, 2026
Python

Add this topic to your repo

To associate your repository with the llm-router-server topic, visit your repo's landing page and select "manage topics."

Learn more