HomeProjectsArticlesPK BoardAbout
Explore Projects

gpt-load

Active
GitHub Go MIT

Description

gpt-load is a self-hosted AI gateway with multi-channel, multi-credential setup and centralized API key management.

Key Features

  • Multi-channel — many LLM providers at once
  • Multi-credential — multiple keys per provider
  • Smart routing — failover on errors
  • Rate-limit — centralized quotas and throttling
  • Observability — full call logs
  • Self-hostable — one Docker command

Use Cases

💡 Centralized LLM credential management
💡 Central rate-limit and quota for AI traffic
💡 Unified enterprise AI entry
💡 Docker-one-liner gateway

Strengths & Limitations

✅ Strengths

  • • Actively maintained, recent updates
  • • High community interest (6.5k stars)
  • • Permissive open-source license (MIT)
  • • Responsive to issues, low backlog

Tags

gateway multi-channel self-hosted proxy

Categories

⚡ Agent Tools

Quick Start

# 多通道 LLM 凭证管理
docker run -d --name gpt-load \
  -p 8080:8080 \
  -v /etc/gpt-load:/app/config \
  tbphp/gpt-load:latest
Visit GitHub Visit Website

Related Projects

LiteLLM

57.9k · Python
Active A

LiteLLM provides a unified interface and proxy gateway for LLM calls, simplifying multi-model switching, routing, and cost control.

llmgatewayproxy +1
  • · Unified LLM interface — OpenAI-format calls across 100+ LLM providers (OpenAI, Anthropic, Gemini, Bedrock, Azure, etc.)
  • · AI Gateway proxy server — Self-hosted proxy with virtual keys, spend tracking, load balancing, and admin dashboard
  • · Python SDK — Switch LLM providers in code via the completion() function
View full details → View on GitHub

Portkey AI Gateway

12.9k · TypeScript
Stale B

Portkey AI Gateway is a blazing fast AI gateway with integrated guardrails, routing to 200+ LLMs with 50+ AI guardrails through a single fast and friendly API.

gatewayllm-routingguardrails +2
  • · Route to 250+ LLMs with a single OpenAI-compatible API endpoint
  • · Blazing fast at under 1ms added latency with a 122kb footprint
  • · Built-in automatic retries, fallbacks, and load balancing for reliability
View full details → View on GitHub

AppFlowy

76.2k · Dart
Active A+

AppFlowy is an open-source Notion alternative with AI workflows, knowledge base, kanban and multi-device sync, usable as agent long-term memory.

note-takingproject-managementai +2
  • · Self-hostable — full data ownership, deploys locally or on a private server
  • · AI assistant — built-in AI for writing, summarizing, translating and table generation
  • · Knowledge base — nested pages, databases, linked views for structured notes
View full details → View on GitHub