HomeProjectsArticlesPK BoardAbout
Explore Projects

Apache APISIX

Active
GitHub Lua Apache-2.0

Description

Apache APISIX is a cloud-native API gateway with native AI gateway features, unifying LLM API traffic, keys and rate limits.

Key Features

  • Cloud-native — dynamic config with hot reload, K8s-friendly
  • AI Gateway — LLM routing, token rate limiting, key management
  • Multi-protocol — HTTP, gRPC, TCP, UDP, WebSocket
  • Plugin system — 60+ official plugins: auth, rate-limit, observability
  • High-performance — data plane built on NGINX and Lua
  • Production-grade — Apache top-level project used in large enterprises

Use Cases

💡 Unifying multiple LLM providers behind one router
💡 Enforcing token quotas and rate limits for agent services
💡 Exposing internal AI services under a single domain
💡 Central LLM auth and audit across teams

Strengths & Limitations

✅ Strengths

  • • Actively maintained, recent updates
  • • High community interest (17.1k stars)
  • • Permissive open-source license (Apache-2.0)

Tags

api-gateway ai-gateway apache llm rate-limit

Categories

⚡ Agent Tools 🔄 Workflow

Quick Start

helm repo add apisix https://charts.apisix.apache.org
helm install apisix apisix/apisix \
  --set ingress-controller.enabled=true
Visit GitHub Visit Website

Related Projects

LiteLLM

57.9k · Python
Active A

LiteLLM provides a unified interface and proxy gateway for LLM calls, simplifying multi-model switching, routing, and cost control.

llmgatewayproxy +1
  • · Unified LLM interface — OpenAI-format calls across 100+ LLM providers (OpenAI, Anthropic, Gemini, Bedrock, Azure, etc.)
  • · AI Gateway proxy server — Self-hosted proxy with virtual keys, spend tracking, load balancing, and admin dashboard
  • · Python SDK — Switch LLM providers in code via the completion() function
View full details → View on GitHub