Rig

Active
GitHub Rust MIT

Description

Build modular and scalable LLM Applications in Rust. Provides agent orchestration, tool-use, RAG pipelines, and other core capabilities for high-performance AI agent systems.

Key Features

  • 20+ LLM provider integrations under a unified interface
  • 10+ vector store integrations for RAG workflows
  • Agentic workflows with multi-turn streaming and tool-use
  • Full OpenAI Semantic Convention compatibility for observability
  • Support for completions, embeddings, transcription, audio, and image generation
  • WASM compatibility for the core library

Use Cases

💡 Building high-performance Rust-based AI agents and chatbots
💡 Creating RAG pipelines with pluggable vector stores
💡 Developing multi-provider LLM applications with minimal boilerplate
💡 Building production AI services that need WASM deployment

Strengths & Limitations

Strengths

  • Actively maintained, recent updates
  • High community interest (8.5k stars)
  • Permissive open-source license (MIT)
  • Established track record (2 years in production)

Quick Start

Add Rig to your project: `cargo add rig`. Create an OpenAI client with `openai::Client::from_env()`, build an agent with `client.agent(openai::GPT_5_2).preamble("...").build()`, then prompt it with `.prompt("...").await`. See docs.rig.rs for full API reference.

Related Projects

LLMFit

34.8k · Rust
Active A+

Hundreds of models and providers. One command to find what runs on your hardware. Provides local LLM runtime for AI agents.

rustllmagent +2
  • · Auto hardware detection & model matching — Detects CPU, RAM, GPU/VRAM, scores hundreds of models across quality, speed, fit, and context dimensions
  • · Interactive TUI interface — Default terminal UI with search, sort, multi-select comparison, hardware simulation, community leaderboard
  • · Multi-GPU & MoE support — Supports multi-GPU setups and Mixture-of-Experts architecture model evaluation

Atomic Agents

6.2k · Python
Active A+

Atomic Agents is a modular AI agent building framework with an atomic design philosophy, providing composable components including tools, pipelines, and memory management for constructing agent systems.

frameworkpythonagent +2
  • · Atomic design philosophy with single-purpose, reusable, composable components
  • · Built on Instructor and Pydantic for type-safe, predictable agent behavior
  • · Multi-provider support including OpenAI, Anthropic, Groq, Gemini, and more

AutoChain

1.9k · Python
Stale C

AutoChain is a lightweight, extensible, and testable LLM Agent framework by Forethought, providing clean abstractions for agent building with automatic tool selection, conversation history management, and automated testing workflows.

frameworkagentpython +3
  • · Lightweight and extensible generative agent pipeline with minimal abstraction layers
  • · Support for custom tools and OpenAI function calling with automatic spec conversion
  • · Simple memory tracking for conversation history and tool outputs with BufferMemory