Open WebUI

Active
GitHub Python NOASSERTION

Description

Open WebUI is a feature-rich, user-friendly self-hosted AI platform supporting Ollama and OpenAI-compatible APIs, with RAG, agents, and MCP capabilities.

Key Features

  • Ollama/OpenAI API integration — Supports local Ollama models and OpenAI-compatible APIs (LMStudio, Groq, Mistral, etc.)
  • Local RAG engine — 9 vector databases (ChromaDB, PGVector, Qdrant, etc.) with multiple document extraction engines
  • Voice/video calls — Integrated STT (Whisper, Deepgram) and TTS (ElevenLabs, OpenAI) for hands-free communication
  • Model builder — Create Ollama models via Web UI with custom characters/agents and community model imports
  • Python function tools — Built-in code editor for extending LLM Function Calling with pure Python functions
  • Enterprise access control — RBAC, LDAP/SSO authentication, and SCIM 2.0 automated user provisioning

Use Cases

💡 Deploy a private AI chat platform connected to local Ollama models for fully offline conversations
💡 Build RAG-based Q&A systems over internal documents with PDF/Word upload and retrieval
💡 Set up a parallel multi-model comparison environment to call multiple LLMs simultaneously
💡 Create voice-interactive AI assistants with real-time speech-to-text and text-to-speech
💡 Deploy an LDAP-authenticated AI platform on enterprise intranet for unified user management

Strengths & Limitations

Strengths

  • Actively maintained, recent updates
  • High community interest (150.7k stars)
  • Established track record (2 years in production)
  • Responsive to issues, low backlog

⚠️ Limitations

  • No clear open-source license

Categories

Quick Start

# Quick start with Docker (includes Ollama support)
docker run -d -p 3000:8080 --add-host=host.docker.internal:host-gateway \
  -e OLLAMA_BASE_URL=http://host.docker.internal:11434 \
  --name open-webui ghcr.io/open-webui/open-webui:main

# Visit http://localhost:3000 to create admin account
# Configure Ollama or OpenAI API connection in settings

Related Projects

Langchain-Chatchat

38.6k · Python
Stale B

A local knowledge base RAG and Agent application platform built on Langchain with support for ChatGLM, Qwen, Llama and other LLMs, offering conversation, knowledge base management, and agent capabilities.

ragllmpython +3
  • · Local knowledge base QA — Document loading, text splitting, vectorization and semantic retrieval via Langchain with BM25+KNN hybrid search
  • · Multi-framework model inference — Supports Xinference, Ollama, FastChat, LocalAI for GLM-4, Qwen2, Llama3 and more
  • · Agent tool calling — Optimized for ChatGLM3/Qwen with auto tool selection, single tool parameter parsing, and multimodal image chat

Khoj

37.0k · Python
Normal A

Khoj is a self-hostable AI second brain that answers questions from the web or your docs, builds custom agents, schedules automations, and performs deep research.

second-brainragself-hosted +2
  • · Multi-LLM support — Switch between local and cloud LLMs including llama3, qwen, gemma, mistral, gpt, claude, gemini, deepseek
  • · Multi-format document retrieval — Get answers from PDFs, Markdown, Word, Notion, org-mode, images and more
  • · Custom agent creation — Build custom agents with custom knowledge, persona, chat model and tools

forge

2.2k · Python
Active A

Forge is a self-hosted LLM tool-calling framework for function calling and multi-step agentic workflows using local models like Ollama and llamafile.

self-hostedtool-callingfunction-calling +4
  • · Proxy server mode drops guardrails into any OpenAI-compatible or Anthropic client without code changes
  • · Rescue parsing handles malformed tool calls from Mistral, Qwen, and fenced-JSON formats automatically
  • · WorkflowRunner with SlotWorker provides priority-queued GPU access for multi-agent architectures

MaxKB

22.7k · Python
Active A+

MaxKB is an open-source knowledge base Q&A and agent building platform powered by LLMs, with vector retrieval, workflow orchestration, and multi-model support out of the box.

knowledge-baseragchatbot +3
  • · RAG Pipeline — Document upload and online crawling with automatic splitting and vectorization to reduce hallucinations
  • · Agentic Workflow — Powerful workflow engine, function library and MCP tool-use for complex business scenarios
  • · Zero-code Integration — Seamlessly integrate into third-party business systems for smart Q&A capabilities

Related Articles