HomeProjectsArticlesPK BoardAbout
Explore Projects

LlamaGPT

Stale
GitHub TypeScript MIT

Description

LlamaGPT is a self-hosted, offline ChatGPT-like chatbot powered by Llama 2. 100% private with no data leaving your device, with Code Llama support and one-click deployment via Umbrel.

Key Features

  • 100% private and offline — no data leaves your device, fully self-hosted
  • Supports multiple Llama 2 and Code Llama models (7B, 13B, 34B, 70B)
  • One-click install on Umbrel home server via the Umbrel App Store
  • Nvidia GPU CUDA support for accelerated inference on compatible hardware
  • OpenAI-compatible API at localhost:3001 for drop-in replacement in existing apps

Use Cases

💡 Private AI chatbot for individuals who need complete data sovereignty
💡 Offline coding assistance with Code Llama models on local hardware
💡 Home lab AI deployment on Umbrel, Mac, Docker, or Kubernetes
💡 Building privacy-first AI applications using the OpenAI-compatible API

Strengths & Limitations

✅ Strengths

  • • High community interest (10.9k stars)
  • • Permissive open-source license (MIT)
  • • Established track record (3 years in production)
  • • Responsive to issues, low backlog

⚠️ Limitations

  • • No updates in over 28 months

Tags

chat-ui self-hosted llama offline-ai private-ai local-llm

Categories

💬 Chat UI

Quick Start

git clone https://github.com/getumbrel/llama-gpt.git && cd llama-gpt && ./run-mac.sh --model 7b  # Access at http://localhost:3000
Visit GitHub Visit Website

Related Projects

Jan

44.3k · TypeScript
Active A

Jan is an open source alternative to ChatGPT that runs 100% offline on your computer, supporting multiple local LLMs with a full desktop chat UI and API server.

chat-uidesktop-appoffline-ai +3
  • · Local LLM Execution — Download and run Llama, Gemma, Qwen from HuggingFace locally
  • · Cloud Model Integration — OpenAI GPT, Anthropic Claude, Mistral, Groq and more cloud APIs
  • · Local OpenAI-compatible API — Local API server at localhost:1337 for other applications
View full details → View on GitHub

ChatterUI

2.7k · TypeScript
Active A+

ChatterUI is a native mobile chat frontend for LLMs that can run on-device models or connect to OpenAI, Claude, Ollama and many other APIs.

chat-uimobilereact-native +2
  • · On-device inference — runs gguf models directly on Android via cui-llama.rn over llama.cpp
  • · Multi-API support — OpenAI, Claude, Cohere, OpenRouter, Mancer, Ollama, koboldcpp and more
  • · Character card spec — compatible with the Character Card v2 format used by SillyTavern
View on GitHub

LibreChat

42.7k · TypeScript
Active A+

LibreChat is an enhanced open-source ChatGPT clone featuring Agents, MCP tools, multi-model support, code interpreter, AI search, and more.

chat-uimulti-modelagents +3
  • · Multi-model switching — Supports OpenAI, Anthropic, Google, AWS Bedrock, Azure OpenAI, and custom OpenAI-compatible endpoints without a proxy
  • · Agent & MCP tool integration — No-code custom assistants with MCP protocol, subagent delegation, skills system, and agent marketplace
  • · Sandboxed code interpreter — Secure isolated execution in Python, Node.js, Go, C/C++, Java, PHP, Rust, Fortran with direct file handling
View full details → View on GitHub