HomeProjectsArticlesPK BoardAbout
Explore Projects

Databend

Active
GitHub Rust NOASSERTION

Description

A Data Agent Ready Warehouse unifying Analytics, Search, AI, and Python Sandbox in one system. Runs on your S3 with built-in vector search, full-text search, and Python execution for AI-powered data analysis.

Key Features

  • Enterprise data warehouse built in Rust — analytics, vector search, full-text search, and auto schema evolution unified in one engine
  • Agent-ready architecture with Sandbox UDF for running Python agent logic, SQL orchestration, and transactions
  • Git-like data branching for safe experimentation on production data snapshots
  • Elastic cloud-native compute on S3, Azure, and GCS with separated storage and compute
  • Python sandbox UDFs enabling LLM calls and tool use directly within SQL functions
  • Docker one-liner local setup and free cloud tier for instant onboarding

Use Cases

💡 AI agent data backends — agents query and analyze enterprise data via SQL and Python UDFs
💡 Real-time analytics and BI on large-scale structured and semi-structured data
💡 Search and RAG pipelines combining vector embeddings with full-text search
💡 Data versioning and safe experimentation using Git-like branching
💡 Replacing legacy data warehouses with a modern, agent-native engine

Strengths & Limitations

✅ Strengths

  • • Actively maintained, recent updates
  • • High community interest (9.4k stars)
  • • Established track record (5 years in production)

⚠️ Limitations

  • • High issue backlog (570 open issues)
  • • No clear open-source license

Tags

database vector-database rag rust data-processing

Categories

📚 RAG Tools 🏗️ Sandbox & Execution

Quick Start

pip install 'databend-driver[local]>=0.34.0'
python3 -c "from databend_driver import connect; c=connect('databend+local:///./local-state'); print(c.query_row(\"SELECT 'Hello, Databend!'\").values())"
Visit GitHub

Related Projects

DeepLake

9.2k · C++
Stale B

AI Data Runtime for Agents. Provides serverless Postgres with a multimodal datalake, enabling scalable retrieval and training. Unifies vector storage, dataset management, and streaming data loading for AI agent workflows.

vector-databasedata-processingpython +3
  • · AI data runtime for agents providing serverless Postgres with multimodal datalake architecture
  • · Unified vector storage, dataset management, and streaming data loading for LLM apps and deep learning training
  • · Native multi-cloud support with a single API to operate S3, GCP, Azure, and local storage
View full details → View on GitHub

Endee

1.3k · C++
Normal B

A high-performance vector database designed to handle up to 1 billion vectors on a single node, delivering significant performance gains through optimized indexing and execution. Also available as a cloud service.

vector-databasedatabaserag +1
  • · High-performance vector database built in C++ with optimized indexing for up to 1 billion vectors on a single node
  • · Hybrid retrieval combining dense vector search with sparse vectors and payload filtering
  • · CPU-targeted builds supporting AVX2, AVX512, NEON, and SVE2 for maximum hardware utilization
View on GitHub

HelixDB

5.9k · Rust
Active A+

An open-source graph-vector database built from scratch in Rust, combining graph database and vector retrieval capabilities to provide AI agents with unified storage for both knowledge graphs and semantic search.

graph-databasevector-databaserag +2
  • · Graph-vector database combining graph traversal and vector similarity search in one system
  • · Rust-based engine for high performance with low resource consumption
  • · TypeScript and Rust SDKs with declarative query DSL for building queries
View full details → View on GitHub

Quivr

39.5k · Python
Active A+

Opinionated RAG framework for integrating GenAI into your apps. Works with any LLM, any vectorstore, any files — so you can focus on your product instead of building RAG pipelines.

ragpythonvector-database +3
  • · Opinionated RAG framework — Ready-to-use RAG pipeline, no need to build from scratch
  • · Any file support — PDF, TXT, Markdown and more with custom parser support
  • · Multi-LLM compatible — OpenAI, Anthropic, Mistral, Gemma and Ollama local models
View full details → View on GitHub