zvec

Active
GitHub C++ Apache-2.0

Description

A lightweight, lightning-fast, in-process vector database by Alibaba with C++ core, Node.js and Python bindings, designed for RAG, agent memory, and vector search use cases.

Key Features

  • Blazing fast in-process vector database searching billions of vectors in milliseconds
  • Dense and sparse vector support with native multi-vector queries in a single call
  • Hybrid search combining semantic similarity with structured filters for precise results
  • Durable storage via write-ahead logging (WAL) guaranteeing persistence across crashes
  • Python and Node.js bindings with simple pip/npm install — zero config, zero servers
  • Battle-tested within Alibaba Group for production-grade low-latency similarity search

Use Cases

💡 Embedding vector search for RAG (Retrieval-Augmented Generation) pipelines
💡 Agent memory storage and retrieval for long-term conversational context
💡 Real-time similarity search in edge devices, notebooks, and server applications
💡 Multi-modal embedding search combining text, image, and audio vectors

Strengths & Limitations

Strengths

  • Actively maintained, recent updates
  • High community interest (15.6k stars)
  • Permissive open-source license (Apache-2.0)
  • Responsive to issues, low backlog

Categories

Quick Start

Install via pip: `pip install zvec` (Python 3.10-3.14) or npm: `npm install @zvec/zvec`. Define a schema, create a collection, insert documents with vectors, and run similarity queries. Example: `collection.query(zvec.VectorQuery("embedding", vector=[0.4,0.3,0.3,0.1]), topk=10)`.

Related Projects

DeepLake

9.2k · C++
Stale B

AI Data Runtime for Agents. Provides serverless Postgres with a multimodal datalake, enabling scalable retrieval and training. Unifies vector storage, dataset management, and streaming data loading for AI agent workflows.

vector-databasedata-processingpython +3
  • · AI data runtime for agents providing serverless Postgres with multimodal datalake architecture
  • · Unified vector storage, dataset management, and streaming data loading for LLM apps and deep learning training
  • · Native multi-cloud support with a single API to operate S3, GCP, Azure, and local storage

Kuzu

4.0k · C++
Stale C

An embedded property graph database built for speed with built-in vector search and full-text search, implementing Cypher query language for knowledge graph construction and AI agent structured knowledge retrieval.

databasevector-databaserag +3
  • · Embedded property graph database: runs directly embedded in applications without server processes, supports Cypher query language and flexible property graph data model
  • · Native vector search and full-text search: built-in vector index and full-text search (FTS) capabilities for semantic retrieval without external vector databases
  • · Columnar storage and high-performance queries: columnar disk storage with CSR adjacency list indices, vectorized query processor, and multi-core parallelism for large-scale graph analytics

TrustGraph

2.7k · Python
Active A+

A graph-native context development platform for storing, enriching, and retrieving structured knowledge with semantic search and portable context cores, supporting RDF, SPARQL, and other standards for AI agent knowledge management.

ragmemorydatabase +3
  • · Context Graph engine with automated entity/relationship extraction and ontology-driven graph construction
  • · Out-of-the-box RAG pipelines: DocumentRAG, GraphRAG, and OntologyRAG
  • · Multi-model database system supporting tabular, document, graph, vector, image, video, and audio data

RAGatouille

4.0k · Python
Stale C

Easily use and train state of the art late-interaction retrieval methods (ColBERT) in any RAG pipeline. Designed for modularity and ease-of-use, backed by research.

ragpythonembedding +1
  • · ColBERT late-interaction retrieval: wraps advanced ColBERT models into simple APIs, enabling late-interaction retrieval methods in RAG pipelines without deep IR research knowledge
  • · End-to-end training and fine-tuning: built-in RAGTrainer and TrainingDataProcessor with automatic deduplication, positive/negative pairing and hard negative mining, supporting training from scratch or fine-tuning pretrained models
  • · Modular composable architecture: DataProcessor, NegativeMiner and other components can be used independently, with support for custom NegativeMiner integration into training pipelines