txtai

Active
GitHub Python Apache-2.0

Description

All-in-one AI framework for semantic search, LLM orchestration, and language model workflows with agent support, RAG, and vector database

Key Features

  • All-in-one AI framework for semantic search, LLM orchestration, and workflows
  • Embeddings database combining vector indexes, graph networks, and relational DBs
  • Multimodal embeddings for text, documents, audio, images, and video
  • Autonomous agents connecting embeddings, pipelines, and workflows
  • Web API and MCP API with bindings for JavaScript, Java, Rust, and Go
  • pip install and ready to go with sensible defaults

Use Cases

💡 Semantic search and similarity retrieval applications
💡 Retrieval-augmented generation (RAG) systems
💡 Multi-model workflow and pipeline orchestration
💡 Knowledge graphs and semantic graph analysis
💡 Document Q&A and automatic labeling

Strengths & Limitations

Strengths

  • Actively maintained, recent updates
  • High community interest (12.9k stars)
  • Permissive open-source license (Apache-2.0)
  • Responsive to issues, low backlog

Quick Start

Install with pip install txtai, then create an embeddings index in a few lines: import txtai; embeddings = txtai.Embeddings(); embeddings.index(["text1", "text2"]); embeddings.search("query", 1). Or start the API with a YAML config.

Related Projects

PromptTools

3.1k · Python
Stale B

PromptTools provides open-source tools for prompt testing and experimentation, supporting multiple LLMs (OpenAI, LLaMA) and vector databases (Chroma, Weaviate, LanceDB) to help developers systematically evaluate and optimize RAG systems.

prompt-testingragevaluation +3
  • · Open-source prompt testing and experimentation across multiple LLM providers
  • · Supports OpenAI, Anthropic, LLaMA, Mistral, Gemini, HuggingFace, and more
  • · Vector database evaluation: Chroma, Weaviate, Qdrant, LanceDB, Pinecone

AI Engineering Hub

37.3k · Jupyter Notebook
Active A+

In-depth tutorials on LLMs, RAGs and real-world AI agent applications. Rich notebook examples for learning AI engineering practices.

ragagentllm +1
  • · 93+ production-ready projects — Covering OCR, RAG, agents, voice, multimodal, and more
  • · Three difficulty tiers — Beginner (22), intermediate (48), advanced (23) projects for progressive learning
  • · LLM hands-on tutorials — Local deployment and applications with DeepSeek, Llama, Gemma, Qwen models

LangExtract

38.5k · Python
Active A+

A Python library by Google for extracting structured information from unstructured text using LLMs with precise source grounding and interactive visualization, designed for data annotation and knowledge extraction workflows.

data-processingllmpython +2
  • · Precise source grounding — Every extraction maps to exact source text location with visual highlighting for traceability and verification
  • · Controlled structured outputs — Few-shot example enforced output schema, leveraging Gemini controlled generation for robust results
  • · Long document optimization — Text chunking, parallel processing, and multi-pass strategy to overcome needle-in-a-haystack challenges

Docstrange

1.5k · Python
Stale B

Extract and convert data from any document (PDFs, images, Word, PPT, URLs) into multiple formats including Markdown, JSON, and CSV.

pythonragtools +2
  • · Multi-format conversion — transforms PDF, DOCX, PPTX, XLSX, images, and URLs into Markdown, JSON, CSV, and HTML
  • · 7B parameter model — upgraded core model for significantly higher accuracy and deeper document understanding
  • · Advanced OCR pipeline — extracts text from scanned documents, phone photos, and receipts with high accuracy

Related Articles