HomeProjectsArticlesPK BoardAbout
Explore Projects

Airweave

Normal
GitHub Python MIT

Description

Open-source context retrieval layer for AI agents that automatically extracts, indexes, and retrieves structured context from diverse data sources.

Key Features

  • 50+ integrations with popular apps, databases, and documents
  • Unified LLM-friendly search interface for multiple data sources
  • Continuous data sync with automatic indexing
  • SDKs, REST API, and MCP support for agent integration
  • Cloud-hosted and self-hosted deployment options
  • Built-in authentication and data ingestion pipelines

Use Cases

💡 Enterprise knowledge base retrieval for AI agents
💡 RAG systems requiring multi-source context aggregation
💡 Customer support bots needing up-to-date product information
💡 Research assistants aggregating data from multiple platforms
💡 Internal tools requiring unified search across SaaS applications

Strengths & Limitations

✅ Strengths

  • • High community interest (6.6k stars)
  • • Permissive open-source license (MIT)

Tags

python rag agent tools data-processing

Categories

📚 RAG Tools

Quick Start

Clone the repo and run ./start.sh to launch locally via Docker. Access the UI at http://localhost:8080. Alternatively, use the cloud version at app.airweave.ai. Connect your data sources through the dashboard and query via SDK or API.
Visit GitHub Visit Website

Related Projects

Docstrange

1.5k · Python
Stale B

Extract and convert data from any document (PDFs, images, Word, PPT, URLs) into multiple formats including Markdown, JSON, and CSV.

pythonragtools +2
  • · Multi-format conversion — transforms PDF, DOCX, PPTX, XLSX, images, and URLs into Markdown, JSON, CSV, and HTML
  • · 7B parameter model — upgraded core model for significantly higher accuracy and deeper document understanding
  • · Advanced OCR pipeline — extracts text from scanned documents, phone photos, and receipts with high accuracy
View on GitHub

PDFMathTranslate

36.6k · Python
Active A+

AI-powered PDF scientific paper translation with preserved formats, supporting Google/DeepL/Ollama/OpenAI services via CLI/GUI/MCP/Docker/Zotero.

ragpythontools +2
  • · Layout-preserving translation — Translates PDF papers while preserving formulas, charts, TOC and annotations in original layout
  • · Multiple translation engines — Supports Google Translate, DeepL, Ollama, OpenAI, MiniMax and more
  • · Multiple interfaces — CLI command line, Gradio GUI, Docker container, Zotero plugin and other access methods
View full details → View on GitHub

SAG

2.5k · Python
Active A

SQL-Driven RAG Engine that automatically builds knowledge graphs during querying, combining SQL query capabilities with Retrieval-Augmented Generation for efficient knowledge retrieval.

pythonragtools +2
  • · SQL-driven RAG engine that automatically builds knowledge graphs at query time instead of pre-maintaining them
  • · Three-stage smart search: entity recall → multi-hop expansion → intelligent ranking (PageRank)
  • · Semantic atomic event extraction — automatically decomposes documents into structured events and multi-dimensional entities
View on GitHub

LangExtract

38.5k · Python
Active A+

A Python library by Google for extracting structured information from unstructured text using LLMs with precise source grounding and interactive visualization, designed for data annotation and knowledge extraction workflows.

data-processingllmpython +2
  • · Precise source grounding — Every extraction maps to exact source text location with visual highlighting for traceability and verification
  • · Controlled structured outputs — Few-shot example enforced output schema, leveraging Gemini controlled generation for robust results
  • · Long document optimization — Text chunking, parallel processing, and multi-pass strategy to overcome needle-in-a-haystack challenges
View full details → View on GitHub