FunASR

Active
GitHub Python MIT

Description

FunASR is an industrial-grade open-source speech recognition toolkit from Alibaba DAMO Academy, 170x faster than Whisper. Supports 50+ languages, speaker diarization, emotion recognition, and an OpenAI-compatible API with MCP server.

Key Features

  • Ultra-fast recognition — SenseVoice-Small runs at 170× realtime on GPU and 17× realtime on CPU
  • Speaker diarization + emotion recognition — Automatically annotate speaker IDs and emotion labels from a single audio clip
  • Streaming recognition — WebSocket-based real-time streaming ASR for call QA and live captioning use cases
  • OpenAI-compatible API + MCP — /v1/audio/transcriptions endpoint and an MCP server for AI agents

Use Cases

💡 Auto-transcribe meeting recordings and separate speakers, outputting structured subtitle files
💡 Real-time call transcription in a customer-service QA system with automatic flagging of abnormal conversations
💡 Integrate speech recognition into Claude / Cursor and other AI agent toolchains via the MCP server

Strengths & Limitations

Strengths

  • Actively maintained, recent updates
  • High community interest (20.2k stars)
  • Permissive open-source license (MIT)
  • Established track record (3 years in production)

Quick Start

# One-liner install
pip install funasr

# Basic ASR with VAD + speaker diarization + timestamps
from funasr import AutoModel
model = AutoModel(model="iic/SenseVoiceSmall",
                  vad_model="fsmn-vad", spk_model="cam++", device="cuda")
result = model.generate(input="audio.wav")

# Start OpenAI-compatible API server
funasr-server --device cuda
# POST /v1/audio/transcriptions

Related Projects

Tongyi DeepResearch

19.9k · Python
Stale B

Open-source deep research agent from Alibaba Tongyi Lab, using multi-stage iterative information retrieval and reasoning to conduct deep analysis, synthesis, and summarization of complex topics with web search and document analysis.

pythonagentllm +3
  • · 30.5B total parameter agentic LLM with only 3.3B activated per token (MoE architecture)
  • · Fully automated synthetic data generation pipeline for agentic pre-training, SFT, and RL
  • · Large-scale continual pre-training on diverse agentic interaction data

Vision Agents

8.1k · Python
Active A+

Open Vision Agents by Stream. Build voice and vision agents quickly with any model or video provider, using Stream's edge network for ultra-low latency realtime interactions.

voiceagentpython +3
  • · Real-time video AI with YOLO, Roboflow integration combined with Gemini/OpenAI for live visual understanding
  • · Ultra-low latency audio/video under 30ms via Stream's edge network with 500ms join time
  • · Native SDK methods from OpenAI, Gemini, and Claude for always-latest LLM capabilities

Agent Service Toolkit

4.5k · Python
Active A+

Full toolkit for running an AI agent service built with LangGraph, FastAPI, and Streamlit, providing a complete reference architecture for agent service deployment.

langgraphfastapistreamlit +3
  • · LangGraph-based agent with human-in-the-loop via interrupt(), long-term memory with Store, and flow control with Command
  • · FastAPI service with both streaming and non-streaming endpoints for flexible agent serving
  • · Streamlit chat interface with voice input/output for interactive agent communication

MiroThinker

8.4k · Python
Normal A

A deep research agent framework optimized for complex research and prediction tasks, with MiroThinker-1.7 and MiroThinker-H1 models achieving 74.0 and 88.2 on BrowseComp benchmark, supporting multi-step reasoning and information retrieval.

pythonagentllm +3
  • · Deep research agent framework optimized for complex research and prediction tasks
  • · MiroThinker-1.7 achieves 74.0 on BrowseComp, H1 model reaches 88.2
  • · Supports 256K context window and up to 300 tool calls per task