LiteLLM
LiteLLM provides a unified interface and proxy gateway for LLM calls, simplifying multi-model switching, routing, and cost control.
Orchestration tools for agent workflows
LiteLLM provides a unified interface and proxy gateway for LLM calls, simplifying multi-model switching, routing, and cost control.
Haystack is an enterprise-grade framework for RAG and search applications, covering document processing, retrieval, generation, and evaluation end to end.
Flowise is a low-code builder for LLM apps that lets you create agent workflows and RAG applications with drag-and-drop interfaces.
LangGraph is an agent workflow orchestration framework from the LangChain team, using graph structures to model agent state and transitions.
Dify is an open-source LLM application development platform with a visual agent orchestration interface, supporting workflows, knowledge bases, and multiple models.
Promptflow is a development and evaluation toolkit for LLM applications and agent workflows, with visual orchestration and debugging.
TaskWeaver is Microsoft's open-source code-interpreter-style agent framework, suitable for data analysis and complex task automation.
DSPy is a declarative LLM programming framework focused on optimizable prompts and program structure, suitable for complex agent workflows.