Spring AI

Active
GitHub Java Apache-2.0

Description

An application framework for AI engineering from the Spring team, providing unified LLM integration, vector storage, function calling, RAG, and agent development for Java and Spring ecosystems with support for OpenAI, Anthropic, Ollama, and more.

Key Features

  • Official Spring AI engineering framework bringing Spring ecosystem portability and modular design to AI
  • Unified API supporting all major AI model providers including OpenAI, Anthropic, Google, and Amazon
  • Supports complete model types: chat completion, embedding, text-to-image, audio transcription, and text-to-speech
  • Integrates with 15+ vector databases including PostgreSQL/PGVector, Milvus, Qdrant, and Redis
  • Built-in RAG support, chat conversation memory management, function calling, and structured output conversion
  • Spring Boot auto-configuration and Starters with one-click project initialization via start.spring.io

Use Cases

💡 Integrate AI capabilities in Java/Spring enterprise applications without switching to Python tech stack
💡 Build enterprise knowledge Q&A systems based on RAG combining vector databases and LLMs
💡 Access multiple AI model services through Spring AI in microservice architectures
💡 Build AI agent-driven business process automation using function calling capabilities
💡 Gradually introduce AI features in existing Spring Boot projects while maintaining architectural consistency

Strengths & Limitations

Strengths

  • Actively maintained, recent updates
  • High community interest (9.4k stars)
  • Permissive open-source license (Apache-2.0)
  • Established track record (3 years in production)

⚠️ Limitations

  • High issue backlog (1.5k open issues)

Quick Start

1. Visit start.spring.io to create a project and select Spring AI dependencies
2. Configure AI model API keys in application.yml
3. Inject ChatClient or EmbeddingModel into Spring beans
4. Call chatClient.call("hello") to send chat requests
5. Use Advisor API for RAG and chat memory
6. Auto-configure vector database connections via Spring Boot Starter

Related Projects

Koog

4.6k · Kotlin
Active A

A JVM framework by JetBrains for building predictable, fault-tolerant, enterprise-ready AI agents across all platforms — from backend services to Android, iOS, and in-browser environments, with built-in MCP and multi-provider LLM support.

kotlinjavaframework +6
  • · Multiplatform deployment across JVM, JS, WasmJS, Android, and iOS via Kotlin Multiplatform
  • · Built-in fault-tolerance with automatic retries and agent state persistence for recovery
  • · Intelligent history compression to optimize token usage in long conversations

AgentField

2.5k · Go
Active A

A framework for building, running, and scaling AI agents as APIs and microservices, with built-in observability, auditability, and identity-aware access control from day one.

goagentframework +3
  • · Build AI agents as REST endpoints with Python, Go, or TypeScript — no DSL or YAML required
  • · Cryptographic identity and tamper-proof audit trails for every agent execution
  • · Built-in human-in-the-loop with pause/resume for approval workflows via webhooks

Atmosphere

3.8k · Java
Active A+

Real-time transport layer for Java AI agents supporting WebSocket, SSE, gRPC, and WebTransport/HTTP3, with native MCP, A2A, and AG-UI protocol support for building event-driven AI agent communication architectures.

javaframeworkagent +4
  • · JVM runtime for streaming AI agents with @Agent annotation-driven development — one annotation declares the agent, classpath modules decide integrations
  • · Real-time transport layer supporting WebSocket, SSE, long-polling (always-on defaults), gRPC, and optional WebTransport/HTTP/3
  • · 12 runtime adapters with contract-tested capability flags — swap between Spring AI, LangChain4j, Google ADK, Anthropic, Cohere, CrewAI and more

Google ADK Go

8.7k · Go
Active A

An open-source, code-first Go toolkit by Google for building, evaluating, and deploying sophisticated AI agents with flexible tool integration, multi-turn conversation management, and streaming responses.

goagentframework +3
  • · Idiomatic Go design leveraging native concurrency and performance for cloud-native agent applications
  • · Rich tool ecosystem with pre-built tools, custom functions, and external tool integration
  • · Code-first development approach defining agent logic, tools, and orchestration directly in Go