Ray

Active
GitHub Python Apache-2.0

Description

Ray is a unified framework for scaling Python and AI applications from a laptop to a cluster.

Key Features

  • Unified distributed runtime — scale from a single machine to a cluster without configuration overhead
  • Ray AI Libraries — built-in ML libraries for Data, Training, Tuning, RL, and Serving
  • Tasks and Actors — simple abstractions for stateless and stateful workloads
  • Ray Serve — programmable model serving with dynamic scaling and batching
  • RLlib — industry-grade reinforcement learning library with support for major RL algorithms
  • Ray Tune — scalable hyperparameter tuning with parallel search algorithms

Use Cases

💡 Train large-scale deep learning models with distributed training across multiple nodes
💡 Deploy ML models as scalable inference services with low-latency autoscaling
💡 Hyperparameter tuning to accelerate model iteration with parallel search
💡 Reinforcement learning training using Ray RLlib
💡 Accelerate data preprocessing pipelines on large datasets

Strengths & Limitations

Strengths

  • Actively maintained, recent updates
  • High community interest (43.7k stars)
  • Permissive open-source license (Apache-2.0)

⚠️ Limitations

  • High issue backlog (3.5k open issues)

Quick Start

# Install Ray
pip install ray

# Initialize local Ray cluster
import ray
ray.init()

# Define remote task
@ray.remote
def square(x):
  return x * x

# Execute 4 tasks in parallel
futures = [square.remote(i) for i in range(4)]
ray.get(futures)

Related Projects

ART

10.7k · Python
Active A+

ART (Agent Reinforcement Trainer) trains multi-step agents for real-world tasks using GRPO reinforcement learning, enabling on-the-job training for models like Qwen, Llama, and more.

reinforcement-learningagent-trainingGRPO +3
  • · GRPO-based reinforcement learning for training multi-step agents on real-world tasks
  • · W&B Training serverless RL with 40% lower cost and 28% faster training via shared inference cluster
  • · Pre-built notebooks for email search, 2048, Tic Tac Toe, Codenames, and MCP tool mastery

OpenClaw-RL

5.7k · Python
Stale B

OpenClaw-RL: Train any agent simply by talking.

reinforcement-learningopenclawskill-learning +1
  • · Fully asynchronous 4-component RL architecture decoupling agent serving, rollout collection, evaluation, and policy training
  • · Self-hosted and private by design — entire stack runs on your infrastructure with no third-party API dependency
  • · Automatic training from natural conversation feedback with zero manual labeling or dataset curation

OpenRLHF

10.0k · Python
Active A

OpenRLHF is a high-performance agentic RL framework based on Ray and vLLM, offering PPO, DAPO, and REINFORCE++ algorithms for large-scale training of agents and vision-language models.

reinforcement-learningagent-trainingPPO +3
  • · First production-ready open-source RLHF framework built on Ray + vLLM distributed architecture
  • · Supports PPO, DAPO, REINFORCE++, GRPO, and RLOO reinforcement learning algorithms
  • · Hybrid engine scheduling where all models share GPUs to minimize idle time

Related Articles