[CoRL 2024] Open-TeleVision: Teleoperation with Immersive Active Visual Feedback

Tensors and Dynamic neural networks in Python with strong GPU acceleration

A modular, primitive-first, python-first PyTorch library for Reinforcement Learning.

[CVPR 2022] HiVT: Hierarchical Vector Transformer for Multi-Agent Motion Prediction

ReKep: Spatio-Temporal Reasoning of Relational Keypoint Constraints for Robotic Manipulation

robomimic: A Modular Framework for Robot Learning from Demonstration

RoboCasa: Large-Scale Simulation of Everyday Tasks for Generalist Robots

SAPIEN Manipulation Skill Framework, a GPU parallelized robotics simulator and benchmark

OpenVLA: An open-source vision-language-action model for robotic manipulation.

GRUtopia: Dream General Robots in a City at Scale

Humanoid-Gym: Reinforcement Learning for Humanoid Robot with Zero-Shot Sim2Real Transfer https://arxiv.org/abs/2404.05695

Evaluating and reproducing real-world robot manipulation policies (e.g., RT-1, RT-1-X, Octo) in simulation under common setups (e.g., Google Robot, WidowX+Bridge)

robosuite: A Modular Simulation Framework and Benchmark for Robot Learning

Unified framework for robot learning built on NVIDIA Isaac Sim

Multi-Joint dynamics with Contact. A general purpose physics simulator.

🤗 LeRobot: State-of-the-art Machine Learning for Real-World Robotics in Pytorch

HumanPlus: Humanoid Shadowing and Imitation from Humans

A Unified Framework for scalable Vehicle Trajectory Prediction

MetaDrive: Open-source driving simulator

[RSS 2023] Diffusion Policy Visuomotor Policy Learning via Action Diffusion

Isaac Gym Environments for Legged Robots

🤗 The largest hub of ready-to-use datasets for ML models with fast, easy-to-use and efficient data manipulation tools

🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

A gym environment for ALOHA

18 Lessons, Get Started Building with Generative AI 🔗 https://microsoft.github.io/generative-ai-for-beginners/

Uncertainty quantification with PyTorch

ScenarioNet: Scalable Traffic Scenario Management System for Autonomous Driving

PSOPT Optimal Control Software

[ICRA 2024] Differentiable Joint Conditional Prediction and Cost Evaluation for Tree Policy Planning