Cosmos-Transfer1 is a world-to-world transfer model designed to bridge the perceptual divide between simulated and real-world environments.

SpatialLM: Large Language Model for Spatial Understanding

OpenEMMA, a permissively licensed open source "reproduction" of Waymo’s EMMA model.

A generative world for general-purpose robotics & embodied AI learning.

Cosmos is a world model development platform that consists of world foundation models, tokenizers and video processing pipeline to accelerate the development of Physical AI at Robotics & AV labs. C…

Official Implementation of paper "V2XPnP: Vehicle-to-Everything Spatio-Temporal Fusion for Multi-Agent Perception and Prediction"

OpenVLA: An open-source vision-language-action model for robotic manipulation.

VBD: Versatile Behavior Diffusion for Generalized Traffic Agent Simulation

A collection ROS projects utilizing foundation models.

A comprehensive list of papers for the definition of World Models and using World Models for General Video Generation, Embodied AI, and Autonomous Driving, including papers, codes, and related webs…

Collect some related resources of NVIDIA Isaac Sim

CleanDiffuser: An Easy-to-use Modularized Library for Diffusion Models in Decision Making

A tutorial about diffusion model application in planning and control.

An Easy-to-use, Scalable and High-performance RLHF Framework (70B+ PPO Full Tuning & Iterative DPO & LoRA & RingAttention & RFT)

[NeurIPS 2024] NAVSIM: Data-Driven Non-Reactive Autonomous Vehicle Simulation and Benchmarking

🤗 LeRobot: Making AI for Robotics more accessible with end-to-end learning

[CVPR 2023 Best Paper Award] Planning-oriented Autonomous Driving

[ICRA 2024] Differentiable Joint Conditional Prediction and Cost Evaluation for Tree Policy Planning

Hybrid-Prediction Integrated Planning for Autonomous Driving

A curated list of awesome LLM for Autonomous Driving resources (continually updated)

High-quality single file implementation of Deep Reinforcement Learning algorithms with research-friendly features (PPO, DQN, C51, DDPG, TD3, SAC, PPG)

[ICCV 2023 Oral] Game-theoretic modeling and learning of Transformer-based interactive prediction and planning

[ICCV & CVPR Workshop] Learning-enabled Interactive Prediction and Planning Framework for Autonomous Vehicles

This repo contains the code for our paper entitled "Multi-Agent Trajectory Prediction with Heterogeneous Edge-Enhanced Graph Attention Network".

[IEEE T-PAMI 2024] All you need for End-to-end Autonomous Driving

[TNNLS] Differentiable Integrated Prediction and Planning Framework for Urban Autonomous Driving

[ITSC 2023] Predictive Decision-making Framework with Interaction-aware Motion Forecasting Model