A generative world for general-purpose robotics & embodied AI learning.

Official implementation of the paper "Unifying 3D Vision-Language Understanding via Promptable Queries"

Official implementation of paper: SFT Memorizes, RL Generalizes: A Comparative Study of Foundation Model Post-training

Offical code for the CVPR 2024 Paper: Separating the "Chirp" from the "Chat": Self-supervised Visual Grounding of Sound and Language

[NeurIPS 2024 Best Paper][GPT beats diffusion🔥] [scaling laws in visual generation📈] Official impl. of "Visual Autoregressive Modeling: Scalable Image Generation via Next-Scale Prediction". An *ult…

[ICLRW 2024] Efficient Remote Sensing with Harmonized Transfer Learning and Modality Alignment

A python toolkit for parsing captions (in natural language) into scene graphs (as symbolic representations).

RS5M: a large-scale vision language dataset for remote sensing [TGRS]

🛰️ Official repository of paper "RemoteCLIP: A Vision Language Foundation Model for Remote Sensing" (IEEE TGRS)

Official code for "SIRS: Multi-task Joint Learning for Remote Sensing Foreground-entity Image-text Retrieval" TGRS2024

Code of paper “Transcending Fusion A Multi Scale Alignment Method for Remote Sensing Image Text Retrieval”

A Prior Instruction Representation Framework for Remote Sensing Image-text Retrieval (MM'23 Oral)

🎮 A Benchmark and Awesome Collection of Methods for Remote Sensing Image-Text Retrieval (RSITR)｜ Remote Sensing Cross-Model Retrieval (RSCMR) | Remote Sensing Vision-Lanuage Models (RSVLMs)

Parameter-Efficient Transfer Learning for Remote Sensing Image-Text Retrieval, 2023

🧀 [ACMMM'23 Oral] Official Code for “A Prior Instruction Representation Framework for Remote Sensing Image-text Retrieval”

📖 Official Code for “PIR-CLIP: Remote Sensing Image-text Retrieval with Prior Instruction Representation Learning”

Collaborative Learning of Anomalies with Privacy (CLAP) for Unsupervised Video Anomaly Detection: A New Baseline

[CVPR 2024] TEA: Test-time Energy Adaptation

Collection of awesome test-time (domain/batch/instance) adaptation methods

Official JAX implementation of Learning to (Learn at Test Time): RNNs with Expressive Hidden States

Official PyTorch implementation of Learning to (Learn at Test Time): RNNs with Expressive Hidden States

Heterogeneous Federated Learning: State-of-the-art and Research Challenges

TPAMI 2024 - Federated Learning for Generalization, Robustness, Fairness: A Survey and Benchmark

[CVPR 2024] Official Repository for "Efficient Test-Time Adaptation of Vision-Language Models"

[ECCV2024] VideoMamba: State Space Model for Efficient Video Understanding

Cambrian-1 is a family of multimodal LLMs with a vision-centric design.

Flower: A Friendly Federated AI Framework

PyTorch implementation of: D. Shenaj, M. Toldo, A. Rigon and P. Zanuttigh, “Asynchronous Federated Continual Learning”, CVPR 2023 Workshop on Federated Learning for Computer Vision (FedVision).