Matryoshka Multimodal Models

Accelerating the development of large multimodal models (LMMs) with lmms-eval

[CVPR 2024 Highlight🔥] Chat-UniVi: Unified Visual Representation Empowers Large Language Models with Image and Video Understanding

[NeurIPS'23 Oral] Visual Instruction Tuning (LLaVA) built towards GPT-4V level capabilities and beyond.

🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

Video-LLaVA: Learning United Visual Representation by Alignment Before Projection

An automatic evaluator for instruction-following language models. Human-validated, high-quality, cheap, and fast.

An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.

Python toolbox for sampling Determinantal Point Processes

Pytorch implementation of DoReMi, a method for optimizing the data mixture weights in language modeling datasets

Code for Improving Factuality and Reasoning in Language Models through Multiagent Debate

Datasets, Transforms and Models specific to Computer Vision

Implementation of f-AnoGAN with PyTorch

A framework for data augmentation for 2D and 3D image classification and segmentation

Code accompanying the paper Probabilistic Selection of Pseudo-Points for Sparse Gaussian Processes.

MICCAI 2017 Paper - Optimal Transport for Diffeomorphic Registration

This repository stores the the assignments and lecture notes for the University of Toronto Graduate Course Computational Design and Fabrication