This is the first released survey paper on hallucinations of large vision-language models (LVLMs). To keep track of this field and continuously update our survey, we maintain this repository of rel…

Fine-grained Vision-language Pre-training for Enhanced CT Image Understanding (ICLR 2025)

Code for ALBEF: a new vision-language pre-training method

✨✨Woodpecker: Hallucination Correction for Multimodal Large Language Models. The first work to correct hallucinations in MLLMs

Colab Notebooks covering deep learning tools for biomolecular structure prediction and design

Implementation of RLHF (Reinforcement Learning with Human Feedback) on top of the PaLM architecture. Basically ChatGPT but with PaLM

[ICLR 2025] Diffusion Feedback Helps CLIP See Better

An open-source framework for training large multimodal models.

The original code for paper "Towards a Holistic Framework for Multimodal LLM in 3D Brain CT Radiology Report Generation"

M3D: Advancing 3D Medical Image Analysis with Multi-Modal Large Language Models

Developing Generalist Foundation Models from a Multimodal Dataset for 3D Computed Tomography

Automated lung segmentation in CT

Automatically segment lung cancer in CTs