Official PyTorch Implementation of "Scalable Diffusion Models with Transformers"

Let us control diffusion models!

An open source deep research clone. AI Agent that reasons large amounts of web data extracted with Firecrawl

Code for the paper "Aligning LLM Agents by Learning Latent Preference from User Edits".

Official inference repo for FLUX.1 models

PhotoMaker [CVPR 2024]

Autoregressive Model Beats Diffusion: 🦙 Llama for Scalable Image Generation

Can large language models provide useful feedback on research papers? A large-scale empirical analysis.

Convert PDF to markdown + JSON quickly with high accuracy

An Obsidian plugin that formats and styles your notes with a focus on configurability and extensibility.

Insert and import citations, bibliographies, notes, and PDF annotations from Zotero into Obsidian.

This repo includes ChatGPT prompt curation to use ChatGPT and other LLM tools better.

THE Copilot in Obsidian

QuickAdd for Obsidian

🔥🔥MLVU: Multi-task Long Video Understanding Benchmark

VideoLLaMA 2: Advancing Spatial-Temporal Modeling and Audio Understanding in Video-LLMs

🔥🔥🔥Latest Papers, Codes and Datasets on Vid-LLMs.

[NeurIPS-2024] 📈 Scaling Laws with Vocabulary: Larger Models Deserve Larger Vocabularies https://arxiv.org/abs/2407.13623

Language models scale reliably with over-training and on downstream tasks

Python Library to evaluate VLM models' robustness across diverse benchmarks

relplot: Utilities for measuring calibration and plotting reliability diagrams

Code for In-context Vectors: Making In Context Learning More Effective and Controllable Through Latent Space Steering

[NeurIPS 2024 Best Paper][GPT beats diffusion🔥] [scaling laws in visual generation📈] Official impl. of "Visual Autoregressive Modeling: Scalable Image Generation via Next-Scale Prediction". An *ult…

[ICML 2024] Official implementation for "HALC: Object Hallucination Reduction via Adaptive Focal-Contrast Decoding"

[NeurIPS 2024] SimPO: Simple Preference Optimization with a Reference-Free Reward

Reference implementation for DPO (Direct Preference Optimization)

Unsupervised text tokenizer for Neural Network-based text generation.

Analyze the inference of Large Language Models (LLMs). Analyze aspects like computation, storage, transmission, and hardware roofline model in a user-friendly interface.

An efficient video loader for deep learning with smart shuffling that's super easy to digest