MoH: Multi-Head Attention as Mixture-of-Head Attention

Offical implementation of "Integer-Valued Training and Spike-Driven Inference Spiking Neural Network for High-performance and Energy-efficient Object Detection" (ECCV2024 Best Paper Candidate)

Offical implementation of "MetaLA: Unified Optimal Linear Approximation to Softmax Attention Map" (NeurIPS2024 Oral)

Offical implementation of "Scaling Spike-driven Transformer with Efficient Spike Firing Approximation Training" (IEEE T-PAMI2025)

More relighting!

This is simple code of SpikedAttention (Neurips 2024)

LLaVA-CoT, a visual language model capable of spontaneous, systematic reasoning

A curated list of resources for using LLMs to develop more competitive grant applications.

Official implementation of "ViewCrafter: Taming Video Diffusion Models for High-fidelity Novel View Synthesis"

An LLM-free Multi-dimensional Benchmark for Multi-modal Hallucination Evaluation

[ACMMM 2024] AesExpert: Towards Multi-modality Foundation Model for Image Aesthetics Perception

An expert benchmark aiming to comprehensively evaluate the aesthetic perception capacities of MLLMs.

Unified Multi-modal IAA Baseline and Benchmark

Mamba SSM architecture

Offical code of "QKFormer: Hierarchical Spiking Transformer using Q-K Attention" (NeurIPS 2024，Spotlight 3%)

Official implementation of 'Motion Inversion For Video Customization'

Offical implementation of "Spike-driven Transformer V2: Meta Spiking Neural Network Architecture Inspiring the Design of Next-generation Neuromorphic Chips" (ICLR2024)

[ICCV-23] Masked Spiking Transformer

Spiking Global-Local Fusion Transformer

A Protein Large Language Model for Multi-Task Protein Language Processing

【Nature Computational Science 2025🔥】Deep peak property learning for efficient chiral molecules ECD spectra prediction

Simple, minimal implementation of the Mamba SSM in one file of PyTorch.

Open-sourced codes for MiniGPT-4 and MiniGPT-v2 (https://minigpt-4.github.io, https://minigpt-v2.github.io/)

The official repo of Qwen-VL (通义千问-VL) chat & pretrained large vision language model proposed by Alibaba Cloud.

[ICLR'25] PiCO: Peer Review in LLMs based on the Consistency Optimization, https://arxiv.org/pdf/2402.01830

A paper list of spiking neural networks, including papers, codes, and related websites. 本仓库收集脉冲神经网络相关的顶会顶刊论文和代码，正在持续更新中。

[AAAI-2024] HARDVS: Revisiting Human Activity Recognition with Dynamic Vision Sensors

Mixture-of-Experts for Large Vision-Language Models