Implementation of MusicLM, Google's new SOTA model for music generation using attention networks, in Pytorch

A TypeScript Apollo Server example

VRT: A Video Restoration Transformer (official repository)

Implementation of Bit Diffusion, Hinton's group's attempt at discrete denoising diffusion, in Pytorch

A collection of AWESOME things about Graph-Related LLMs.

Implementation of an Attention layer where each head can attend to more than just one token, using coordinate descent to pick topk

An open-source efficient deep learning framework/compiler, written in python.

Code & data for AAAI'23 Oral paper "Heterogeneous Graph Masked Autoencoders".

A modern Python application packaging and distribution tool

Official Implementation of Time Series Generation with Masked Autoencoder (ExtraMAE)

Open source package for Survival Analysis modeling

Survival analysis built on top of scikit-learn

Interact, analyze and structure massive text, image, embedding, audio and video datasets

This is an open-source toolkit for Heterogeneous Graph Neural Network(OpenHGNN) based on DGL.

GraphMAE: Self-Supervised Masked Graph Autoencoders in KDD'22

The AMLSim project is intended to provide a multi-agent based simulator that generates synthetic banking transaction data together with a set of known money laundering patterns - mainly for the pur…

Implementation of fused cosine similarity attention in the same style as Flash Attention

Pre-trained Nordic models for BERT

Learning in infinite dimension with neural operators.

[NeurIPS 2021] Galerkin Transformer: a linear attention without softmax for Partial Differential Equations

Solving PDEs with NNs

An ultimately comprehensive paper list of Vision Transformer/Attention, including papers, codes, and related websites

Vector (and Scalar) Quantization, in Pytorch

text and image to video generation: CogVideoX (2024) and CogVideo (ICLR 2023)

This is an official implementation for "Swin Transformer: Hierarchical Vision Transformer using Shifted Windows".

MagTense - a micromagnetism and magnetostatic framework

JAX-based neural network library

BertViz: Visualize Attention in NLP Models (BERT, GPT2, BART, etc.)

Implementation of Hierarchical Transformer Memory (HTM) for Pytorch