Materials for the Hugging Face Diffusion Models Course

Slicing a PyTorch Tensor Into Parallel Shards

Projects for an undergraduate OS course

Gibbs sampling for generating protein sequences

Flexible and powerful tensor operations for readable and reliable code (for pytorch, jax, TF and others)

GPU Accelerated Gaussian Process for Regression

Beyond the Imitation Game collaborative benchmark for measuring and extrapolating the capabilities of language models

Workflow for creating and analyzing the Open Catalyst Dataset

FAIR Chemistry's library of machine learning methods for chemistry

Composable transformations of Python+NumPy programs: differentiate, vectorize, JIT to GPU/TPU, and more

PyTorch extensions for high performance and large scale training.

ProtTrans is providing state of the art pretrained language models for proteins. ProtTrans was trained on thousands of GPUs from Summit and hundreds of Google TPUs using Transformers Models.

A GPipe implementation in PyTorch

Tasks Assessing Protein Embeddings (TAPE), a set of five biologically relevant semi-supervised learning tasks spread across different domains of protein biology.

Facebook AI Research's Automatic Speech Recognition Toolkit

Tasks Assessing Protein Embeddings (TAPE), a set of five biologically relevant semi-supervised learning tasks spread across different domains of protein biology. (DEPRECATED)

A high performance and generic framework for distributed DNN training

Deep learning model converter for PaddlePaddle. (『飞桨』深度学习模型转换工具)

UniRep model, usage, and examples.

🚀 Awesome System for Machine Learning ⚡️ AI System Papers and Industry Practice. ⚡️ System for Machine Learning, LLM (Large Language Model), GenAI (Generative AI). 🍻 OSDI, NSDI, SIGCOMM, SoCC, MLSy…

a language for fast, portable data-parallel computation

Curated list of project-based tutorials

A curated list of awesome C++ (or C) frameworks, libraries, resources, and shiny things. Inspired by awesome-... stuff.

Dopamine is a research framework for fast prototyping of reinforcement learning algorithms.

Reference implementations of MLPerf™ training benchmarks

PArallel Distributed Deep LEarning: Machine Learning Framework from Industrial Practice （『飞桨』核心框架，深度学习&机器学习高性能单机、分布式训练和跨平台部署）

Second place solution for Facebook V competition on Kaggle

Deep Learning papers reading roadmap for anyone who are eager to learn this amazing tech!

Summaries and notes on Deep Learning research papers