A high-throughput and memory-efficient inference and serving engine for LLMs

Easy and Efficient Quantization for Transformers

Ongoing research training transformer models at scale

A PyTorch Extension: Tools for easy mixed precision and distributed training in Pytorch

Fast and memory-efficient exact attention

Samples for CUDA Developers which demonstrates features in CUDA Toolkit

Knowre 데브옵스 커리큘럼

Models and examples built with TensorFlow

🤗 Transformers: State-of-the-art Natural Language Processing for Pytorch, TensorFlow, and JAX.

TensorFlow code and pre-trained models for BERT

Deep Learning Examples

Tensors and Dynamic neural networks in Python with strong GPU acceleration