LLM training in simple, raw C/CUDA

📚LeetCUDA: Modern CUDA Learn Notes with PyTorch for Beginners🐑, 200+ CUDA/Tensor Cores Kernels, HGEMM, FA-2 MMA etc.🔥

how to optimize some algorithm in cuda.

Learn CUDA Programming, published by Packt

Examples demonstrating available options to program multiple GPUs in a single node or a cluster

A set of hands-on tutorials for CUDA programming

CUDA Matrix Multiplication Optimization

HierarchicalKV is a part of NVIDIA Merlin and provides hierarchical key-value storage to meet RecSys requirements. The key capability of HierarchicalKV is to store key-value feature-embeddings on h…

Benchmark tests supporting the TiledCUDA library.