Everything you need to build state-of-the-art foundation models, end-to-end.

A Python framework for high performance GPU simulation and graphics

Machine Learning Engineering Open Book

This is an online course where you can learn and master the skill of low-level performance analysis and tuning.

Collection of best practices, reference architectures, model training examples and utilities to train large models on AWS.

Material for gpu-mode lectures

NCCL tests for ALCF machines

Optimized primitives for collective multi-GPU communication

Convert PyPI entries to Spack package.py

Performance monitoring and benchmarking suite

The CSCS ReFrame test suite

A high-performance, zero-overhead, extensible Python compiler with built-in NumPy support

Dive Into Ansible Lab

Learning Modern 3D Graphics Programming

Main Web Site (Online Books)

PythonHPC

A tool that facilitates building OCI images.

Slurm in Docker - Exploring Slurm using CentOS 7 based Docker images

A Slurm cluster using docker-compose

Docker local slurm cluster

Example codes from the book Parallel Programming With OpenACC

A powerful Python framework for writing and running portable regression tests and benchmarks for HPC systems.

A sequence of Jupyter notebooks featuring the "12 Steps to Navier-Stokes" http://lorenabarba.com/

ldd as a tree

MPI Cluster Automation Solution using Docker, based on Alpine Linux with MPICH (see IEEE paper)

A little bit about a linux kernel

Slides and code samples for training, tutorials, and workshops about Docker, containers, and Kubernetes.