PyTorch implementation for Convolutional Networks with Adaptive Inference Graphs https://github.com/andreasveit/convnet-aig
NVIDIA开源面向精简混合精度和分布式训练的Pytorch扩展 https://github.com/nvidia/apex
PyTorch实现的CIFAR-10/CIFAR-100/MNIST/FashionMNIST图像分类 https://github.com/hysts/pytorch_image_classification
TorchFusion：深度学习框架，基于PyTorch，面向AI系统加速研究与开发 https://github.com/johnolafenwa/TorchFusion
Hypergradient descent https://github.com/gbaydin/hypergradient-descent
An intriguing failing of convolutional neural networks and the CoordConv solution https://github.com/Wizaron/coord-conv-pytorch
PyTorch深度学习微课程 https://github.com/Atcold/pytorch-Deep-Learning https://atcold.github.io/pytorch-Deep-Learning/
FastAI2&PyTorch自监督教程 https://amarsaini.github.io/Epoching-Blog/jupyter/2020/03/23/Self-Supervision-with-FastAI.html
Skeltorch：PyTorch项目原型轻量框架 https://github.com/davidalvarezdlt/skeltorch
高效PyTorch：PyTorch教程与最佳实践集锦 https://github.com/vahidk/EffectivePyTorch
Classy Vision：基于PyTorch的端到端图像/视频分类框架 https://github.com/facebookresearch/ClassyVision https://classyvision.ai/
RaySGD：让分布式Pytorch更简单、更高效 https://github.com/ray-project/ray/tree/master/python/ray/util/sgd/torch
“Torch实战教程” https://www.bilibili.com/video/BV1Qk4y197FR/
NVIDIA GPU上的Pytorch JIT提前编译(AOT) https://github.com/NVIDIA/TRTorch
【基于PyTorch的概率时序预测框架】'PyTorchTS - PyTorch based Probabilistic Time Series forecasting framework based on GluonTS backend' https://github.com/zalandoresearch/pytorch-ts
PyTorch实现的对抗攻击与工具 https://github.com/Harry24k/adversarial-attacks-pytorch
【Pytorch教程资料(Jupyter Notebooks)】’Pytorch_Tutorial - A set of jupyter notebooks on pytorch functions with examples' https://github.com/Tessellate-Imaging/Pytorch_Tutorial
PyTorch深度学习学习与实践(Notebooks合集) https://github.com/dair-ai/pytorch_notebooks
【从PyTorch到PyTorch Lightning】《From PyTorch to PyTorch Lightning — A gentle introduction》 https://towardsdatascience.com/from-pytorch-to-pytorch-lightning-a-gentle-introduction-b371b7caaf09
fastai新书《Deep Learning for Coders with fastai and PyTorch: AI Applications Without a PhD》草稿，fastai/PyTorch深度学习实战 https://github.com/fastai/fastbook
An implementation of DropBlock in PyTorch. DropBlock is a replacement for dropout which zero-es entire spatial blocks instead of single pixels. For more information, check the paper: DropBlock: A regularization method for convolutional networks https://github.com/Randl/DropBlock-pytorch
PyTorch implementation of Multi-Label Image Recognition with Graph Convolutional Networks, CVPR 2019. https://github.com/chenzhaomin123/ML_GCN
PyTorch学习资源汇总 https://github.com/INTERMT/Awesome-PyTorch-Chinese
Benchmark Analysis of Representative Deep Neural Network Architectures https://github.com/CeLuigi/models-comparison.pytorch https://github.com/CeLuigi/models-comparison.pytorch/wiki/Accuracy-vs-Computational-complexity
CNN图片检索 https://github.com/filipradenovic/cnnimageretrieval-pytorch
Video Frame Synthesis using Deep Voxel Flow https://github.com/lxx1991/pytorch-voxel-flow
Fast.ai PyTorch Serverless API (w/ AWS Lambda) https://github.com/alecrubin/pytorch-serverless/
YOLOv3的最小化PyTorch实现 https://github.com/eriklindernoren/PyTorch-YOLOv3
PyTorch神经网络辅助训练高级库ignite https://github.com/pytorch/ignite
PyTorch深度学习微课程 https://github.com/Atcold/pytorch-Deep-Learning
https://github.com/tristandeleu/pytorch-meta
Efficient semantic image segmentation with superpixel pooling https://github.com/bermanmaxim/superpixPool
用于强化学习算法快速原型构建的轻量级PyTorch架构 https://github.com/zuoxingdong/lagom
Pytorch-UNet - Pytorch implementation of the U-Net for image semantic segmentation, with dense CRF post-processing https://github.com/milesial/Pytorch-UNet
ssds.pytorch - Repository for Single Shot MultiBox Detector and its variants, implemented with pytorch, python3. https://github.com/ShuangXieIrene/ssds.pytorch
Glow: Better Reversible Generative Models(人脸变老的效果) https://github.com/chaiyujin/glow-pytorch
用PyTorch 0.4实现的YoloV3 https://github.com/andy-yun/pytorch-0.4-yolov3
(PyTorch)深度强化学习实现集锦 https://github.com/TianhongDai/reinforcement-learning-algorithms
DARTS: Differentiable Architecture Search（网络结构搜索） https://github.com/quark0/darts
Deformable ConvNets V2 in PyTorch https://github.com/chengdazhi/Deformable-Convolution-V2-PyTorch
Implementation code of the paper: FishNet: A Versatile Backbone for Image, Region, and Pixel Level Prediction, NeurIPS 2018 https://github.com/kevin-ssy/FishNet
(PyTorch)机器学习实验管理工具 https://github.com/MIC-DKFZ/trixi https://trixi.readthedocs.io/en/latest/
基于PyTorch的开源医学图像处理框架，提供全套的医学成像载入、预处理模块和数据集 https://medicaltorch.readthedocs.io/en/stable/
Deep Audio-Visual Embedding network (DAVEnet) implementation in PyTorch https://github.com/dharwath/DAVEnet-pytorch
人人皆舞王(Everybody Dance Now)的 PyTorch 实现 https://github.com/nyoki-mtl/pytorch-EverybodyDanceNow
基于PyTorch的高效深度学习库fastai https://github.com/fastai/fastai/ https://docs.fast.ai/
A PyTorch implementation of Xception: Deep Learning with Depthwise Separable Convolutions https://github.com/tstandley/Xception-PyTorch
PyTorch几何计算机视觉库 https://github.com/arraiy/torchgeometry
Transformer implementation in PyTorch https://github.com/tunz/transformer-pytorch
基于PyTorch的深度学习计算机视觉框架 https://github.com/donnyyou/PyTorchCV
PyTorch implementation of CVPR'18 - Perturbative Neural Networks http://xujuefei.com/pnn.html https://github.com/juefeix/pnn.pytorch
A PyTorch implementation of Mnasnet searched architecture: MnasNet: Platform-Aware Neural Architecture Search for Mobile. https://github.com/AnjieZheng/MnasNet-PyTorch
Pytorch Implementation of Refinenet https://github.com/thomasjpfan/pytorch_refinenet
Multi-Task Learning as Multi-Objective Optimization https://github.com/IntelVCL/MultiObjectiveOptimization
'Pytorch TVM Extension' https://github.com/pytorch/tvm
PyTorch implementation of DGCNN (Deep Graph Convolutional Neural Network) https://github.com/muhanzhang/pytorch_DGCNN
用Python实现Transformer https://github.com/SamLynnEvans/Transformer
PyTorch大数据集高效训练最佳实践 https://github.com/Lyken17/Efficient-PyTorch
(Pytorch)GPU内存跟踪工具 https://github.com/Oldpan/Pytorch-Memory-Utils
Pytorch高级训练框架 https://github.com/achaiah/pywick
Facebook基于PyTorch的Ax与BoTorch：简化深度学习实验 https://towardsdatascience.com/facebook-is-making-deep-learning-experimentation-easier-with-these-two-new-pytorch-based-frameworks-5e29754bb8de
(PyTorch)手写体合成与预测 https://github.com/ritheshkumar95/pytorch_handwriting_synthesis
基于mltest的PyTorch单元测试包 https://github.com/suriyadeepan/torchtest
PyTorch深度学习教程资料 https://github.com/sethjuarez/DeepLearningWithPyTorch
60分钟PyTorch深度学习实例入门教程 https://pytorch.org/tutorials/beginner/deep_learning_60min_blitz.html
【pycls：灵活的(PyTorch)图像分类研究框架】'pycls - Codebase for Image Classification Research, written in PyTorch.' https://github.com/facebookresearch/pycls
《动手学深度学习》例子的PyTorch实现 https://github.com/dsgiitr/d2l-pytorch
新书《Deep Learning for Coders with fastai and PyTorch: AI Applications Without a PhD》随书代码 https://github.com/fastai/book_nbs
【PyTorch深度学习教程】 https://www.youtube.com/playlist?list=PLQVvvaa0QuDdeMyHEYc0gxFpYwHY2Qfdh
PyTorch implementation of "Grid anchor based image cropping" https://github.com/HuiZeng/Grid-Anchor-based-Image-Cropping-Pytorch
【PyTorch3d：(PyTorch)3D视觉深度学习库】 https://github.com/facebookresearch/pytorch3d
Implement Towards Effective Low-bitwidth Convolutional Neural Networks https://github.com/nowgood/QuantizeCNNModel
【Hydra：机器学习项目配置的全新视角(PyTorch)】 https://hydra.cc/
【PyTorch封装库，提供了系统的、可扩展的方法，用PyTorch高效构建、训练、评价和优化深度学习模型】 https://github.com/jkoutsikakis/pytorch-wrapper
【PyTorch实现的NCA(Neighbourhood Components Analysis)降维方法】 https://github.com/kevinzakka/nca
【用PyTorch+einops改善深度学习代码】《Writing better code with pytorch+einops》 https://github.com/arogozhnikov/einops
【Hydra：基于PyTorch的多任务学习框架】 https://github.com/hav4ik/Hydra
【PyTorch计算机视觉深度学习模板】 https://github.com/FrancescoSaverioZuppichini/PyTorch-Deep-Learning-Template
【开源书：PyTorch深度学习起步】’First steps towards Deep Learning with pyTorch - This is an open sourced book on deep learning.' b https://github.com/vaibhawvipul/First-steps-towards-Deep-Learning
'torchprofile - A general and accurate MACs / FLOPs profiler for PyTorch models.' https://github.com/mit-han-lab/torchprofile
【PyTorch简化开发工具箱】 https://github.com/PistonY/torch-toolbox
【dlib vs. PyTorch 简单性能评测】 https://github.com/arrufat/dlib-pytorch-benchmark
【用Cortex实现PyTorch模型产品化部署】 https://pan.baidu.com/s/1xzd7ZwC_RMt3AwLsqjtFKw
【Ray：构建和运行分布式应用的快速简单框架，包括可扩展超参微调库Tune和强化学习库RLlib，可实现PyTorch分布式训练】 https://github.com/ray-project/ray
【PyTorch Elastic ：PyTorch分布式训练框架】 https://github.com/pytorch/elastic
将训练数据快速便捷地加载到深度学习框架 https://github.com/NVlabs/tensorcom
【PyTorch半监督学习工具包】 https://github.com/moskomule/ssl-suite
【PyTorch深度学习教程C++实现版】 https://github.com/prabhuomkar/pytorch-cpp
一文总结Pytorch的8张思维导图! https://bigquant.com/community/t/topic/157823?utm_source=weibo&utm_campaign=191121_l1
【PyTorch深度学习项目框架模板(最佳实践)】’PyTorch Project Template - A best practice for deep learning project template architecture.' https://github.com/L1aoXingyu/Deep-Learning-Project-Template
(PyTorch)轻量实时语义分割模型集锦 https://github.com/Tramac/Lightweight-Segmentation
PyTorch 官方推荐了一份 60 分钟的深度学习指南 https://mp.weixin.qq.com/s/fB7iW_luNOyHAMD7GoJMYg
NVIDIA 出品的 PyTorch 模型性能分析工具 https://github.com/NVIDIA/apex/tree/master/apex/pyprof
PyTorch语义分割实现集锦 https://github.com/Tramac/Awesome-semantic-segmentation-pytorch
PytorchInsight - a pytorch lib with state-of-the-art architectures, pretrained models and real-time updated results https://github.com/implus/PytorchInsight
一个包含计算机视觉、自然语言处理领域的诸多经典模型的聚合中心。这年头有很多 Hub，什么 GitHub、SciHub、xxxxHub 等等，但是最近图灵奖得主 Yann LeCun 强推的 PyTorch-Hub。无论是 ResNet、BERT、GPT、VGG、PGAN 还是 MobileNet 等经典模型，只需输入一行代码，都能实现一键调用！妈妈再也不用担心你的模型啦！ https://github.com/pytorch/hub
Life is short, you need PyTorch. https://github.com/Eurus-Holmes/LIS-YNP
PyTorch快速教程 https://github.com/omerbsezer/Fast-Pytorch
Simple, extendable, easy to understand Glow implementation in PyTorch https://github.com/y0ast/Glow-PyTorch
Flambé：面向研究和产品化加速的机器学习实验框架(基于PyTorch) https://github.com/Open-ASAPP/flambe
Official Pytorch Implementation for ICML'19 paper: Unsupervised Deep Learning by Neighbourhood Discovery https://github.com/Raymond-sci/AND
PyTorch Hub：仅需一行代码(torch.hub.load())复用ResNet, ResNext, BERT, GPT, PGAN, Tacotron, DenseNet, MobileNet等最新模型】 https://pytorch.org/blog/towards-reproducible-research-with-pytorch-hub/
DaskMaskRCNN - Running Mask-RCNN on Dask with PyTorch https://github.com/msalvaris/DaskMaskRCNN
PyTorch图像模型代码、脚本、预训练模型集锦 https://github.com/rwightman/pytorch-image-models
PyTorch模型摘要插件 https://github.com/Tramac/torchscope
用PySnooper调试PyTorch代码 https://github.com/zasdfgbnm/TorchSnooper
PyTorch & PyTorch Geometric图神经网络(GNN)实战 https://towardsdatascience.com/hands-on-graph-neural-networks-with-pytorch-pytorch-geometric-359487e221a8
Implementing Billion-scale semi-supervised learning for image classification using Pytorch https://github.com/leaderj1001/Billion-scale-semi-supervised-learning
RetinaNet Examples - Fast and accurate object detection with end-to-end GPU optimization https://github.com/NVIDIA/retinanet-examples
Pytorch分类实验模板 https://github.com/learning-luke/pytorch-experiments-template
Danbooru2018数据集上的ResNet预训练模型(PyTorch) https://github.com/RF5/danbooru-pretrained
Flambé：面向研究和产品化加速的机器学习实验框架(基于PyTorch) https://github.com/asappresearch/flambe
Awesome-Pytorch-list｜厉害的Pytorch项目 https://github.com/xavier-zy/Awesome-pytorch-list-CNVersion
PyTorch工具箱 https://github.com/bonlime/pytorch-tools
PyTorch 实现的神经网络量化算法集 https://github.com/Enderdead/Pytorch_Quantize_impls
PyProf: PyTorch Profiling tool https://github.com/adityaiitb/pyprof2
PyTorch深度学习教程 https://www.bilibili.com/video/av69000304/
https://blog.openmined.org/encrypted-training-on-mnist/
一个包含计算机视觉、自然语言处理领域的诸多经典模型的聚合中心。这年头有很多 Hub，什么 GitHub、SciHub、xxxxHub 等等，但是最近图灵奖得主 Yann LeCun 强推的 PyTorch-Hub。无论是 ResNet、BERT、GPT、VGG、PGAN 还是 MobileNet 等经典模型，只需输入一行代码，都能实现一键调用！
https://github.com/pytorch/hub
https://github.com/ShusenTang/Dive-into-DL-PyTorch
【半监督深度学习训练和实现小Tricks】'Tricks of Semi-supervised Deep Leanring --Pytorch - PseudoLabel 2013, VAT, PI model, Tempens, MeanTeacher, ICT, MixMatch, FixMatch'
https://github.com/iBelieveCJM/Tricks-of-Semi-supervisedDeepLeanring-Pytorch
【PyProf ：PyTorch模块GPU性能分析工具】’PyProf - A GPU performance profiling tool for PyTorch models' https://github.com/NVIDIA/PyProf
TorchServe：最新发布的开源PyTorch模型服务器 https://github.com/pytorch/serve
【AutoTorch超参优化工具集】 https://github.com/StacyYang/AutoTorch
【PyTorch大模型支持】’PyTorch Large Model Support - Large Model Support in PyTorch' https://github.com/IBM/pytorch-large-model-support
【PyTorch高性能数据加载/增广包】 https://github.com/PhoenixDL/rising
【PyTorch Zoo：PyTorch模块/程序集】 https://github.com/bkkaggle/pytorch_zoo
【TorchSketch：基于PyTorch的自由手绘草图深度学习库】 https://github.com/PengBoXiangShang/torchsketch
ESTorch is an Evolution Strategy Library built around PyTorch. https://github.com/goktug97/estorch
rectorch：PyTorch实现的最先进推荐算法 https://github.com/makgyver/rectorch
【用Catalyst加速PyTorch深度学习研究】 https://medium.com/pytorch/catalyst-101-accelerated-pytorch-bd766a556d92
【《动手深度学习》(英文版) 官方增加实例PyTorch实现】 https://d2l.ai/
【PyTorch机器学习：张量操作入门】 https://medium.com/swlh/machine-learning-pytorch-590b09409236
【PyTorch实战教程(Jupyter Notebook)】 https://github.com/curiousily/Getting-Things-Done-with-Pytorch
The Incredible PyTorch（不可思议的 PyTorch）。里面收集了许多与 PyTorch 相关的教程、项目、论文、书籍、视频等资源 https://github.com/ritchieng/the-incredible-pytorch
【高性能PyTorch—消除I/O和CPU瓶颈】 https://towardsdatascience.com/efficient-pytorch-part-1-fe40ed5db76c
【深度学习时序预测】’DeepSeries - Seq2Seq, Bert, Transformer, WaveNet for time series prediction.' https://github.com/EvilPsyCHo/Deep-Time-Series-Prediction
【PyTorch实现的FastSurferCNN】 https://github.com/Deep-MI/FastSurfer
https://github.com/teddykoker/image-gpt
【支持分布式学习的PyTorch深度学习项目模板】’Deep Learning Project Template for PyTorch' https://github.com/ryul99/pytorch-project-template
【PyTorch深度学习：从零到GAN (freeCodeCamp.org)】 https://jovian.ml/forum/c/course-discussions/pytorch-zero-to-gans/18
【用LibTorch构建C++应用示例】 https://github.com/BIGBALLON/PyTorch-CPP
【新手老手都能用的计算机视觉PyTorch解决方案库】 https://github.com/microsoft/computervision-recipes
Intel官方PyTorch扩展版，提供CPU上更好的体验和性能 https://github.com/intel/intel-extension-for-pytorch
【PyTorch数据集读取器，用于直接读取POSIX tar文档】 https://github.com/tmbdev/webdataset
PyTorch计算机视觉自注意力模块包 https://github.com/The-AI-Summer/self-attention-cv
【PyTorch入门(Notebook/Slides)】’Notebook / Slides for ACDL2020 in Siena, Italy' https://github.com/t-vi/acdl2020
【Torch-Pruning：PyTorch结构化神经网络修剪工具包】 https://github.com/VainF/Torch-Pruning
【万字综述，核心开发者全面解读 PyTorch 内部机制】 https://mp.weixin.qq.com/s/N1RuJwCfGmbV2kW5zh7XHQ
【PFRL：基于PyTorch的深度强化学习库】 https://github.com/pfnet/pfrl
https://github.com/haofanwang/Score-CAM
https://github.com/msnh2012/Msnhnet
MiniTorch：面向深度学习实现教学的Torch API复现库 https://minitorch.github.io/
PyTorch 教程代码 https://pytorch.org/tutorials/beginner/deep_learning_60min_blitz.html https://github.com/yunjey/pytorch-tutorial
GitHub 上一本开源的 PyTorch 书籍：《20 天内吃掉那只 PyTorch》 https://github.com/lyhue1991/eat_pytorch_in_20_days
WebDataset：面向大数据集、多文件、多GPU的高效PyTorch I/O库 https://pytorch.org/blog/efficient-pytorch-io-library-for-large-datasets-many-files-many-gpus/
【PyTorch自动混合精度教程】 https://github.com/hoya012/automatic-mixed-precision-tutorials-pytorch
PyTorchTS：PyTorch概率时间序列预测框架 https://github.com/zalandoresearch/pytorch-ts
【PyTorch模型压缩】 https://github.com/j-marple-dev/model_compression
开源的电子书籍：《Getting Things Done with Pytorch》。开发者可从该书中学到有关 PyTorch、神经网络、图像分类、人脸检测、情感分析等基础知识。从书中提供的具体示例，还能进一步了解项目从原型开发到模型部署，最后正式上线生产环境的整个流程。 https://github.com/curiousily/Getting-Things-Done-with-Pytorch
PyTorch性能调优指南(混合精度计算机视觉加速) https://www.bilibili.com/video/BV1g64y1F72n/
torchkit：PyTorch科研小工具/样板 https://github.com/kevinzakka/torchkit
PyTorch Lightning Bolts：新的PyTorch Lightning深度学习研究和生产工具箱，流行模型的PyTorch Lightning实现集合，所有模型经过良好测试和优化，可以在多GPU/TPU上提速运行 https://medium.com/pytorch/pytorch-lightning-bolts-from-boosted-regression-on-tpus-to-pre-trained-gans-5cebdb1f99fe
Pytorch Forecasting：PyTorch时序预测库 https://github.com/jdb78/pytorch-forecasting
https://github.com/koba-jon/pytorch_cpp
pytorchTutorial：PyTorch教程资料 https://github.com/python-engineer/pytorchTutorial
https://github.com/lucidrains/vit-pytorch https://openreview.net/forum?id=YicbFdNTTy
【TorchExpo：PyTorch移动部署模型与扩展集合】'TorchExpo - Collection of models and extensions for mobile deployment in PyTorch' https://torchexpo.rtfd.io/
https://github.com/parrt/tensor-sensor
https://github.com/anguelos/tormentor
Torchserve Dashboard - Management Dashboard for Torchserve https://github.com/cceyda/torchserve-dashboard
DarkTorch：用PyTorch C++前端和NVIDIA GPU实现的低延迟深度学习推理服务器 https://github.com/QuantScientist/DarkTorch
实战教程：用PyTorch实现Transformer https://github.com/gordicaleksa/pytorch-original-transformer
Pytorch贝叶斯神经网络库 https://github.com/Harry24k/bayesian-neural-network-pytorch
TyXe: PyTorch贝叶斯神经网络库 https://github.com/karalets/TyXe
【基于PyTorch Lightning项目大列表】 https://pytorchlightning.ai/community#projects
torchdistill: 知识提炼模块化配置驱动框架 https://github.com/yoshitomo-matsubara/torchdistill
Super Selfish：PyTorch图像自监督学习统一框架，包括基于图块、预测式、生成式、对比式等各类14种算法 https://github.com/MECLabTUDA/Super_Selfish
Ensemble-Pytorch：PyTorch集成学习库 https://github.com/xuyxu/Ensemble-Pytorch
用PyTorch JIT优化模型 https://lernapparat.de/jit-optimization-intro/
PyCave：用PyTorch实现的支持GPU加速的传统机器学习模型 https://github.com/borchero/pycave
VISSL：基于PyTorch的最先进图像自监督学习库 https://github.com/facebookresearch/vissl
Pytorch Image Models (timm)：Ross Wightman创建的深度学习库，集合了SOTA计算机视觉模型、层、实用程序、优化器、调度器、数据加载器等 https://github.com/fastai/timmdocs
Lightning Flash：基于PyTorch Lightning的快速原型化、基线化和微调可扩展深度学习模型任务集合 https://medium.com/pytorch/introducing-lightning-flash-the-fastest-way-to-get-started-with-deep-learning-202f196b3b98
This is my implementation of the experiment in the paper of fixmatch. https://github.com/CoinCheung/fixmatch-pytorch
A PyTorch implementation of our proposed loss function from the paper "SimLoss: Class Similarities in Cross Entropy" https://github.com/konstantinkobs/SimLoss
用ONNX/Torchscript加快BERT推理速度 https://towardsdatascience.com/an-empirical-approach-to-speedup-your-bert-inference-with-onnx-torchscript-91da336b3a41
Quickvision：易用的PyTorch计算机视觉库 https://github.com/Quick-AI/quickvision
storchastic：PyTorch随机深度学习库 https://github.com/HEmile/storchastic
Kindle - 无需代码的PyTorch简单模型构建包 https://github.com/JeiKeiLim/kindle
PyTorch中的梯度累加 https://www.cnblogs.com/lart/p/11628696.html 可以不清零，变相达到扩大batchsize的效果，很好的trick
PyTorch实现的图像代码、脚本、预训练模型集锦 https://github.com/rwightman/pytorch-image-models
PyTorch 学习资源整理汇总，含有学习教程、手册、视频教程和实战项目等资料 https://github.com/INTERMT/Awesome-PyTorch-Chinese
手把手：看例子理解PyTorch https://towardsdatascience.com/understanding-pytorch-with-an-example-a-step-by-step-tutorial-81fc5f8c4e8e
PyTorch从入门到GANs https://medium.com/jovian-io/pytorch-basics-tensors-and-gradients-eb2f6e8a6eee
flaxvision：从torchvision移植的神经网络模型集 https://github.com/rolandgvc/flaxvision
NN Template：使用PyTorch Lightning, Hydra, W&B, DVC的PyTorch项目高效开发模板 https://github.com/lucmos/nn-template
Kineto - A CPU+GPU Profiling library that provides access to timeline traces and hardware performance counters.
https://github.com/pytorch/kineto
fastmoe：基于PyTorch的MoE模型训练系统 https://github.com/laekov/fastmoe
【PyTorch Lightning + Hydra模板】 github.com/hobogalaxy/lightning-hydra-template
【accelerate：在各种设备上简单运行PyTorch训练脚本】 github.com/huggingface/accelerate
PyTorch基础教程——完整的机器学习工作流程指南，详细解释了诸如 Tensors，DataLoaders，Transforms 等概念 https://pytorch.org/tutorials/beginner/basics/intro.html
Torchattacks：PyTorch对抗攻击库 github.com/Harry24k/adversarial-attacks-pytorch
Torch-metrics: model evaluation metrics for PyTorch：PyTorch模型评价指标库 github.com/enochkan/torch-metrics
深度学习项目模板：Pytorch Lightning, Hydra, Tensorboard深度学习项目模板最佳实践 github.com/lkhphuc/lightning-hydra-template
Torchsort：PyTorch快速可微排序库 github.com/teddykoker/torchsort paper:《Fast differentiable sorting and ranking》
Change Detection Repository：Python变化检测方法集 github.com/I-Hope-Peace/ChangeDetectionRepository
Padertorch：旨在简化用 PyTorch 编写的深度学习模型训练的工具集 github.com/fgnt/padertorch
PyTorch Profiler：新的性能分析工具 https://pytorch.org/blog/introducing-pytorch-profiler-the-new-and-improved-performance-tool/
用PyTorch Lightning+DeepSpeed实现数十亿参数模型训练 https://medium.com/pytorch-lightning/accessible-multi-billion-parameter-model-training-with-pytorch-lightning-deepspeed-c9333ac3bb59
PyTorch Notebooks：PyTorch深度学习学习与实践Notebooks集合 github.com/omarsar/pytorch_notebooks
PyTorch实用基础教程 https://www.bilibili.com/video/BV1Sy4y1b7ic/
torchtyping - Runtime type annotations for the shape, dtype etc. of PyTorch Tensors. github.com/patrick-kidger/torchtyping
友好的PyTorch入门工具书(中文)，Don't let me think是本书的最高追求 github.com/lyhue1991/eat_pytorch_in_20_days
pytest-pytorch - pytest plugin for a better developer experience when working with the PyTorch test suite github.com/Quansight/pytest-pytorch
pykale：PyTorch多模态学习/迁移学习库 github.com/pykale/pykale
torchshard：用于将PyTorch张量切成平行分片的轻量引擎，可减少 GPU 内存并扩大训练规模 github.com/KaiyuYue/torchshard
Stanford Nimble：深度学习物理引擎 github.com/keenon/nimblephysics
Pytorch-Lightning-Template：Pytorch-Lightning模板 github.com/miracleyoo/pytorch-lightning-template
一些有用的PyTorch技巧 www.reddit.com/r/MachineLearning/comments/n9fti7/d_a_few_helpful_pytorch_tips_examples_included/ www.youtube.com/watch?v=BoC8SGaT3GE
《PyTorch深度学习编程》随书代码 github.com/falloutdurham/beginners-pytorch-deep-learning
H5Record：Pytorch大数据集(>100G，<=1T)存储格式 github.com/theblackcat102/H5Record
Pytorch Lightning教程集(notebooks) github.com/PyTorchLightning/lightning-tutorials
PyTorch + TorchVision图像分类实例教程 github.com/bentrevett/pytorch-image-classification
用ONNX Runtime加速PyTorch模型 #pytorch加速 github.com/pytorch/ort
ToR[e]cSys：PyTorch推荐系统算法框架 github.com/p768lwy3/torecsys
LibTraffic(阡陌)：PyTorch 实现的交通流量预测库 github.com/LibTraffic/Bigscity-LibTraffic
github.com/Mayurji/MLWithPytorch
用PyTorch 30分钟从头训练Compact Transformer https://medium.com/pytorch/training-compact-transformers-from-scratch-in-30-minutes-with-pytorch-ff5c21668ed5
微软的PyTorch基础课程，主要讲解 PyTorch 及其实际应用领域的基础内容。 https://docs.microsoft.com/en-us/learn/paths/pytorch-fundamentals/
用torch-ort加速PyTorch训练 github.com/pytorch/ort
MLab - “云上炼丹师”的云基础设施：容器化PyTorch训练环境 + 存储解决方案 github.com/DeepVAC/MLab
《手把手PyTorch深度学习》随书代码 github.com/dvgodoy/PyTorchStepByStep
《PyTorch现代计算机视觉实战》随书代码 github.com/PacktPublishing/Modern-Computer-Vision-with-PyTorch
Opti Models - PyTorch optimizations and benchmarking github.com/IlyaDobrynin/opti_models
《PyTorch计算机视觉实战》随书代码 github.com/PacktPublishing/PyTorch-Computer-Vision-Cookbook
《Getting Things Done with Pytorch》 开发者可从该书中学到有关 PyTorch、神经网络、图像分类、人脸检测、情感分析等基础知识。 从书中提供的具体示例，还能进一步了解项目从原型开发到模型部署，最后正式上线生产环境的整个流程。 github.com/curiousily/Getting-Things-Done-with-Pytorc
PyTorch入门教程：张量 https://www.nbshare.io/notebook/28337708/PyTorch-Beginner-Tutorial-Tensors/
PyTorch image models, scripts, pretrained weights -- ResNet, ResNeXT, EfficientNet, EfficientNetV2, NFNet, Vision Transformer, MixNet, MobileNet-V3/V2, RegNet, DPN, CSPNet, and more
https://github.com/rwightman/pytorch-image-models https://rwightman.github.io/pytorch-image-models/training_hparam_examples/
github.com/sithu31296/image-classification
Kornia，一款基于 PyTorch 的可微分的计算机视觉库。可训练模型来执行图像变换、对极几何、深度估计和低级图像处理。 其核心使用 PyTorch 作为主要后端，以提高效率并利用反向模式自动微分来定义和计算复杂函数的梯度。 github.com/kornia/kornia
用PyTorch Lightning将深度学习管线速度加快10倍 https://devblog.pytorchlightning.ai/how-we-used-pytorch-lightning-to-make-our-deep-learning-pipeline-10x-faster-731bd7ad318a
torch2tflite：PyTorch -> Onnx -> Tensorflow 2 -> TFLite 模型转换器 github.com/omerferhatt/torch2tflite
classy：基于PyTorch的深度神经网络模型快速原型和共享库 github.com/sunglasses-ai/classy
【PyTorch实例教程：迁移学习与图像分类】 https://www.pyimagesearch.com/2021/10/11/pytorch-transfer-learning-and-image-classification/
PyTorch Live：面向Android/iOS手机端的PyTorch github.com/pytorch/live
《PyTorch & Scikit-Learn 机器学习实战》随书代码 github.com/rasbt/machine-learning-book
ONNX命令行工具箱 ONNX Command Line Toolbox github.com/jackwish/onnxcli
MMDeploy：开源深度学习模型部署工具集 github.com/open-mmlab/mmdeploy
PyTorch Lightning + Hydra深度学习项目模板 github.com/hobogalaxy/lightning-hydra-template
torchinfo：显示PyTorch模块概要 github.com/TylerYep/torchinfo
Knowledge Distillation Toolkit：PyTorch/PyTorch Lighting开发的知识蒸馏工具包 github.com/georgian-io/Knowledge-Distillation-Toolkit
Hammer：PyTorch深度模型高效训练工具包 github.com/bytedance/Hammer
PyTorch Image Models (timm)实战指南 towardsdatascience.com/getting-started-with-pytorch-image-models-timm-a-practitioners-guide-4e77b4bf9055
TorchMetrics：面向复现指标标准化的PyTorch通用指标评估包 github.com/PyTorchLightning/metrics
免费书稿：《Deep Learning for Coders with fastai and PyTorch: AI Applications Without a PhD》，fastai/PyTorch深度学习实战 github.com/fastai/fastbook
TFLite Conversion：PyTorch->TFLite模型转换 github.com/sithu31296/PyTorch-ONNX-TFLite
HookAndLook：用Pytorch训练深度学习模型期间帮助收集统计数据和运行检查的库 github.com/arsenyinfo/hookandlook
github.com/TorchStudio/torchstudio
PyTorch Metric Learning：PyTorch深度度量学习库 github.com/KevinMusgrave/pytorch-metric-learning
LibMTL：PyTorch多任务学习库 github.com/median-research-group/LibMTL
Disent：用PyTorch Lightning构建的模块化解缠表示学习框架 github.com/nmichlo/disent
【Multi-task Recommendation in PyTorch(MTReclib)：PyTorch多任务推荐库】 github.com/easezyc/Multitask-Recommendation-Library
sk2torch：将scikit-learn模型转换成PyTorch模型 github.com/unixpickle/sk2torch
Torch Points3D：点云深度学习统一框架 github.com/nicolas-chaulet/torch-points3d
PyG：PyTorch图神经网络(GNN)库 github.com/pyg-team/pytorch_geometric
Machine Learning Collection：机器学习/深度学习/PyTorch/TensorFlow教程资源集锦 github.com/aladdinpersson/Machine-Learning-Collection
pytorch-topological：PyTorch拓扑机器学习框架 github.com/aidos-lab/pytorch-topological
torchinfo：显示PyTorch模块概要 github.com/TylerYep/torchinfo
TorchOpt：基于PyTorch构建的高性能优化器库，可轻松实现函数优化和基于梯度的元学习 github.com/metaopt/TorchOpt
github.com/ai-in-motion/moai
kornia：基于PyTorch的可微计算机视觉库 github.com/kornia/kornia/blob/master/README_zh-CN.md
torch-ppr - (Personalized) Page-Rank computation using PyTorch github.com/mberr/torch-ppr
Pytorch-Energizer：Pytorch主动学习库 github.com/pietrolesci/pytorch-energizer
PiPPy: PyTorch流水线并行化 github.com/pytorch/PiPPy
torchshow：PyTorch张量可视化 github.com/xwying/torchshow
SharedDataset - A PyTorch Dataset that caches samples in shared memory, accessible globally to all processes github.com/jotaf98/shareddataset
Trainer：通用模型训练工具 github.com/coqui-ai/Trainer
continual-inference：用于构建持续推理网络的PyTorch组件库 github.com/LukasHedegaard/continual-inference
Zennit：PyTorch神经网络解释/探索框架 github.com/chr5tphr/zennit
Torch-RecHub：易用的Lighting Pytorch推荐系统框架 github.com/morningsky/Torch-RecHub
PyTorch Metric Learning：PyTorch深度度量学习库 github.com/KevinMusgrave/pytorch-metric-learning
【tsai：基于Pytorch & fastai的深度学习时序处理库】’tsai - Time series Timeseries Deep Learning Machine Learning Pytorch fastai | State-of-the-art Deep Learning library for Time Series and Sequences in Pytorch / fastai' by timeseriesAI GitHub: github.com/timeseriesAI/tsai
【torchsnapshot：一个轻量库，用于为PyTorch大规模分布式训练工作负载提供容错能力】'torchsnapshot - A light-weight library for adding fault tolerance to large-scale PyTorch distributed training workloads.' by Meta Research GitHub: github.com/facebookresearch/torchsnapshot
'深入浅出PyTorch - PyTorch入门教程' datawhalechina.github.io/thorough-pytorch/ GitHub: github.com/datawhalechina/thorough-pytorch
推荐一本 AI 技术书籍：《Pytorch 常用函数手册》，手册分为 14 章，内含超 200 个常用函数。 从最基础的创建张量开始，逐步加深，涵盖日常开发常用的函数。感兴趣的同学，可以领取学习一下。 https://githubdaily.gitee.io/posts/2022-07-21-pytorch-book/
【PyTorch深度学习入门课程资料】’Learn PyTorch for Deep Learning (work in progress) - Materials for the Learn PyTorch for Deep Learning: Zero to Mastery course.' by Daniel Bourke GitHub: github.com/mrdbourke/pytorch-deep-learning
【Sparsebit：PyTorch模型压缩/加速工具包】’Sparsebit - A model compression and acceleration toolbox based pytorch.' by MEGVII Research GitHub: github.com/megvii-research/Sparsebit
'PyTorch image models, scripts, pretrained weights -- ResNet, ResNeXT, EfficientNet, EfficientNetV2, NFNet, Vision Transformer, MixNet, MobileNet-V3/V2, RegNet, DPN, CSPNet, and more' by Ross Wightman GitHub: github.com/rwightman/pytorch-image-models
【river-torch：Python在线深度学习库DeepRiver基于PyTorch的API】’river-torch - a Python library for online deep learning' by OnlineML GitHub: github.com/online-ml/river-torch
【Uni-Core：高性能分布式PyTorch框架】’Uni-Core - an efficient distributed PyTorch framework' by DP Technology GitHub: github.com/dptech-corp/Uni-Core
【pytorch-optimizer：PyTorch实现的优化器集】’pytorch-optimizer - Bunch of optimizer implementations in PyTorch' by Hyeongchan Kim GitHub: github.com/kozistr/pytorch_optimizer
【EasyCV：PyTorch一站式计算机视觉工具箱，聚焦自监督学习、图像分类、度量学习、目标检测等方面】'EasyCV - An all-in-one toolkit for computer vision' by Alibaba GitHub: github.com/alibaba/EasyCV
【《Fastai & Pytorch深度学习入门》第二版代码】’The fastai book - The fastai book, 2nd edition (in progress)' by fast.ai GitHub: github.com/fastai/fastbook2e
https://pytorch.org/tutorials/recipes/recipes/tuning_guide.html
'PyTorch Template Using DistributedDataParallel - This is a seed project for distributed PyTorch training, which was built to customize your network quickly' by Liangwei Jiang GitHub: github.com/Janspiry/distributed-pytorch-template
【Streaming：用于神经网络高效训练的数据流库(PyTorch)】’Streaming - a PyTorch compatible dataset that enables users to stream training data from cloud-based object stores.‘ by MosaicML GitHub: github.com/mosaicml/streaming
【Torch-RecHub：易用易扩展的Pytorch Lighting推荐模型框架】'Torch-RecHub - A Lighting Pytorch Framework for Recommendation Models, Easy-to-use and Easy-to-extend' by Datawhale GitHub: github.com/datawhalechina/torch-rechub
【Tensorflow & PyTorch多GPU深度学习模板】’tf-torch-template - Deep learning project template with tensorflow & pytorch (multi-gpu version)' by Junho Kim GitHub: github.com/taki0112/tf-torch-template
【Pytorch Wavelet Toolbox (ptwt)：Pytorch小波变换工具包】’Pytorch Wavelet Toolbox (ptwt) - Differentiable fast wavelet transforms in PyTorch with GPU support.' by Moritz Wolter GitHub: github.com/v0lta/PyTorch-Wavelet-Toolbox
'TorchEval - A library that contains a rich collection of performant PyTorch model metrics, a simple interface to create new metrics, a toolkit to facilitate metric computation in distributed training and tools for PyTorch model evaluations.' by pytorch GitHub: github.com/pytorch/torcheval
【GeoTorch: 空时深度学习框架】'GeoTorch: A Spatiotemporal Deep Learning Framework - GeoTorch: A Spatiotemporal Deep Learning Framework' by Data Systems Lab GitHub: github.com/DataSystemsLab/GeoTorch
【9个深度学习模型并行和分布式训练/推理库】《9 libraries for parallel & distributed training/inference of deep learning models》 medium.com/@mlblogging.k/9-libraries-for-parallel-distributed-training-inference-of-deep-learning-models-5faa86199c1f
Cadene/pretrained-models.pytorch: 「Pretrained ConvNets for pytorch: NASNet, ResNeXt, ResNet, InceptionV4, InceptionResn https://github.com/Cadene/pretrained-models.pytorch
'torchnnprofiler - Context Manager to profile the forward and backward times of PyTorch's nn.Module' by Kshiteej K GitHub: github.com/kshitij12345/torchnnprofiler
'finetuning-scheduler - A PyTorch Lightning extension that accelerates and enhances foundational model experimentation with flexible finetuning schedules.' by Dan Dale GitHub: github.com/speediedan/finetuning-scheduler
【Merlin Dataloader：加速训练TensorFlow和PyTorch推荐模型，数据加载速度最高可提升10倍】’Merlin Dataloader - lets you quickly train recommender models for TensorFlow and PyTorch’ by NVIDIA-Merlin GitHub: github.com/NVIDIA-Merlin/dataloader
'Hailo Model Zoo - includes pre-trained models and a full building and evaluation environment' by Hailo GitHub: github.com/hailo-ai/hailo_model_zoo
【PyTorch学习速率规划器可视化指南】《A Visual Guide to Learning Rate Schedulers in PyTorch》by Leonie Monigatti towardsdatascience.com/a-visual-guide-to-learning-rate-schedulers-in-pytorch-24bbb262c863
【torchview：PyTorch模型可视化】’torchview - torchview: visualize pytorch models' by mert-kurttutan GitHub: github.com/mert-kurttutan/torchview
【Holistic Trace Analysis：PyTorch性能分析库】’Holistic Trace Analysis - A library to analyze PyTorch traces.' Meta Research GitHub: github.com/facebookresearch/HolisticTraceAnalysis
【tensor_parallel：一行代码将 PyTorch 大模型分到多个GPU上运行(训练/推理)】’tensor_parallel - Automatically split your PyTorch models on multiple GPUs for training & inference' Andrei Panferov GitHub: github.com/BlackSamorez/tensor_parallel
【PaDiff：基于PaddlePaddle与PyTorch的模型精度对齐工具】'PaDiff - paddle debug toolkits' PaddlePaddle GitHub: github.com/PaddlePaddle/PaDiff
【PaConvert：API代码转换工具，将Pytorch代码转换为PaddlePaddle代码】’PaConvert - paddle code convert toolkit' Zhou Wei GitHub: github.com/zhouwei25/PaConvert
【PyTorch快速入门 (Colab)】《PyTorch-CrashCourse.ipynb - Colaboratory》 https://colab.research.google.com/drive/1eiUBpmQ4m7Lbxqi2xth1jBaL61XTKdxp?usp=sharing
【加快 PyTorch 模型训练的一些技巧】《Some Techniques To Make Your PyTorch Models Train (Much) Faster》 GitHub: github.com/rasbt/faster-pytorch-blog https://sebastianraschka.com/blog/2023/pytorch-faster.html
【Modulus (Alpha)：基于 PyTorch 的深度学习工具包，用于为物理系统开发深度学习模型】'Modulus (Alpha) - A PyTorch based deep-learning toolkit for developing DL models for physical systems' NVIDIA GitHub: github.com/NVIDIA/modulus
【StarLight：帮助实现轻量深度神经网络的开源项目，主要包含三个模块：网络压缩、神经架构搜索和可视化，还提供了一个方便的工具 QuiverPyTorch，用于可视化任意网络的中间特征】'StarLight - helps in obtaining lightweight deep neural networks’ by ICT-ANS GitHub: github.com/ICT-ANS/StarLight
【SSLRec: 基于PyTorch的深度学习框架，通过自监督学习技术增强了推荐系统，包含常用数据集、数据处理、训练、测试、评估和最先进的研究模型的代码脚本，提供了大量实用函数和易于使用的界面，简化了推荐模型的开发和评估过程】’SSLRec: A Self-Supervised Learning Library for Recommendation - SSLRec: A Self-Supervised Learning Library for Recommendation' HKUDS GitHub: github.com/HKUDS/SSLRec
'torchkeras：通用的pytorch模型训练模版工具，旨在提供优雅、易用且易于修改的训练工具，支持进度条、评估指标、early stopping等功能，同时还支持tensorboard和wandb回调函数等扩展功能’ lyhue1991 GitHub: github.com/lyhue1991/torchkeras
'Pytorch Docker Images - Pure Pytorch Docker Images.' cnstark GitHub: github.com/cnstark/pytorch-docker
【comgra：一个与 pytorch 一起使用的库，可以更轻松地检查神经网络的内部结构，允许可视化计算图并检查不同时间点的各张量的值】’comgra - a library for use with pytorch that makes it easier to inspect the internals of your neural networks' by Florian Dietz GitHub: github.com/FlorianDietz/comgra
'tinytorch - A really tiny autograd engine' joey00072 GitHub: github.com/joey00072/Tinytorch
【ExecuTorch：PyTorch发布的移动和边缘设备推理工具包】
- ExecuTorch提供了轻量级运行时和算子注册表，覆盖了PyTorch生态系统中的各类模型。
- ExecuTorch包含了从模型创作到训练和部署的端到端SDK和工具链。
- ExecuTorch具有可组合性，支持第三方集成，可以加速不同硬件平台上的模型推理。
- ExecuTorch强调多平台可移植性、高生产效率和利用硬件性能的高性能。
- ExecuTorch由Arm、苹果和高通的自定义智能体组件优化，可在其各自的硬件平台上实现高效的模型推理。
- PyTorch Edge及ExecuTorch使研究环境和生产环境更加贴近，为PyTorch社区带来端到端的在设备上部署解决方案。
- ExecuTorch为移动设备和边缘设备上的在设备推理奠定基础，有望推动各类创新应用的产生。 《PyTorch Edge: Enabling On-Device Inference Across Mobile and Edge Devices with ExecuTorch | PyTorch》 github.com/pytorch/executorch#executorch
【PyTorch Frame：PyTorch表格深度学习库，专门用于处理异构的表格数据，包括数值、分类、时间、文本和图像等不同列类型，旨在促进表格数据的深度学习研究，为初学者和专家提供支持，以解决传统基于树的模型在处理复杂列类型（如文本、序列、图像）和与下游模型（如GNNs）集成的困难等问题】’PyTorch Frame - Tabular Deep Learning Library for PyTorch' PyG GitHub: github.com/pyg-team/pytorch-frame
电子书《Deep Learning with PyTorch》 https://livebook.manning.com/book/deep-learning-with-pytorch 本书的目的是为大家介绍PyTorch深度学习的基础知识，并以一个实际项目来展示。我们力图介绍深度学习底层的核心思想，并向读者展示PyTorch如何将其实现。
深入浅出PyTorch 阅读地址：datawhalechina.github.io/thorough-pytorch/ “PyTorch是利用深度学习进行数据科学研究的重要工具，在灵活性、可读性和性能上都具备相当的优势，近年来已成为学术界实现深度学习算法最常用的框架。 考虑到PyTorch的学习兼具理论储备和动手训练，两手都要抓两手都要硬的特点，我们（Datawhale）开发了《深入浅出PyTorch》课程，期望以组队学习的形式，帮助大家从入门到熟练掌握PyTorch工具，进而实现自己的深度学习算法。”
【TorchFix：PyTorch代码静态分析工具，具备自动修复功能的代码检查器，它利用LibCST库操作Python具体语法树，支持自动修复（codemods）以及问题报告】'TorchFix - a linter for PyTorch-using code with autofix support - TorchFix - a linter for PyTorch-using code with autofix support' PyTorch Labs GitHub: github.com/pytorch-labs/torchfix