Two simple and effective designs of vision transformer, which is on par with the Swin transformer

ICCV2021, Tokens-to-Token ViT: Training Vision Transformers from Scratch on ImageNet

Official implementation of PVT series