‘A Promising Direction for Semi-Supervised Learning’ – AWS Lab’s Semi-ViT Beats CNNs While Maintaining Scalability
In the new paper Semi-supervised Vision Transformers at Scale, a research team from AWS AI Labs proposes a semi-supervised learning pipeline for vision transformers that is stable, reduces hyperparameter tuning sensitivity, and outperforms conventional convolutional neural networks.