Abstract: Network Augmentation (NetAug) is a recent method used to improve the performance of tiny neural networks on large-scale datasets. This method provides additional supervision to tiny models ...