Convolutional Neural Networks are a class of deep learning models designed to process grid-like data, such as images. They're particularly effective for tasks like image classification, object ...

Multi-Head Self-Attention in ViTs (left) is approximated by depthwise convolution over the reshaped value tensor (right). We aim to reduce the inference cost of large pre-trained Vision Transformers ...