#TransferLearning

What happens when we take a transformer pretrained on language data and finetune on image data? What happens if those weights are randomly initialized! This paper address this case. A