SparK: the first successful BERT/MAE-style pretraining on any convolutional networks

[imoldpan]

参考

• GitHub - keyu-tian/SparK: [ICLR'23 Spotlight] The first successful BERT/MAE-style pretraining on any convolutional network; Pytorch impl. of "Designing BERT for Convolutional Networks: Sparse and Hierarchical Masked Modeling"