Pre trained CRATE weights

[sampath-ch]

Firstly, thank you for your valuable work.
The URL (https://drive.google.com/file/d/1hYgDJl4EKHYfKprwhEjmWmWHuxnK6_h8/view?usp=share_link) for weights for CRATE-SMALL on ImageNet-1K is not working.
The G-Drive link says "URL does not exist." Could you please update it with a working link.
Thanks in advance.

[IceIce1ce]

+1

[SHIELD-SKY]

+1

[PepeRoConde]

ola!
them have weights in this colab
for convenience or in case you have trouble with the colab, i made a shared folder with the weights (their are MIT licensed as of this writing)

[SHIELD-SKY]

Thanks a lot! I wonder which model the "crate-demo.pth" file corresponds to?

[PepeRoConde]

"crate-demo.pth" file corresponds to this (from this other repo somewhat only referenced in the colab)

    def CRATE_base_demo():
        model = CRATE(
            image_size=224,
            patch_size=8,
            num_classes=21842,
            dim=768,
            depth=12,
            heads=6,
            dropout=0.0,
            emb_dropout=0.0,
            dim_head=768 // 6,
        )