Nov 15, 2021 · We present a self-supervised framework iBOT that can perform masked prediction with an online tokenizer. Specifically, we perform self- ...
iBOT is a novel self-supervised pre-training framework that performs masked image modeling with self-distillation. iBOT pre-trained model shows local ...
Jan 28, 2022 · We present a self-supervised framework iBOT that can perform masked image modeling with an online tokenizer, achieving the state-of-the-art results in ...
On the one hand, our tokenizer captures high- level visual semantics progressively learned by enforcing the simi- larity of cross-view images on class tokens.
Apr 14, 2024 · iBOT is proposed, which performs masked prediction with an online tokenizer. Specifically, self-distillation is performed on masked patch ...