IEEE

Mitigating Backdoor Attacks in Pre-Trained Encoders via Self-Supervised Knowledge Distillation

Abstract: Pre-trained encoders in computer vision have recently received great attention from both research and industry communities. Among others, a promising paradigm is to utilize self-supervised ...
IEEE

CE-Net: Context Encoder Network for 2D Medical Image Segmentation

Abstract: Medical image segmentation is an important step in medical image analysis. With the rapid development of a convolutional neural network in image processing, deep learning has been used for ...
GitHub

Return of the Encoder: Efficient Small Language Models

We note that our work focuses on architectural comparisons rather than competing with recent SLM developments (e.g., SmolLM, MobileLLM). Our analysis isolates the fundamental advantages of ...
GitHub

huggingface/pytorch-image-models

Add Gemma4 ViT encoders w/ NaFlex pipeline support (variable aspect/size per image). Thanks Yonghye Kwon Support DINOv3 weights in NaFlexVit. Thanks Yonghye Kwon Some improvements to Muon fallback ...