TransMix: Crafting highly transferable adversarial examples to evade face recognition models

Faculty Computer Science Year: 2024
Type of Publication: ZU Hosted Pages:
Authors:
Journal: Image and Vision Computing Elsevier (Science Direct) Volume:
Keywords : TransMix: Crafting highly transferable adversarial examples    
Abstract:
The main challenge in deceiving face recognition (FR) models lies in the target model under the black-box setting. Existing works seek to generate adversarial examples to improve the adversarial transferability for black-box attacks. However, the attack performance and quality of the crafted image still have room for improvement. In this work, we propose a novel method called TransMix to improve the transferability of adversarial face examples based on data augmentation. Our approach leverages the mixture of the original image with a mixed sample image that is randomly mixed using images from different identities or the same identities, incorporating information from diverse categories. Then, we perform random transformations times to create diverse input patterns, exploiting the gradient from various images and other identities in the same iteration. Extensive experiments conducted on the CelebA dataset demonstrate that TransMix achieves a significantly higher attack success rate against different FR models and Vision Transformers (ViTs), outperforming the best competitor by a large margin of 5.6% and 8.8% when attacking the ViTs using adversarial images generated on the ArcFace model. Our results also confirm that adversarial examples crafted by TransMix exhibit good adversarial transferability against defense models, achieving an attack success rate of 52.3% on the Bit-Red model.
   
     
 
       

Author Related Publications

  • Yasmeen Mohamed Mohamed Khedr, "Robust color image hashing using quaternion polar complex exponential transform for image authentication", Springer, 2018 More
  • Yasmeen Mohamed Mohamed Khedr, "Robust image hashing using exact Gaussian Hermite moments", IET The Institute of Engineering and Technology, 2018 More
  • Yasmeen Mohamed Mohamed Khedr, "Sampling-Based Teacher Guided Method to Boost Transferable Attack on SAR Image Classification", Frontiers in Artificial Intelligence and Applications, 2024 More
  • Yasmeen Mohamed Mohamed Khedr, "Semantic Adversarial Attacks on Face Recognition Through Significant Attributes", Springer, 2023 More
  • Yasmeen Mohamed Mohamed Khedr, "Experimental and numerical modelling of solid and hollow biomass pellets high-temperature rapid oxy-steam combustion: The effect of integrated CO2/H2O concentration", Elsevier, 2021 More

Department Related Publications

  • Khalied Mohamed Hosny, "Deep Learning and Optimization-Based Methods for Skin Lesions Segmentation: A Review", IEEE, 2023 More
  • Ehab Roshdy Mohamed, "Deep Learning and Optimization-Based Methods for Skin Lesions Segmentation: A Review", IEEE, 2023 More
  • Duaa Saad AbdelHamid Shora, "Deep Learning and Optimization-Based Methods for Skin Lesions Segmentation: A Review", IEEE, 2023 More
  • Walid Ibrahim Ibrahim Khedr, "Cryptographic Accumulator-Based Scheme for Critical Data Integrity Verification in Cloud Storage", IEEE, 2019 More
Tweet