Skip to main navigation Skip to search Skip to main content

Privacy Preserving Semantic Communications Using Vision Language Models: A Segmentation and Generation Approach

  • Haoran Chang
  • , Mingzhe Chen
  • , Huaxia Wang
  • , Qianqian Zhang

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Semantic communication has emerged as a promising paradigm for next-generation wireless systems, improving the communication efficiency by transmitting high-level semantic features. However, reliance on unimodal representations can degrade reconstruction under poor channel conditions, and privacy concerns of the semantic information attack also gain increasing attention. In this work, a privacy-preserving semantic communication framework is proposed to protect sensitive content of the image data. Leveraging a vision-language model (VLM), the proposed framework identifies and removes private-content regions from input images prior to transmission. A shared privacy database enables semantic alignment between the transmitter and receiver to ensure consistent identification of sensitive entities. At the receiver, a generative module reconstructs the masked regions using learned semantic priors and conditioned on the received text embedding. Simulation results show that generalizes well to unseen image processing tasks, improves reconstruction quality at the authorized receiver by over 10% using text embedding, and reduces identity leakage to the eavesdropper by more than 50%.

Original languageEnglish (US)
Title of host publication2025 IEEE Military Communications Conference, MILCOM 2025
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages1365-1370
Number of pages6
ISBN (Electronic)9798331502928
DOIs
StatePublished - 2025
Event2025 IEEE Military Communications Conference, MILCOM 2025 - Los Angeles, United States
Duration: Oct 6 2025Oct 10 2025

Publication series

NameProceedings - IEEE Military Communications Conference MILCOM
ISSN (Print)2155-7578
ISSN (Electronic)2155-7586

Conference

Conference2025 IEEE Military Communications Conference, MILCOM 2025
Country/TerritoryUnited States
CityLos Angeles
Period10/6/2510/10/25

All Science Journal Classification (ASJC) codes

  • Electrical and Electronic Engineering

Fingerprint

Dive into the research topics of 'Privacy Preserving Semantic Communications Using Vision Language Models: A Segmentation and Generation Approach'. Together they form a unique fingerprint.

Cite this