How Far Are VLMs from Privacy Awareness in the Physical World?
An interactive audiovisual benchmark showing that current VLMs struggle to turn privacy cues into situated behavior.
Xinjie Shen
An interactive audiovisual benchmark showing that current VLMs struggle to turn privacy cues into situated behavior.
A comprehensive evaluation benchmark for assessing privacy awareness of large language models in physical environments, revealing significant gaps when privacy is grounded in real-world contexts across four evaluation tiers.