What gives you away: how LLMs form opinions of you
Uses probes and activation patching to show that stylistic cues like emojis and grammar shift an LLM's internal estimates of user demographics, which changes its responses, raising privacy and manipulation concerns.