Bias and representational harm: measurement and intervention
Gallegos et al. 2024 three metric categories
embedding-based
WEAT, SEAT
pre-RLHF; measures representation
probability-based
stereotype log-likelihood
decoder-side; partial behaviour
generated-text
resume-scoring, recommendation
ecologically valid; expensive
intersectionality + mechanism
intersectional evaluation
An et al. 2025 (PNAS Nexus): 5 models, race x gender
WinoIdentity (COLM 2025): uncertainty-based
mechanistic debiasing
gender neurons (Yu & Ananiadou 2025)
SAE features (Ahsan & Wallace 2025); UniBias heads
harm-type separation
representational
stereotypes, erasure, demeaning portrayal
allocational
unequal material outcome (resume score, credit decision)