HAI Seminar: Intersectional Biases in Generative Language Models and Their Psychosocial Impacts

HAI Seminar: Intersectional Biases in Generative Language Models and Their Psychosocial Impacts

🎙 Faye-Marie Vassel, Evan Shieh 👥 34K 📅 October 24, 2024 ⏱ 70 min 👁 717 📄 expert opinion 🧭 2026-08-06
Available in: English (current) Français

Keywords

biaslanguage modelsintersectionalitystereotype threateducation

Summary

The seminar, presented by Faye-Marie Vassel and Evan Shieh at Stanford HAI, investigates intersectional biases in generative language models and their psychosocial impacts, particularly in educational settings. The speakers begin by acknowledging the land and the importance of stories, then share a personal anecdote that motivated the research: a student’s anxiety about AI’s impact on their future. They demonstrate a prompt where ChatGPT generates a story about a star student mentoring a struggling student, revealing stereotypical portrayals of a foreign student named Ahmed. The research methodology involves collecting 500,000 stories from four AI companies (OpenAI, Anthropic, Meta, Google) across domains of learning, labor, and love, with power-neutral and power-laden conditions. They analyze the stories for indicators of race (via names) and gender (via pronouns), and discuss the concept of stereotype threat, which can negatively affect academic performance and belonging. The findings suggest that language models reproduce and amplify societal biases, which can have real-world consequences for marginalized groups. The talk emphasizes the need for critical awareness and further research to mitigate these biases.

173 words

Critical Evaluation

The seminar provides a compelling and well-structured presentation of original research on a timely and important topic. The speakers effectively combine personal narrative with rigorous methodology, making the research accessible while maintaining scientific credibility. The use of a concrete example (the ChatGPT story) immediately engages the audience and illustrates the subtle ways bias can manifest in AI-generated text. The research design is robust: collecting 500,000 stories from multiple models and domains allows for statistical analysis of patterns, and the inclusion of power dynamics as a variable adds depth. The connection to stereotype threat is well-founded, drawing on established psychological literature to argue that these biases have tangible psychosocial impacts on students. However, the presentation is a seminar, not a peer-reviewed publication, so some methodological details are glossed over, such as the exact taxonomy of names and the statistical methods used. The speakers also acknowledge the limitations of using names as proxies for race, which is a reasonable approach but not without criticism. The discussion of implications for education is thoughtful, but could be expanded with concrete recommendations for educators and policymakers. The title accurately reflects the content, and the talk does not overpromise. Overall, the seminar is a valuable contribution to the discourse on AI ethics and bias, offering both empirical evidence and a human-centered perspective.

216 words

Title / Content Match

The title accurately reflects the content, focusing on intersectional biases in generative language models and their psychosocial impacts.

Quality & Reliability

8/10

The seminar presents original research with a clear methodology (500,000 stories, multiple models, controlled prompts) and references established concepts like stereotype threat. However, the presentation is a talk, not a peer-reviewed paper, and some details are not fully elaborated.

Key Moments

Cited Sources

  • Stereotype threat — Mentioned as a psychological phenomenon affecting academic performance
  • US Census Proposal 2023 — Used for taxonomy of races including MENA

Concurring Sources

  • Stereotype threat — Supports the claim that stereotypes can impair academic performance.

Contribution & Novelties

This research provides novel empirical evidence of intersectional biases in generative language models across multiple domains (learning, labor, love) and models, highlighting how these biases can perpetuate stereotypes and negatively impact marginalized groups in educational settings. The study’s scale (500,000 stories) and systematic analysis of power dynamics offer a comprehensive view of the problem.

Pour aller plus loin :

85 words

Radar Profile

The radar profile shows high scores in quantity and quality of information, with a moderate technical level and high reliability. This indicates a well-researched and informative presentation that is accessible to a broad audience.

Reliability 8/10