Xuhui Zhou


GHC 5705

4902 Forbes Ave

Pittsburgh, PA 15213

I am a PhD student at the Language Technologies Institute at CMU fortunately advised by Maarten Sap Markdown Monster icon . I am interested in socially intelligent human language technology. More specifically (yet still vague), I am interested in the following Qs:

  1. How do we define and build language technology that interacts with humans/society positively?
  2. How do we create better (socially) grounded language technology with commonsense?
  3. How does (social) language intelligence emerge through human language communication?


Nov 1, 2023 New work on contextual privacy! ConfAIde: Can LLMs Keep a Secret? Testing Privacy Implications of Language Models!
🌐 Website 𝕏 Tweet
Oct 19, 2023 New work on social intelligence! SOTOPIA: Interactive Evaluation for Social Intelligence in Language Agents!
🌐 Website 𝕏 Tweet
Oct 16, 2023 Really excited about our newly-accepted EMNLP papers:! Don’t Take This Out of Context! On the Need for Contextual Models and Evaluations for Stylistic Rewriting, FANTOM: A Benchmark for Analyzing Theory of Mind in Conversations, and our MRL workshop paper: Learning to translate by learning to communicate
Jul 26, 2023 New work on website navigation! WebArena: A Realistic Web Environment for Building Autonomous Agents!
🌐 Website πŸ—žοΈ News Cover 𝕏 Tweet
Jun 16, 2023 New preprint: Clever Hans or Neural Theory of Mind? Stress Testing Social Reasoning in Large Language Models!
Jun 16, 2023 New preprint: β€œDon’t Take This Out of Context!” On the Need for Contextual Models and Evaluations for Stylistic Rewriting!
May 16, 2023 Our paper COBRA 🐍 Frames: Contextual Reasoning about Effects and Harms of Offensive Statements appears at Findings of ACL 2023!
Apr 16, 2023 Our ToM Workshop has been accepted to ICML 2023! :star:
Apr 2, 2023 Our team won the second place in the CMU LTI LLM hackathon! :tada: :tada: :tada: We focus on inversing the ChatGPT workflow!
Jan 11, 2021 Our paper: Challenges in Automated Debiasing for Toxic Language Detection will appear at EACL 2021!
Dec 14, 2020 Accept two intern offers from Apple! One happens at the Siri Info Intel team for the spring quarter, another happens at the Machine Translation team for the summer quarter :tada:
Oct 20, 2020 Our paper: Linguistically-Informed Transformations (LIT): A Method for Automatically Generating Contrast Sets will appear at BlackboxNLP 2020.
Oct 2, 2020 Our paper: Multilevel Text Alignment with Cross-Document Attention will appear at EMNLP 2020.
Apr 20, 2020 My undergraduate thesis: RPD: A Distance Function Between Word Embeddings get accepted by ACL SRW 2020.