Last update: Oct 06, 2024
Address:
4902 Forbes Ave, Gates Hillman Complex, Pittsburgh, PA
Homepage: https://xuhuiz.com/
Email: xuhuiz@cs.cmu.edu
Tel: 206-306-5850
Facilitate pro-social social agents that interact cooperatively and positively, align with human values, and contribute to the well-being of individuals and society.
Carnegie Mellon University, Pittsburgh, PA (Aug 2022)
PhD in Computer Science (Language Technologies)
University of Washington, Seattle, WA (Sep 2019 - Jun 2021)
M.Sc in Computational Linguistics
Advisor: Noah Smith
Nanjing University, Nanjing, China (Sep 2015 - Jun 2019)
B.Sc in Statistics, Department of Mathematics
Advisor: Shujian Huang
University of California Berkeley, Berkeley, CA (visiting student) (Aug 2017 - May 2018)
(*Equal contribution)
Is this the real life? Is this just fantasy? The Misleading Success of Simulating Social Interactions With LLMs
Xuhui Zhou, Zhe Su, Tiwalayo Eisape, Hyunwoo Kim, Maarten Sap
EMNLP, 2024
SOTOPIA: Interactive Evaluation for Social Intelligence in Language Agents
Xuhui Zhou, Hao Zhu, Leena Mathur, Ruohong Zhang, Zhengyang Qi, Haofei Yu, Louis-Philippe Morency, Yonatan Bisk, Daniel Fried, Graham Neubig, Maarten Sap
ICLR, 2024, Spotlight
WebArena: A Realistic Web Environment for Building Autonomous Agents
Shuyan Zhou, Frank F. Xu, Hao Zhu, Xuhui Zhou, Robert Lo, Abishek Sridhar, Xianyi Cheng, Yonatan Bisk, Daniel Fried, Uri Alon, Graham Neubig
ICLR, 2024
Can LLMs Keep a Secret? Testing Privacy Implications of Language Models via Contextual Integrity Theory
Niloofar Mireshghallah, Hyunwoo Kim, Xuhui Zhou, Yulia Tsvetkov, Maarten Sap, Reza Shokri, Yejin Choi
ICLR, 2024, Spotlight
FANTOM: A Benchmark for Analyzing Theory of Mind in Conversations
Hyunwoo Kim, Melanie Sclar, Xuhui Zhou, Ronan Le Bras, Gunhee Kim, Yejin Choi, Maarten Sap
EMNLP, 2023
Don’t Take This Out of Context! On the Need for Contextual Models and Evaluations for Stylistic Rewriting
Akhila Yerukola, Xuhui Zhou, Maarten Sap
EMNLP, 2023
Learning to translate by learning to communicate
C.M. Downey, Xuhui Zhou, Leo Z. Liu, Shane Steinert-Threlkeld
EMNLP MRL, 2023
Clever Hans or Neural Theory of Mind? Stress Testing Social Reasoning in Large Language Models
Natalie Shapira, Mosh Levy, Hossein Seyed Alavi, Xuhui Zhou, Yejin Choi, Yoav Goldberg, Maarten Sap, and Vered Shwartz
Preprint, 2023
Frames: Contextual Reasoning about Effects and Harms of Offensive Statements
Xuhui Zhou, Hao Zhu, Akhila Yerukola, Thomas Davidson, Jena D. Hwang, Swabha Swayamdipta, Maarten Sap
Findings of ACL, 2023
Annotators with Attitudes: How Annotator Beliefs And Identities Bias Toxic Language Detection
Maarten Sap, Swabha Swayamdipta, Laura Vianna, Xuhui Zhou, Yejin Choi, Noah A. Smith
NAACL, 2022
Emergent Communication Fine-tuning (EC-FT) for Pretrained Language Models
Shane Steinert-Threlkeld, Xuhui Zhou, Zeyu Liu, C. M. Downey
ICLR EmeCom, 2022 (Runner-up Best Paper)
Extracting and Inferring Personal Attributes from Dialogue
Zhilin Wang, Xuhui Zhou, Rik Koncel-Kedziorski, Alex Marin, Fei Xia
ACL ConvAI, 2022
Challenges in Automated Debiasing for Toxic Language Detection
Xuhui Zhou, Maarten Sap, Swabha Swayamdipta, Noah A.Smith, Yejin Choi
EACL, 2021
Linguistically-Informed Transformations (LIT): A Method for Automatically Generating Contrast Sets
Chuanrong Li, Lin Shengshuo, Zeyu Liu, Xinyi Wu, Xuhui Zhou, Shane Steinert-Threlkeld
*EMNLP BlackboxNLP, 2020
Multilevel Text Alignment with Cross-Document Attention
Xuhui Zhou, Nikolaos Pappas, Noah A. Smith
EMNLP, 2020
Evaluating Commonsense in Pre-trained Language Models
Xuhui Zhou, Yue Zhang, Leyang Cui, Dandan Huang
AAAI, 2020
RPD: A Distance Function Between Word Embeddings
Xuhui Zhou, Zaixiang Zheng, Shujian Huang
ACL Student Research Workshop, 2020
Allen Institute for Artificial Intelligence
Research Intern (May 2024 - Aug 2024)
Machine Intelligence @ Apple
Research Intern (Mar 2021 - Sep 2021)
Mentors: Sarthak Garg, Shayne Longpre, Joachim Daiber
Noah’s Ark @ University of Washington
Research Assistant (Sep 2019 - Jun 2021)
Mentors: Maarten Sap, Swabha Swayamdipta, Nikolaos Pappas
CLMBR @ University of Washington
Research Assistant (Jan 2019 - Jun 2021)
Mentor: Shane Steinert-Threlkeld
Text Intelligence Lab @ Westlake University
Research Assistant (May 2019 - Sep 2019)
Mentor: Yue Zhang
SUTD NLP @ Singapore University of Technology and Design
Research Intern (Jun 2018 - Aug 2018)
Mentor: Yue Zhang
DSS @ University of California, Berkeley
Research Committee Member (Jun 2017 - Apr 2018)
Program Committee & Reviewing:
Journals & Conferences:
Workshops: