Kanishka Misra, Aaron Mueller, and Jon Gauthier pose with their Outstanding Paper Award at ACL'23.
Kanishka Misra, Aaron Mueller, and Jon Gauthier pose with their Outstanding Paper Award.

Faculty and students from the Johns Hopkins Department of Computer Science and affiliated centers presented their recent findings in computational linguistics at the 61st Annual Meeting of the Association for Computational Linguistics, held July 9–14 in Toronto, Canada. The ACL is the premier international scientific and professional society for researchers working in the field of natural language processing and computation.

Among the Hopkins researchers’ accolades are two Outstanding Paper Awards, secured by an intercollegiate team including Daniel Khashabi, an assistant professor of computer science, and by a group of researchers from academia and industry that included recent CS alumnus Aaron Mueller ’20 (MS), ’23 (PhD).

Khashabi—along with UCLA researchers Nikil Roashan Selvam and Kei-Wei Chang and research scientists Sunipa Dev (Google Research) and Tushar Khot (the Allen Institute for AI)—investigated the unreliability of scores obtained from social bias benchmarks in “The Tail Wagging the Dog: Dataset Construction Biases of Social Bias Benchmarks.”

Joined by Meta AI researchers Koustuv Sinha, Keren Fuentes, and Adina Williams and PhD candidates Jon Gauthier (MIT) and Kanishka Misra (Purdue University), Mueller analyzed language modeling acceptability judgements with systematically manipulated contexts. He presented their findings, titled “Language model acceptability judgements are not always robust to context,” in person at the conference.

Additionally, a position paper by Arya McCarthy, a doctoral candidate in the Center for Language and Speech Processing, and Giovanna Maria Dora Dore, an associate teaching professor and the associate director of the Krieger School’s Program in East Asian Studies, received an honorable mention; “Theory-Grounded Computational Analysis” argues for a return to theoretically grounded research questions to promote better integration of NLP and the social sciences.

Other JHU ACL’23 presenters include: