Faculty Recruiting Support CICS

Machine Learning and Friends Lunch

15 Sep
Thursday, 09/15/2022 12:00pm to 1:00pm
Computer Science Building, Room 150/151, Zoom
Machine Learning and Friends Lunch

Title: "Probabilistic Commonsense Knowledge in Language"

Abstract: Commonsense knowledge is critical to achieving artificial general intelligence. This shared common background knowledge is implicit in all human communication, facilitating efficient information exchange and understanding. However, commonsense research is hampered by its immense quantity of knowledge because an explicit categorization is impossible. Furthermore, a plumber could repair a sink in a kitchen or a bathroom, indicating that common sense reveals a probable assumption rather than a definitive answer. To align with these properties of commonsense fundamentally, we want to model and evaluate such knowledge human-like using probabilistic abstractions and principles.

This talk will introduce a probabilistic model representing commonsense knowledge using a learned latent space of geometric embeddings -- probabilistic box embeddings. Using box embeddings makes it possible to handle commonsense queries with intersections, unions, and negations in a way similar to Venn diagram reasoning. Meanwhile, existing evaluations do not reflect the probabilistic nature of commonsense knowledge. To fill in the gap, I will discuss a method of retrieving commonsense related question answer distributions from human annotators and a novel method of generative evaluation. We utilize these approaches in two new commonsense datasets (ProtoQA, Commonsense frame completion). The combination of modeling and evaluation methods based on probabilistic principles sheds light on how commonsense knowledge can be incorporated into artificial intelligence models in the future.

Bio: Xiang Li (Lorraine) is a young investigator with the Mosaic team at Allen Institute of AI and will become an assistant professor at University of Pittsburgh starting Fall 2023. She defended her Ph.D. in Computer Science from UMass Amherst, advised by Andrew McCallum. Previously, she obtained an M.S. in Computer Science from The University of Chicago while conducting research at TTIC. Her research is at the intersection of natural language processing, commonsense reasoning, knowledge representation, and machine learning. More specifically, her research focuses on designing probabilistic models and evaluation methods for implicit commonsense knowledge in language.

To find out more information about this event or to obtain the Zoom link, please see the event announcements from MLFL on the college email lists or contact wenlongzhao [at] cs.umass.edu (subject: MLFL%20Zoom%20Link) (Wenlong Zhao). A pizza lunch is available along with this event in room 150/151.