Youth-AI-Safety named a winning team in international hackathon

Yaman Yu
Yaman Yu
Yang Wang
Yang Wang, Professor
Yun Huang
Yun Huang, Associate Professor

A team of researchers from the SALT (Social Computing Systems) Lab has been selected as a winner in an international hackathon hosted by the Berkeley Center for Responsible, Decentralized Intelligence. The LLM Agents MOOC Hackathon brought together over 3,000 students, researchers, and practitioners from 127 countries to build and showcase innovative work in large language model (LLM) agents, grow the AI agent community, and advance LLM agent technology.

Hackathon teams could compete in one of five tracks: Applications, Benchmarks, Fundamentals, Safety, and Decentralized and Multi-Agents. Team Youth-AI-Safety, which included PhD student Yaman Yu, Informatics PhD student Yiren Liu, Computer Science undergraduate Jacky Zhang, Associate Professor Yun Huang, and Professor Yang Wang, won 8th place in the Applications Track—the most popular track with 75 percent of the participants.

The team's hackathon project builds on members' earlier work highlighting the risks teenagers face when using generative artificial intelligence (GAI)—risks that parents are often unaware of and struggling to manage, Yu said. The goal of the project is to safeguard youth in GAI platforms by building a risk taxonomy for youth-nuanced challenges; creating a real-world labeled dataset for risk detection; and developing YouthSafeAgent, a parental control system for real-time monitoring and family communication.

“We collected chat logs from youth participants, a large-scale Reddit dataset, and an AI incident database to categorize risks and develop a structured taxonomy for youth-GAI interactions. Using this taxonomy, we labeled the chat logs to create a dataset. Based on this, we developed a parental control tool that enables real-time monitoring of children's risky interactions with GAI and allows parents to take action when needed,” Yu explained.

Future steps for the project include expanding the dataset, adding real-time intervention strategies, integrating user feedback from parents and youth, and finally releasing the YouthSafeAgent risk taxonomy, dataset, and parental control tools.

The SALT Lab seeks to understand how people interact with sociotechnical computing systems and develops original designs that either enable new forms of user/social interaction or impact existing interaction. The lab proposes, develops, and evaluates novel infrastructure solutions for a variety of social computing applications, including mobile crowdsourcing systems for public safety, systems for protecting people's privacy in social media, designs for enabling new forms of interactions between librarians and patrons, and mechanisms for making authentication more accessible for people with disabilities.

Updated on
Backto the news archive

Related News

Spectrum Scholar Spotlight: Guadalupe Castillo

Twelve iSchool master's students were named 2024–2025 Spectrum Scholars by the American Library Association (ALA) Office for Diversity, Literacy, and Outreach Services. This "Spectrum Scholar Spotlight" series highlights the School's scholars. MSLIS student Guadalupe Castillo earned her BA in international studies and Spanish and Latin American literature from the University of California, San Diego.

Guadalupe Castillo

iSchool researchers to present at CHI 2025

iSchool faculty and students will present their research at the ACM Conference on Human Factors in Computing Systems (CHI 2025), which will be held from April 26 to May 1 in Yokohama, Japan. 

Kemboi receives the Research and Advocacy Social Justice Award

PhD student Gladys Kemboi has received the 2025 Research and Advocacy Social Justice Award from the Office of Diversity & Social Justice Education in the Office of Student Affairs. She was presented with the award at the Social Justice Awards Ceremony, which was held on April 8 in the Illini Union. The annual event honors and celebrates the work and dedication of University of Illinois community members seeking to create a more inclusive and equitable campus.

Gladys Kemboi

Garnes receives Coretta Scott King-Virginia Hamilton Award for Lifetime Achievement

Carolyn L. Garnes (MSLIS '72) has received the 2025 Coretta Scott King-Virginia Hamilton Award for Lifetime Achievement from the American Library Association (ALA). The annual award, named in honor of award-winning children's book author Virginia Hamilton, is presented in odd years "to a practitioner for substantial contributions through active engagement with youth using award-winning African American literature for children and/or young adults, via implementation of reading and reading-related activities/programs."

Carolyn L. Garnes

Undergraduate Research Symposium features iSchool students and mentors

Several iSchool undergraduate students will participate in the 18th annual Undergraduate Research Symposium. During the event, visitors will learn about undergraduate research projects through oral and poster presentations, creative performances, and art exhibits. All are welcome to attend the symposium, which will be held on April 24 from 9:00 a.m.-5:00 p.m. in the Illini Rooms and South Lounge of the Illini Union. Oral presentations will be held on the second floor of the Illini Union.