School of Information Sciences

Youth-AI-Safety named a winning team in international hackathon

Yaman Yu
Yaman Yu
Yang Wang
Yang Wang, Professor
Yun Huang
Yun Huang, Associate Professor

A team of researchers from the SALT (Social Computing Systems) Lab has been selected as a winner in an international hackathon hosted by the Berkeley Center for Responsible, Decentralized Intelligence. The LLM Agents MOOC Hackathon brought together over 3,000 students, researchers, and practitioners from 127 countries to build and showcase innovative work in large language model (LLM) agents, grow the AI agent community, and advance LLM agent technology.

Hackathon teams could compete in one of five tracks: Applications, Benchmarks, Fundamentals, Safety, and Decentralized and Multi-Agents. Team Youth-AI-Safety, which included PhD student Yaman Yu, Informatics PhD student Yiren Liu, Computer Science undergraduate Jacky Zhang, Associate Professor Yun Huang, and Professor Yang Wang, won 8th place in the Applications Track—the most popular track with 75 percent of the participants.

The team's hackathon project builds on members' earlier work highlighting the risks teenagers face when using generative artificial intelligence (GAI)—risks that parents are often unaware of and struggling to manage, Yu said. The goal of the project is to safeguard youth in GAI platforms by building a risk taxonomy for youth-nuanced challenges; creating a real-world labeled dataset for risk detection; and developing YouthSafeAgent, a parental control system for real-time monitoring and family communication.

“We collected chat logs from youth participants, a large-scale Reddit dataset, and an AI incident database to categorize risks and develop a structured taxonomy for youth-GAI interactions. Using this taxonomy, we labeled the chat logs to create a dataset. Based on this, we developed a parental control tool that enables real-time monitoring of children's risky interactions with GAI and allows parents to take action when needed,” Yu explained.

Future steps for the project include expanding the dataset, adding real-time intervention strategies, integrating user feedback from parents and youth, and finally releasing the YouthSafeAgent risk taxonomy, dataset, and parental control tools.

The SALT Lab seeks to understand how people interact with sociotechnical computing systems and develops original designs that either enable new forms of user/social interaction or impact existing interaction. The lab proposes, develops, and evaluates novel infrastructure solutions for a variety of social computing applications, including mobile crowdsourcing systems for public safety, systems for protecting people's privacy in social media, designs for enabling new forms of interactions between librarians and patrons, and mechanisms for making authentication more accessible for people with disabilities.

Updated on
Backto the news archive

Related News

iSchool researchers present at CSCW 2025

Several faculty, students, and recent grads will present their research at the 28th ACM Conference on Computer-Supported Cooperative Work and Social Computing (CSCW 2025), which will be held October 18–22 in Bergen, Norway. The online portion of the conference will be held on October 10. 

Get to know Jade Carthans, BSIS student

Jade Carthans is interested in how human-centered design, machine learning, and data analytics can come together to solve critical problems that impact organizations and individuals. She gained firsthand experience in these areas through internships with Microsoft and State Farm.

Jade Carthans

iSchool faculty and staff present at AISLE annual conference

Join the iSchool for the Association of Illinois School Library Educators (AISLE) annual conference, held October 5–7 at the I Hotel and Conference Center in Champaign, Illinois. The theme for the conference is “Libraries Build Connections.”

Downie appointed executive associate dean

The iSchool is pleased to announce that Professor J. Stephen Downie has been appointed executive associate dean. In this role, he will work closely with Interim Dean Emily Knox to realize the iSchool's strategic goals and objectives. He also will provide leadership for the internal administration of the School, coordinate the work of associate deans and assigned staff, and facilitate faculty affairs.

Stephen Downie

School of Information Sciences

501 E. Daniel St.

MC-493

Champaign, IL

61820-6211

Voice: (217) 333-3280

Fax: (217) 244-3302

Email: ischool@illinois.edu

Back to top