Scottish researchers develop AI tech to tackle gender-based abuse online

They've been awarded funding to create safe spaces online

Author: John CallanPublished 20th Jun 2022

Experts at the National Robotarium in Edinburgh believe a new algorithm they are developing could help to tackle gender-based online abuse.

Researchers at the base, which involved Heriot-Watt University and the University of Edinburgh, have been awarded £1 million of funding from UK Research and Innovation to create high tech AI tools to help detect social media trolling.

They have said the machine learning could help to create safer online spaces.

The research also includes the development of educational tools to help young people recognise and respond to online gender-based violence.

Principal investigator and professor of conversational AI at the National Robotarium, Verena Rieser, said: "Outcomes from the project will help create online spaces that are equally safe irrespective of someone's gender, race or background, and provide more effective and transparent means of moderation, giving users more control over their online experiences."

Co-researcher and reader in computer science education at the National Robotarium, Dr Fiona McNeill, said: "Through this interactive work, we will create educational materials that help young people understand and recognise online gender-based violence, to gain confidence in responding to it, either as a victim or a bystander, and to recognise if they are perpetrating it."

The prospect of the technology is being welcomed by both the Scottish and UK governments.

Scottish Office minister Iain Stewart, said: "Hate speech and harassment are just as unacceptable online as they are offline.

"For too long online platforms have enabled the most vile forms of targeted abuse with almost no consequences for perpetrators, and minimal support and protection for victims.

"I am hopeful that this research into new AI algorithms will deliver a valuable tool in fighting back and creating safer online environments."

Scottish Economy Secretary Kate Forbes said: "Everyone should feel equally safe and respected, whether online or offline."

She added: "As a key component of the City Region Deal, the team behind the National Robotarium is working to help tackle online abuse, using artificial intelligence to help make our society more inclusive.

"This work will drive positive social and cultural change, with the potential to create an impact felt far beyond Edinburgh and the south east of Scotland."

Hear all the latest news from across the North of Scotland on MFR. Listen on FM, via our Rayo app, DAB, or smart speaker.