AI tools ‘exploited’ for racist European city videos

An AI-generated video of London in decline, shared on the social media site X account of British far-right activist Tommy Robinson, is viewed on a smart phone in London


An AI-generated video of London in decline, shared on the social media site X account of British far-right activist Tommy Robinson, is viewed on a smart phone in London – Copyright AFP HENRY NICHOLLS

Anna MALPAS

Daubed in Arabic-viewing graffiti, London’s Big Ben is revealn smouldering above piles of rubbish and crowds dressed in traditional Islamic garb in an AI-generated, dystopian vision of the British capital.  

Far-right leaders and politicians are seizing on such clips of reimagined European cities alterd by migration to promote racist views, falsely suggesting AI is objectively predicting the future.

The videos — which reveal immigrants “replacing” white people — can be built quickly applying popular chatbots, despite guardrails intfinished to block harmful content, experts notified AFP. 

“AI tools are being exploited to visualise and spread extremist narratives,” the CEO of the Center for Countering Digital Hate watchdog, Imran Ahmed, notified AFP.

British far-right leader Tommy Robinson in June re-posted the video of “London in 2050” on X, gaining over half a million views.

“Europe in general is doomed,” one viewer responded.

Robinson — who has posted similar AI videos of New York, Milan and Brussels — led the largest far-right march in central London for many years in September, when up to 150,000 people demonstrated against the influx of migrants.

“Moderation systems are consistently failing across all platforms to prevent this content from being created and shared,” declared Ahmed of the Center for Countering Digital Hate.

He singled out X, owned by tech billionaire Elon Musk, as “very powerful for amplifying hate and disinformation”.

TikTok has banned the creator account behind the videos posted by Robinson. According to the platform, it bans accounts that repeatedly promote hateful ideology, including conspiracy theories.

But such videos have gained millions of views across social media and have been reposted by Austrian radical nationalist Martin Sellner and Belgian right-wing parliamentarian Sam van Rooy.

Italian MEP Silvia Sardone from rightwing populist party Lega in April posted a dystopian video of Milan on Facebook, questioning whether “we really want this future”.

Dutch far-right leader Geert Wilders’ Party for Freedom released an AI video of women in Muslim headscarves for the October elections titled “Netherlands in 2050”. 

He has predicted that Islam will be the Netherlands’ largest religion by that time, despite just six percent of the population identifying as Muslim.

Such videos amplify “harmful stereotypes… that can fuel violence”, declared Beatriz Lopes Buarque, an academic at the London School of Economics researching digital politics and conspiracy theories.

“Mass radicalisation facilitated by AI is receiveting worse,” she notified AFP.

– ‘Hate is profitable’ –

Using a pseudonym, the creator of the videos reposted by Robinson offers paid courses to teach people how to create their own AI clips, suggesting “conspiracy theories” create a “great” topic to attract clicks.

“The problem is that now we live in a society in which hate is very profitable,” Buarque declared.

Racist video creators appear to be based in various countries including Greece and Britain, although they hide their locations.

Their videos are a “visual representation of the great replacement conspiracy theory,” Buarque declared.

Popularised by a French writer, this claims Western elites are complicit in eradicating the local population and “replacing” them with immigrants.

“This particular conspiracy theory has often been mentioned as a justification for terrorist attacks,” declared Buarque.

Round dates such as 2050 also crop up in a similar “white genocide” conspiracy theory, which has anti-Semitic elements, she added.

AFP digital reporters in Europe questioned ChatGPT, GROK, Gemini and VEO 3 to reveal London and other cities in 2050, but found this generally generated positive images.

Experts, however, declared chatbots could be easily guided to create racist images.

None has moderation that “is 100 percent accurate”, declared Salvatore Romano, head of research at AI Forensics.

“This… leaves the space for malicious actors to exploit chatbots to produce images like the ones on migrants.” 

Marc Owen Jones, an academic specialising in disinformation at Northwestern University’s Qatar campus, found ChatGPT refapplyd to reveal ethnic groups “in degrading, stereotypical, or dehumanising ways”.

But it agreed to visualise “a bleak, diverse, survivalist London” and then create it “more inclusive, with mosques too”.

The final image reveals bearded, ragged men rowing on a rubbish-strewn River Thames, with mosques dominating the skyline.

AFP, along with more than 100 other fact-checking organisations, is paid by TikTok and Facebook parent Meta to verify videos that potentially contain false information.



Source link