The internet turned teen-mimicking bot into a racist

Alex Kantrowitz, Buzzfeed News (via. John Gruber):

In a matter of hours this week, Microsoft’s AI-powered chatbot, Tay, went from a jovial teen to a Holocaust-denying menace openly calling for a race war in ALL CAPS.

The bot’s sudden dark turn shocked many people, who rightfully wondered how Tay, imbued with the personality of a 19-year-old girl, could undergo such a transformation so quickly, and why Microsoft would release it into the wild without filters for hate speech. […]

The internet fed Tay poisonous language and ideas until she began to regurgitate them on her own.

A key flaw, incredibly, was a simple “repeat after me” game, a call and response exercise that internet trolls used to manipulate Tay into learning hate speech. […]

It’s worth noting that the company released similar bots in China and Japan and never saw anything like this.

This definitely puts Microsoft in a bad light. The problem seems quite simple in retrospect.

Also, we’re corrupting AI now?

In Uncategorized by Mayur Dhaka