The partial explanation for why its images put people of color in historical settings where they wouldn’t normally be found came a day after Google said it was temporarily stopping its Gemini chatbot from generating any images with people in them. That was in response to a social media outcry from some users claiming the tool had an anti-white bias in the way it generated a racially diverse set of images in response to written prompts.
“It’s clear that this feature missed the mark,” said a blog post from Prabhakar Raghavan, a senior vice president who runs Google’s search engine and other businesses. “Some of the images generated are inaccurate or even offensive. We’re grateful for users’ feedback and are sorry the feature didn’t work well.”
[https://cdn.magzter.com/1400077361/1709166012/articles/ZAJbaeiKH1709199642673/68btE45RY1709199760737.jpg]
Raghavan didn’t mention specific examples but among those that drew attention on social media this week were images that depicted a Black woman as a U.S. founding father and showed Black and Asian people as Nazi-era German soldiers.
Google added the new image-generating feature to its Gemini chatbot, formerly known as Bard, about three weeks ago. It was built atop an earlier Google research experiment called Imagen 2.
[https://cdn.magzter.com/1400077361/1709166012/articles/ZAJbaeiKH1709199642673/h5iRNQSMF1709199812944.jpg]
Google has known for a while that such tools can be unwieldly. In a 2022 technical paper, the researchers who developed Imagen warned that generative AI tools can be used for harassment or spreading misinformation “and raise many concerns regarding social and cultural exclusion and bias.” Those considerations informed Google’s decision not to release “a public demo” of Imagen or its underlying code, the researchers added at the time.
Since then, the pressure to publicly release generative AI products has grown because of a competitive race between tech companies trying to capitalize on interest in the emerging technology sparked by the advent of OpenAI’s chatbot ChatGPT.
[https://cdn.magzter.com/1400077361/1709166012/articles/ZAJbaeiKH1709199642673/Yfd_61DLR1709199865765.jpg]
The problems with Gemini are not the first to recently affect an image-generator. Microsoft had to adjust its own Designer tool several weeks ago after some were using it to create deepfake pornographic images of Taylor Swift and other celebrities. Studies have also shown AI image-generators can amplify racial and gender stereotypes found in their training data, and without filters they are more likely to show lighter-skinned men when asked to generate a person in various contexts.
“When we built this feature in Gemini, we tuned it to ensure it doesn’t fall into some of the traps we’ve seen in the past with image generation technology — such as creating violent or sexually explicit images, or depictions of real people,” Raghavan said. “And because our users come from all over the world, we want it to work well for everyone.”
[https://cdn.magzter.com/1400077361/1709166012/articles/ZAJbaeiKH1709199642673/Q8FyOeInF1709199909770.jpg]
He said many people might “want to receive a range of people” ...
“It’s clear that this feature missed the mark,” said a blog post from Prabhakar Raghavan, a senior vice president who runs Google’s search engine and other businesses. “Some of the images generated are inaccurate or even offensive. We’re grateful for users’ feedback and are sorry the feature didn’t work well.”
[https://cdn.magzter.com/1400077361/1709166012/articles/ZAJbaeiKH1709199642673/68btE45RY1709199760737.jpg]
Raghavan didn’t mention specific examples but among those that drew attention on social media this week were images that depicted a Black woman as a U.S. founding father and showed Black and Asian people as Nazi-era German soldiers.
Google added the new image-generating feature to its Gemini chatbot, formerly known as Bard, about three weeks ago. It was built atop an earlier Google research experiment called Imagen 2.
[https://cdn.magzter.com/1400077361/1709166012/articles/ZAJbaeiKH1709199642673/h5iRNQSMF1709199812944.jpg]
Google has known for a while that such tools can be unwieldly. In a 2022 technical paper, the researchers who developed Imagen warned that generative AI tools can be used for harassment or spreading misinformation “and raise many concerns regarding social and cultural exclusion and bias.” Those considerations informed Google’s decision not to release “a public demo” of Imagen or its underlying code, the researchers added at the time.
Since then, the pressure to publicly release generative AI products has grown because of a competitive race between tech companies trying to capitalize on interest in the emerging technology sparked by the advent of OpenAI’s chatbot ChatGPT.
[https://cdn.magzter.com/1400077361/1709166012/articles/ZAJbaeiKH1709199642673/Yfd_61DLR1709199865765.jpg]
The problems with Gemini are not the first to recently affect an image-generator. Microsoft had to adjust its own Designer tool several weeks ago after some were using it to create deepfake pornographic images of Taylor Swift and other celebrities. Studies have also shown AI image-generators can amplify racial and gender stereotypes found in their training data, and without filters they are more likely to show lighter-skinned men when asked to generate a person in various contexts.
“When we built this feature in Gemini, we tuned it to ensure it doesn’t fall into some of the traps we’ve seen in the past with image generation technology — such as creating violent or sexually explicit images, or depictions of real people,” Raghavan said. “And because our users come from all over the world, we want it to work well for everyone.”
[https://cdn.magzter.com/1400077361/1709166012/articles/ZAJbaeiKH1709199642673/Q8FyOeInF1709199909770.jpg]
He said many people might “want to receive a range of people” ...
You're reading a preview of
Apple(Digital) - 1 Issue, March 01, 2024