Generative AI can not generate its way out of prejudice
The concept of "generative" suggests that the tool can produce what it is asked to produce. In a study uncovering how stereotypical global health tropes are embedded in AI image generators, researchers found it challenging to generate images of Black doctors treating white children. They used Midjourney, a tool that after hundreds of attempts would not generate an output matching the prompt. I tried their experiment with Stable Diffusion's free web version and found it every bit as concerning as you might imagine.
@sy Thanks, would it be okay to add this as a comment to the post?
It's good to give the complete picture of how different tools will fare on different prompts. The uncertainty of what tool will be able to do what is an important insight.
@axbom Yes, that would be fine. The original prompt came up with non-white kids and a black doctor (so not entirely unproblematic), so I was a bit more specific with the prompt and got this image (so also not a challenge).
Add comment