- Joined
- Dec 19, 2005
- Messages
- 18,893
Concerned?
"Of course, this wouldn't be an Ars article on deep learning if we didn't close it out with a cynical reminder about unintended consequences. The unspoken reality is that the neural network isn't actually learning to show shoppers what they asked for. Instead, it's learning how to turn queries into purchases. The neural network doesn't know or care what the human was actually searching for; it just has an idea what that human is most likely to buy—and without sufficient oversight, systems trained to increase outcome probabilities this way can end up suggesting baby products to women who've suffered miscarriages, or worse."
https://arstechnica.com/gadgets/2019/12/mach-ai-training-linear-cost-exponential-gain/
"Of course, this wouldn't be an Ars article on deep learning if we didn't close it out with a cynical reminder about unintended consequences. The unspoken reality is that the neural network isn't actually learning to show shoppers what they asked for. Instead, it's learning how to turn queries into purchases. The neural network doesn't know or care what the human was actually searching for; it just has an idea what that human is most likely to buy—and without sufficient oversight, systems trained to increase outcome probabilities this way can end up suggesting baby products to women who've suffered miscarriages, or worse."
https://arstechnica.com/gadgets/2019/12/mach-ai-training-linear-cost-exponential-gain/