- Joined
- May 18, 1997
- Messages
- 55,634
It was widely reported yesterday that Facebook "had to" shut down its AI chatbot program because the AI started having conversations in their own language, and of course we all know what happens when that happens. It however seems that a lot of folks ran with a story that was not quite on point. Facebook's AI team is out today countering the previous reports, and they don't seem to happy about what previous said about the experiment.
Simply put, agents in environments attempting to solve a task will often find unintuitive ways to maximize reward. Analyzing the reward function and changing the parameters of an experiment is NOT the same as "unplugging" or "shutting down AI". If that were the case, every AI researcher has been "shutting down AI" every time they kill a job on a machine.
There is a joke in here about there not actually being any intelligence, but artificial, on FaceBook, but I will not go there.....oops.
Simply put, agents in environments attempting to solve a task will often find unintuitive ways to maximize reward. Analyzing the reward function and changing the parameters of an experiment is NOT the same as "unplugging" or "shutting down AI". If that were the case, every AI researcher has been "shutting down AI" every time they kill a job on a machine.
There is a joke in here about there not actually being any intelligence, but artificial, on FaceBook, but I will not go there.....oops.