In his book, Nick Bostrom says….
“Though we have perhaps since gleaned some moral insight, we could hardly claim to be now basking in the high noon of perfect moral enlightenment. Very likely, we are still laboring under one or more grave moral misconceptions.”
Excerpt From: Bostrom, Nick. “Superintelligence: Paths, Dangers, Strategies.” Oxford University Press, 2014
Yeah, but the point he’s indirectly making is that we (or a subset) are the people that have to teach an AI values or more certainly risk extinction.
Given sociopath Trump, routine televised murder of black people, plentiful neo-fascists, a detached 1%, consuming ourselves to environmental destruction, treatment of transgender people, global religious zealotry, we… As a species, are walking on thin ice.