From KurzweilAI:
In “The A.I. Anxiety” Sunday (12/27), the Washington Post concisely summarized the risks implicit in superintelligence … and more worrisome, in “superstupidity”: “There is no one person who understands exactly how these [intelligent computer] systems work or are operating at any given moment. Throw in elements of autonomy, and things can go wrong quickly and disastrously.” In other words: stupid people + superintelligent machines —> superstupidity.
Power grid: FAIL. Example: A yearlong investigation by the AP reveals that Iranian, Chinese, Russian, and other hackers have accessed the “aging, outdated” and vulnerable U.S. power grid (with some facilities still using Fortran, Windows 95, and floppy disks), downloaded critical drawings, and even took over the controls of a large utility’s wind farm. Got solar + backup batteries?
Are you “doubleplusungood”? Speaking of total control of power, Ant Financial in China has launched “Sesame Credit scores” on Weibo and WeChat, says Quartz — following a government directive last summer calling for the establishment of a “social credit system.” The service apparently evaluates one’s purchasing and spending habits to derive a credit score, which is “evidence that the Chinese government is enacting a scheme that will monitor citizens’ finances,” says the ACLU and others, warning that “one’s political views or ‘morality’ might raise or lower one’s score.”
More here.