Provably Safe AGI is Potentially a Very Dangerous Concept

Published on May 23, 2024

The article reviews the paper "Toward Guaranteed Safe AI" by Davidad and others, including notable figures like Yoshua Bengio and Max Tegmark. The paper advocates for integrating symbolic and subsymbolic AI to enhance intelligence, ethics, transparency, and efficiency. While acknowledging the value of pursuing provably safe AI, the article criticizes the paper for rehashing old ideas and underestimating practical challenges. It warns that the push for formal safety guarantees might lead to stringent regulations, restricting AGI development to large corporations and governments. The author argues for a decentralized, democratic approach to AGI development, cautioning against allowing the pursuit of provable safety to justify hierarchical control, which could stifle innovation and favour corporate and governmental dominance over AGI research.

Read the full article here.

Other news

Radio-Wave Weapon Could Be 'Game Changer' Against Drones

May 23, 2024
The British military has announced it is testing a new weapons technology that is expected to be a "game changer" on the battlefield, using nothing but invisible radio waves to take out enemy drones and vehicles from a range of up to a mile.The Radio Frequency Directed Energy Weapon (RFDEW) beams radio waves at a target, or group of targets, in order to destroy their onboard electronics. The RFDEW

CENTCOM bound: Army soldiers slated to test high-power microwaves against drone swarms

May 23, 2024
After receiving four high-power microwave prototypes designed to stop drone swarms, the US Army is preparing to send some of them on to the Middle East to see how they perform, according to Chief of Staff Gen. Randy George.Testifying before the Senate Appropriations subcommittee today, George told lawmakers that like the Stryker-mounted lasers recently sent over to the US Central Command area, the