California’s SB 1047 Won’t Address Existential Risks From AI

Over the last year, the rapid advancement of artificial intelligence has captivated the world’s attention, sparking both excitement and concern. As AI systems like OpenAI’s ChatGPT become increasingly sophisticated, policymakers are grappling with how to ensure that this transformative technology is developed and deployed responsibly. In California, State Senator Scott Wiener has introduced legislation aimed at mitigating the potential existential risks posed by AI.

The proposed law, known as SB 1047, has already passed the California State Senate and is making its way to the General Assembly, where it is expected to undergo further amendments. The bill was informed by input from the Center for AI Safety, an organization dedicated to reducing societal-scale risks from artificial intelligence.

Senator Wiener should be commended for his genuine concern for the welfare of humanity. However, while the intentions behind SB 1047 may be laudable, the legislation itself is unlikely to have any meaningful impact on existential risks, which are risks that could lead to the extinction of the human race. To understand why, it is important to examine two main categories of existential risk associated with AI: unintended consequences and intentional misuse.

Read the full article on Forbes.