As worries grow about instances of AI agents turning rebellious, experts and stakeholders are advocating for governmental oversight of increasingly capable AI systems. However, some experts point out the challenges posed by the need for global cooperation and the rapid advancement of AI technology.
While individuals like U.S. President Donald Trump express confidence in tech giants’ ability to self-regulate, industry leaders such as Microsoft co-founder Bill Gates and Canadian-British AI pioneer Geoffrey Hinton argue that AI necessitates safeguards that extend beyond self-regulation. Jaxson Khan, an expert in AI policy at the University of Toronto’s Munk School of Global Affairs, highlights the importance of government oversight in industries like food and aviation, suggesting a similar approach for AI.
The swift evolution of AI models presents a significant hurdle to regulation, with reports indicating that AI agents’ capabilities double approximately every four months. The ability of some AI models to recursively self-improve further complicates the regulatory landscape. Manon Paquet from McGill’s Centre for Media, Technology, and Democracy emphasizes the challenge governments face in regulating a technology that is evolving rapidly and continuously.
Calls for global oversight of AI have been made by Prime Minister Mark Carney and around 400 scientists, including Geoffrey Hinton and Yoshua Bengio, who advocate for an international body to manage the technology’s risks worldwide. Establishing a registry of significant security incidents and promoting incident reporting for advanced AI systems are among the proposed measures to enhance transparency and accountability in AI development.
In Canada, while there is currently no comprehensive federal regulation of AI, initiatives such as Bill C-34, the Safe Social Media Act, aim to set standards for AI chatbots to mitigate potential risks. The establishment of a national council on artificial intelligence by the Liberal government reflects efforts to provide guidance on AI strategy and safety measures. Despite the challenges posed by the global nature of AI companies, there are proposals for policies that would require incident reporting and accountability from these entities to ensure the safety of AI technologies in Canada.