# AI safety

OpenAI and Poland's National Research Institute NASK have signed an agreement to collaborate on AI safety, security and technical research. NASK's AI Safety Research Center, which serves as the Polish Artificial Intelligence Safety Institute, and OpenAI will explore ways to evaluate increasingly capable AI systems, identify potential vulnerabilities and strengthen safeguards. The agreement extends OpenAI's work with public research institutions including the US CAISSI and the UK AISI, and builds on NASK's CERT Polska gaining access to OpenAI cyber-capable models through Daybreak and using them to find six vulnerabilities in MikroTik RouterOS.

OpenAI and Poland's National Research Institute NASK have signed an agreement to collaborate on AI safety, security and technical research. NASK's AI Safety Research Center, which serves as the Polish Artificial Intelligence Safety Institute, and OpenAI will explore ways to evaluate increasingly capable AI systems, identify potential vulnerabilities and strengthen safeguards. The agreement extends OpenAI's work with public research institutions including the US CAISSI and the UK AISI, and builds on NASK's CERT Polska gaining access to OpenAI cyber-capable models through Daybreak and using them to find six vulnerabilities in MikroTik RouterOS.

This Nature explainer traces the September 2026 AI-extinction debate triggered by Anthropic researcher Jacob Coxon's resignation, in which Coxon said "the people building AI earnestly believe that it could kill us all by the end of the decade," Evan Hubinger estimated the risk of human extinction at ">10% within the next decade," and Dario Amodei then posted an essay calling for a slowdown rather than a halt in AI development; it also cites RAND's Michael Vermeer, whose assessment of nuclear weapons, biotechnology and deliberate atmospheric modification found complete extinction by nuclear weapons infeasible while the other two scenarios could not be ruled out, though carrying them out would require models to have considerable ability to physically interact with the world and would almost

This Nature explainer traces the September 2026 AI-extinction debate triggered by Anthropic researcher Jacob Coxon's resignation, in which Coxon said "the people building AI earnestly believe that it could kill us all by the end of the decade," Evan Hubinger estimated the risk of human extinction at ">10% within the next decade," and Dario Amodei then posted an essay calling for a slowdown rather than a halt in AI development; it also cites RAND's Michael Vermeer, whose assessment of nuclear weapons, biotechnology and deliberate atmospheric modification found complete extinction by nuclear weapons infeasible while the other two scenarios could not be ruled out, though carrying them out would require models to have considerable ability to physically interact with the world and would almost

This guest opinion piece by Po-Shen Loh, published on Terence Tao's blog, proposes that the mathematics community and all industries should publicly adopt the axiom 'We (humans) should help humanity flourish,' and argues from it that further AI advance will create more high-skill human oversight jobs than there are people to fill them, eventually forcing AI progress to slow; it also discusses how pure mathematics contributes to human flourishing and what practical changes adopting the axiom might bring.

This guest opinion piece by Po-Shen Loh, published on Terence Tao's blog, proposes that the mathematics community and all industries should publicly adopt the axiom 'We (humans) should help humanity flourish,' and argues from it that further AI advance will create more high-skill human oversight jobs than there are people to fill them, eventually forcing AI progress to slow; it also discusses how pure mathematics contributes to human flourishing and what practical changes adopting the axiom might bring.