AI Safety & Alignment

Today's Stories

1. 1

   Researchers propose philosophical approach to AI alignment training

   Researchers have developed a metaethical argument — combining perspectival moral realism with evolutionary debunking as an epistemological approach — and are considering submitting it as feedback to Anthropic or publishing it for broader engagement with AI alignment researchers. Anthropic has stated its constitutional approach to AI training is meant to be revised and improved over time, and substantive philosophical contributions are rarer than bug reports. The argument presented takes a position distinct from common approaches in AI ethics literature, which tend toward either naive moral realism or preference-satisfaction consequentialism — making it potentially more likely to gain traction precisely because it addresses moral uncertainty in a less common way.

   Although the probability that any single submission changes training decisions is low, the expected value may be higher than it seems, given Anthropic's openness to revising its approach and the relative scarcity of rigorous philosophical input to AI training methodology.

2. 2

   AI policy lagging research; political will, not ideas, is the constraint

   A Les­s­Wrong analysis argues that AI safety research has already produced sufficient knowledge and best practices to address catastrophic risks, but these are not being applied or enforced. The author estimates that a majority of the top approximately 100–1,000 most influential policymakers worldwide have never had a serious conversation about catastrophic risk, and fewer than 1% of civil-society submissions to the UN Global Dialogue mention existential risks. The bottleneck on AI safety is no longer a shortage of clever policy ideas but rather lack of awareness and political will among decision-makers. Because policymakers do not believe the problem exists, they are not worried, and existing best practices remain unapplied. This suggests that better research alone will not solve the problem; what is needed is engagement with the policy and leadership communities that shape AI governance.

   The author notes that the field under-invests in conversations about catastrophic risk at the policy level—a gap that may determine whether the existing knowledge base translates into enforceable international or national regulatory regimes.

3. 3

   AI safety experts say policy, not research, is now the bottleneck

   An AI safety researcher argues that the field has sufficient knowledge to address catastrophic risks, but awareness among policymakers remains critically low—with an estimated majority of the top ~100–1,000 most influential policymakers worldwide never having had a serious conversation about the issue. The gap between available safety practices and their enforcement suggests that progress depends less on new discoveries and more on political will. A serious regulatory regime could reduce most of the risk, yet low awareness among decision-makers is preventing action.

   Only one of 1,534 written submissions to the UN Global Dialogue mentions AI takeover, and fewer than 1% mention existential risks—a signal of how marginalized catastrophic-risk concerns remain in formal policy discourse.

4. 4

   AI safety experts flag executive power as greatest control risk

   AI safety researchers argue that the US President and Chinese General Secretary hold the easiest pathways to seize permanent power using AI, rather than elaborate scenarios involving AI-developed nanotech or bioweapons. The observation challenges how the AI safety community frames loss-of-control risks. It suggests that the concentration of state power in executive hands — particularly control over security apparatus — represents a more direct threat vector than technological acceleration scenarios.

   The analysis calls for detailed mechanism studies specific to the US and China, though the high-level principle is said to apply across most state structures where a single leader holds de facto control over security forces.

5. 5

   FORT Robotics brings outside-in safety to robots with Nvidia Halos

   FORT Robotics joined Nvidia's Halos for Robotics ecosystem and is demonstrating an agentic safety application using Nvidia's Outside-In Safety Blueprint this week at the Automate conference in Chicago. The solution combines external infrastructure sensors and visual AI agents with onboard robot perception to deliver real-time functional safety. Traditional robot safety systems rely only on onboard sensors and force robots to operate conservatively, slowing them down in dynamic warehouse and factory environments. Outside-In Safety automatically adjusts robot efficiency across changing environments, which means warehouses and factories can run robots faster while keeping workers safe—unlocking cost savings from processes like trailer unloading, inventory replenishment, and product assembly.

   FORT is a member of Nvidia's AI Systems Inspection Lab, the world's first ANSI National Accreditation Board (ANAB)-accredited inspection lab designed specifically for physical AI and autonomous systems. The lab verifies functional safety, cybersecurity, and AI compliance for autonomous vehicles, robotics, and sensor technologies.

6. 6

   SK postpones 2026 AI Summit to align with Nvidia's March event

   SK Group is postponing its 2026 SK AI Summit to the first half of 2027, moving it from its originally scheduled second-half 2026 slot. The company hosts the summit annually as its flagship event to showcase AI and semiconductor developments. Industry sources believe the delay is meant to better align the summit with Nvidia GTC, which is held each March. This suggests SK wants its announcements timed alongside one of the tech industry's largest annual AI and hardware events, potentially to maximize visibility and industry impact.

   The rescheduled summit is now expected in the first half of 2027, though no specific date has been announced.