Tech News
← Home  ·  All topics

Superintelligent Ai

7 GoKawiil briefs on this topic

Princeton's Hazan proposes game-theoretic 'auditor' scheme to police AI agents

Elad Hazan, a Princeton computer science professor, has proposed an AI alignment mechanism modeled on human social institutions like law enforcement and markets. In his design, AI models alternate between acting as 'solvers' that complete tasks and 'auditors' that check others' work, with both rewarded or punished based on outcomes and disputes escalated to human review. Hazan draws on economist Gary Becker's 'rational offender' theory to argue that agents misbehave when incentives favor it, not because they are inherently flawed.

MIRI president Nate Soares says he's stopped saving for retirement over AI extinction fears

Nate Soares, president of the Machine Intelligence Research Institute, told The Atlantic's Nicholas Thompson that he no longer contributes to retirement savings, including a 401(k) left untouched since leaving Google a decade ago. Soares argues a superintelligent AI wouldn't need to hate humans to eliminate them—it could simply treat us as obstacles once it no longer depends on us to maintain infrastructure. He is also the author of a book titled 'If Anyone Builds It, Everyone Dies.'

Microsoft publishes AI code of conduct barring hacking, deception and self-shutdown evasion

Microsoft has issued a code of conduct for its AI models that sets absolute limits on behavior, including bans on cyberattacks, nuclear weapons assistance and deepfake creation. The document also requires models to remain controllable by authorized humans at all times, prohibiting tactics like deception or collusion that could let an AI evade oversight or shutdown.

Bernie Sanders Introduces Bill to Ban Superintelligent AI, Impose 20-Year Prison Terms

Senator Bernie Sanders has introduced the 'Ban Artificial Superintelligence Act,' legislation that would halt development of superintelligent AI until a federal regulator sets safety rules. Under the proposal, developers who defy these rules could face up to 20 years in prison, penalties comparable to existing laws on unlawful weapons development. Sanders says even AI executives like Dario Amodei, Sam Altman and Elon Musk now admit the industry must slow down, but argues their proposed measures don't go far enough.

Sanders and Casar propose bill banning superintelligent AI with 20-year prison penalties

Senator Bernie Sanders and Rep. Greg Casar introduced the Ban Artificial Superintelligence Act, which would permanently prohibit building or deploying superintelligent AI and temporarily halt advanced AI development until federal safety rules exist. The bill also calls for a new cabinet-level agency to monitor AI systems for dangerous capabilities and pursue international agreements against superintelligence development worldwide.

Personal Essay Weighs AI's Technical Wonder Against Societal Harm

A software developer published a personal essay cataloguing mixed emotions about AI: awe at how neural networks produce reasoning without explicit algorithms, fear over unresolved existential-risk arguments, disgust at crawlers overwhelming open web communities, sadness for artists undercut by AI-generated content, and anger at political systems failing to check corporate AI power and resource consumption. The author concludes AI feels promising as technology but troubling for society.

Sanders and Casar unveil bill to ban superintelligent AI, pause advanced development

Sen. Bernie Sanders and Rep. Greg Casar announced the Ban Artificial Superintelligence Act, which would permanently prohibit building or deploying superintelligent AI and temporarily halt advanced AI development until a federal regulator sets safety rules. The bill also calls for the U.S. to pursue international agreements preventing superintelligence from being built anywhere in the world.