MIRI Updates
New paper: “Formalizing convergent instrumental goals”
Tsvi Benson-Tilsen, a MIRI associate and UC Berkeley PhD candidate, has written a paper with contributions from MIRI Executive Director Nate Soares on strategies that will tend to be useful for most possible ends: “Formalizing convergent instrumental goals.” The paper...
November 2015 Newsletter
Research updates A new paper: Leó Szilárd and the Danger of Nuclear Weapons New at IAFF: Subsequence Induction A shortened version of the Reflective Oracles paper has been published in the LORI 2015 conference proceedings. General updates Castify has released...
Edge.org contributors discuss the future of AI
In January, nearly 200 public intellectuals submitted essays in response to the 2015 Edge.org question, “What Do You Think About Machines That Think?” (available online). The essay prompt began: In recent years, the 1980s-era philosophical discussions about artificial intelligence (AI)—whether...
New report: “Leó Szilárd and the Danger of Nuclear Weapons”
Today we release a new report by Katja Grace, “Leó Szilárd and the Danger of Nuclear Weapons: A Case Study in Risk Mitigation” (PDF, 72pp). Leó Szilárd has been cited as an example of someone who predicted a highly disruptive...
October 2015 Newsletter
Research updates New paper: Asymptotic Logical Uncertainty and The Benford Test New at IAFF: Proof Length and Logical Counterfactuals Revisited; Quantilizers Maximize Expected Utility Subject to a Conservative Cost Constraint General updates As a way to engage more researchers in...
New paper: “Asymptotic logical uncertainty and the Benford test”
We have released a new paper on logical uncertainty, co-authored by Scott Garrabrant, Siddharth Bhaskar, Abram Demski, Joanna Garrabrant, George Koleszarik, and Evan Lloyd: “Asymptotic logical uncertainty and the Benford test.” Garrabrant gives some background on his approach to logical...