May 2015 decision theory conference at Cambridge University

Posted by & filed under News.

MIRI, CSER, and the philosophy department at Cambridge University are co-organizing a decision theory conference titled Self-Prediction in Decision Theory and AI, to be held in the Faculty of Philosophy at the Cambridge University. The dates are May 13-19, 2015. Huw Price and Arif Ahmed at Cambridge University are the lead organizers. Confirmed speakers, in the order… Read more »

MIRI’s July 2014 newsletter

Posted by & filed under Newsletters.

Research Updates Two new reports: “Distributions allowing tiling of staged subjective EU maximizers” and “Non-omniscience, probabilistic inference, and metamathematics.” New analysis: Failures of an embodied intelligence. Book chapter co-authored by Nick Bostrom (Oxford) and Eliezer Yudkowsky (MIRI) now published in the Cambridge Handbook of Artificial Intelligence. 2 new expert interviews: Roger Schell on long-term computer security research and Allan Friedman on cybersecurity… Read more »

New report: “Non-omniscience, probabilistic inference, and metamathematics”

Posted by & filed under Papers.

UC Berkeley student and MIRI research associate Paul Christiano has released a new report: “Non-omniscience, probabilistic inference, and metamathematics.” Abstract: We suggest a tractable algorithm for assigning probabilities to sentences of first-order logic and updating those probabilities on the basis of observations. The core technical difficulty is relaxing the constraints of logical consistency in a way… Read more »

Roger Schell on long-term computer security research

Posted by & filed under Conversations.

Roger R. Schell is a Professor of Engineering Practice at the University Of Southern California Viterbi School Of Engineering, and a member of the founding faculty for their Masters of Cyber Security degree program. He is internationally recognized for originating several key security design and evaluation techniques, and he holds patents in cryptography, authentication and… Read more »

New chapter in Cambridge Handbook of Artificial Intelligence

Posted by & filed under Papers.

The Cambridge Handbook of Artificial Intelligence has been released. It contains a chapter co-authored by Nick Bostrom (Oxford) and Eliezer Yudkowsky (MIRI) called “The Ethics of Artificial Intelligence,” available in PDF here. The abstract reads: The possibility of creating thinking machines raises a host of ethical issues. These questions relate both to ensuring that such…

Our mid-2014 strategic plan

Posted by & filed under MIRI Strategy.

Summary Events since MIRI’s April 2013 strategic plan have increased my confidence that we are “headed in the right direction.” During the rest of 2014 we will continue to: Decrease our public outreach efforts, leaving most of that work to FHI at Oxford, CSER at Cambridge, FLI at MIT, Stuart Russell at UC Berkeley, and others (e.g. James… Read more »

New report: “Distributions allowing tiling of staged subjective EU maximizers”

Posted by & filed under Papers.

MIRI has released a new technical report by Eliezer Yudkowsky, “Distributions allowing tiling of staged subjective EU maximizers,” which summarizes some work done at MIRI’s May 2014 workshop. Abstract: We consider expected utility maximizers making a staged series of sequential choices, and replacing themselves with successors on each time-step (to represent self-modification). We wanted to find… Read more »

Allan Friedman on cybersecurity and cyberwar

Posted by & filed under Conversations.

MIRI recently interviewed Allan Friedman, co-author of Cybersecurity and Cyberwar: What Everyone Needs to Know. We interviewed Dr. Friedman about cyberwar because the regulatory and social issues raised by the prospect of cyberwar may overlap substantially with those that will be raised by the prospect of advanced autonomous AI systems, such as those studied by MIRI. Our GiveWell-style notes… Read more »