A fond farewell and a new Executive Director

Posted by & filed under News.

Dear friends and supporters of MIRI, I have some important news to share with you about the future of MIRI. Given my passion for doing research, I’m excited to have accepted a research position at GiveWell. Like MIRI, GiveWell is an excellent cultural fit for me, and I believe they’re doing important work. I look… Read more »

New papers on reflective oracles and agents

Posted by & filed under News.

We recently released two new papers on reflective oracles and agents. The first is “Reflective oracles: A foundation for classical game theory,” by Benja Fallenstein, Jessica Taylor, and Paul Christiano. Abstract: Classical game theory treats players as special—a description of a game contains a full, explicit enumeration of all players—even though in the real world, “players” are… Read more »

Recent AI control brainstorming by Stuart Armstrong

Posted by & filed under News.

MIRI recently sponsored Oxford researcher Stuart Armstrong to take a solitary retreat and brainstorm new ideas for AI control. This brainstorming generated 16 new control ideas, of varying usefulness and polish. During the past month, he has described each new idea, and linked those descriptions from his index post: New(ish) AI control ideas. He also named each… Read more »

2014 in review

Posted by & filed under MIRI Strategy.

It’s time for my review of MIRI in 2014.1 A post about our next strategic plan will follow in the next couple months, and I’ve included some details about ongoing projects at the end of this review.   2014 Summary Since early 2013, MIRI’s core goal has been to help create a new field of research devoted to the technical challenges… Read more »

New report: “An Introduction to Löb’s Theorem in MIRI Research”

Posted by & filed under News.

Today we publicly release a new technical report by Patrick LaVictoire, titled “An Introduction to Löb’s Theorem in MIRI Research.” The report’s introduction begins: This expository note is devoted to answering the following question: why do many MIRI research papers cite a 1955 theorem of Martin Löb, and indeed, why does MIRI focus so heavily… Read more »

Introducing the Intelligent Agent Foundations Forum

Posted by & filed under News.

Today we are proud to publicly launch the Intelligent Agent Foundations Forum (RSS), a forum devoted to technical discussion of the research problems outlined in MIRI’s technical agenda overview, along with similar research problems. Patrick’s welcome post explains: Broadly speaking, the topics of this forum concern the difficulties of value alignment- the problem of how to ensure that… Read more »

Bill Hibbard on Ethical Artificial Intelligence

Posted by & filed under Conversations.

Bill Hibbard is an Emeritus Senior Scientist at the University of Wisconsin-Madison Space Science and Engineering Center, currently working on issues of AI safety and unintended behaviors. He has a BA in Mathematics and MS and PhD in Computer Sciences, all from the University of Wisconsin-Madison. He is the author of Super-Intelligent Machines, “Avoiding Unintended…

Fallenstein talk for APS March Meeting 2015

Posted by & filed under News.

MIRI researcher Benja Fallenstein recently delivered an invited talk at the March 2015 meeting of the American Physical Society in San Antonio, Texas. His talk was one of four in a special session on artificial intelligence. Fallenstein’s title was “Beneficial Smarter-than-human Intelligence: the Challenges and the Path Forward.” His slides are available here. Abstract: Today,… Read more »