New annotated bibliography for MIRI’s technical agenda

Posted by & filed under News.

Today we release a new annotated bibliography accompanying our new technical agenda, written by Nate Soares. If you’d like to discuss the paper, please do so here. Abstract: How could superintelligent systems be aligned with the interests of humanity? This annotated bibliography compiles some recent research relevant to that question, and categorizes it into six topics: (1)… Read more »

New mailing list for MIRI math/CS papers only

Posted by & filed under News.

As requested, we now offer email notification of new technical (math or computer science) papers and reports from MIRI. Simply subscribe to the mailing list below. This list sends one email per new technical paper, and contains only the paper’s title, author(s), and abstract, plus a link to the paper. Subscribe: Email Address * First Name… Read more »

New report: “The value learning problem”

Posted by & filed under News.

Today we release a new technical report by Nate Soares, “The value learning problem.” If you’d like to discuss the paper, please do so here. Abstract: A superintelligent machine would not automatically act as intended: it will act as programmed, but the fit between human intentions and formal specification could be poor. We discuss methods by which a… Read more »

New report: “Formalizing Two Problems of Realistic World Models”

Posted by & filed under News.

Today we release a new technical report by Nate Soares, “Formalizing two problems of realistic world models.” If you’d like to discuss the paper, please do so here. Abstract: An intelligent agent embedded within the real world must reason about an environment which is larger than the agent, and learn how to achieve goals in that environment. We… Read more »

New report: “Vingean Reflection: Reliable Reasoning for Self-Improving Agents”

Posted by & filed under News.

Today we release a new technical report by Benja Fallenstein and Nate Soares, “Vingean Reflection: Reliable Reasoning for Self-Improving Agents.” If you’d like to discuss the paper, please do so here. Abstract: Today, human-level machine intelligence is in the domain of futurism, but there is every reason to expect that it will be developed eventually. Once… Read more »

An improved “AI Impacts” website

Posted by & filed under News.

Recently, MIRI received a targeted donation to improve the AI Impacts website initially created by frequent MIRI collaborator Paul Christiano and part-time MIRI researcher Katja Grace. Collaborating with Paul and Katja, we ported the old content to a more robust and navigable platform, and made some improvements to the content. You can see the result… Read more »

New report: “Questions of reasoning under logical uncertainty”

Posted by & filed under News.

Today we release a new technical report by Nate Soares and Benja Fallenstein, “Questions of reasoning under logical uncertainty.” If you’d like to discuss the paper, please do so here. Abstract: A logically uncertain reasoner would be able to reason as if they know both a programming language and a program, without knowing what the program… Read more »

Matthias Troyer on Quantum Computers

Posted by & filed under Conversations.

Dr. Matthias Troyer is a professor of Computational Physics at ETH Zürich. Before that, he finished University Studies in “Technischer Physik” at the Johannes Kepler Universität Linz, Austria, as well as Diploma in Physics and Interdisciplinary PhD thesis at the ETH Zürich. His research interest and experience focuses on High Performance Scientific Simulations on architectures,… Read more »