January 2018 Newsletter

Posted by & filed under Newsletters.

Our 2017 fundraiser was a huge success, with 341 donors contributing a total of $2.5 million! Some of the largest donations came from Ethereum inventor Vitalik Buterin, bitcoin investors Christian Calderon and Marius van Voorden, poker players Dan Smith and Tom and Martin Crowley (as part of a matching challenge), and the Berkeley Existential Risk… Read more »

End-of-the-year matching challenge!

Posted by & filed under News.

Update 2017-12-27: We’ve blown past our 3rd and final target, and reached the matching cap of $300,000 for the Matching Challenge! Thanks so much to everyone who supported us! All donations made before 23:59 PST on Dec 31st will continue to be counted towards our fundraiser total. The fundraiser total includes projected matching funds from… Read more »

December 2017 Newsletter

Posted by & filed under Newsletters.

  Our annual fundraiser is live. Discussed in the fundraiser post: News  — What MIRI’s researchers have been working on lately, and more. Goals — We plan to grow our research team 2x in 2018–2019. If we raise $850k this month, we think we can do that without dipping below a 1.5-year runway. Actual goals — A bigger-picture outline of… Read more »

Announcing “Inadequate Equilibria”

Posted by & filed under News.

MIRI Senior Research Fellow Eliezer Yudkowsky has a new book out today: Inadequate Equilibria: Where and How Civilizations Get Stuck, a discussion of societal dysfunction, exploitability, and self-evaluation. From the preface: Inadequate Equilibria is a book about a generalized notion of efficient markets, and how we can use this notion to guess where society will… Read more »

November 2017 Newsletter

Posted by & filed under Newsletters.

Eliezer Yudkowsky has written a new book on civilizational dysfunction and outperformance: Inadequate Equilibria: Where and How Civilizations Get Stuck. The full book will be available in print and electronic formats November 16. To preorder the ebook or sign up for updates, visit equilibriabook.com. We’re posting the full contents online in stages over the next… Read more »

October 2017 Newsletter

Posted by & filed under Newsletters.

“So far as I can presently estimate, now that we’ve had AlphaGo and a couple of other maybe/maybe-not shots across the bow, and seen a huge explosion of effort invested into machine learning and an enormous flood of papers, we are probably going to occupy our present epistemic state until very near the end. “[…I]t’s hard… Read more »

September 2017 Newsletter

Posted by & filed under Newsletters.

Research updates “Incorrigibility in the CIRL Framework”: a new paper by MIRI assistant researcher Ryan Carey responds to Hadfield-Menell et al.’s “The Off-Switch Game”. New at IAFF: The Three Levels of Goodhart’s Curse; Conditioning on Conditionals; Stable Pointers to Value: An Agent Embedded in Its Own Utility Function; Density Zero Exploration; Autopoietic Systems and the Difficulty… Read more »

August 2017 Newsletter

Posted by & filed under Newsletters.

Research updates “A Formal Approach to the Problem of Logical Non-Omniscience”: We presented our work on logical induction at the 16th Conference on Theoretical Aspects of Rationality and Knowledge. New at IAFF: Smoking Lesion Steelman; “Like This World, But…”; Jessica Taylor’s Current Thoughts on Paul Christiano’s Research Agenda; Open Problems Regarding Counterfactuals: An Introduction For Beginners “A Game-Theoretic… Read more »