End-of-the-year matching challenge!

Posted by & filed under News.

Update 2017-12-27: We’ve blown past our 3rd and final target, and reached the matching cap of $300,000 for the Matching Challenge! Thanks so much to everyone who supported us! All donations made before 23:59 PST on Dec 31st will continue to be counted towards our fundraiser total. The fundraiser total includes projected matching funds from… Read more »

December 2017 Newsletter

Posted by & filed under Newsletters.

  Our annual fundraiser is live. Discussed in the fundraiser post: News  — What MIRI’s researchers have been working on lately, and more. Goals — We plan to grow our research team 2x in 2018–2019. If we raise $850k this month, we think we can do that without dipping below a 1.5-year runway. Actual goals — A bigger-picture outline of… Read more »

Announcing Inadequate Equilibria

Posted by & filed under News.

MIRI Senior Research Fellow Eliezer Yudkowsky has a new book out today: Inadequate Equilibria: Where and How Civilizations Get Stuck, a discussion of societal dysfunction, exploitability, and self-evaluation. From the preface: Inadequate Equilibria is a book about a generalized notion of efficient markets, and how we can use this notion to guess where society will…

November 2017 Newsletter

Posted by & filed under Newsletters.

Eliezer Yudkowsky has written a new book on civilizational dysfunction and outperformance: Inadequate Equilibria: Where and How Civilizations Get Stuck. The full book will be available in print and electronic formats November 16. To preorder the ebook or sign up for updates, visit equilibriabook.com. We’re posting the full contents online in stages over the next… Read more »

October 2017 Newsletter

Posted by & filed under Newsletters.

“So far as I can presently estimate, now that we’ve had AlphaGo and a couple of other maybe/maybe-not shots across the bow, and seen a huge explosion of effort invested into machine learning and an enormous flood of papers, we are probably going to occupy our present epistemic state until very near the end. “[…I]t’s hard… Read more »

September 2017 Newsletter

Posted by & filed under Newsletters.

Research updates “Incorrigibility in the CIRL Framework”: a new paper by MIRI assistant researcher Ryan Carey responds to Hadfield-Menell et al.’s “The Off-Switch Game”. New at IAFF: The Three Levels of Goodhart’s Curse; Conditioning on Conditionals; Stable Pointers to Value: An Agent Embedded in Its Own Utility Function; Density Zero Exploration; Autopoietic Systems and the Difficulty… Read more »

August 2017 Newsletter

Posted by & filed under Newsletters.

Research updates “A Formal Approach to the Problem of Logical Non-Omniscience”: We presented our work on logical induction at the 16th Conference on Theoretical Aspects of Rationality and Knowledge. New at IAFF: Smoking Lesion Steelman; “Like This World, But…”; Jessica Taylor’s Current Thoughts on Paul Christiano’s Research Agenda; Open Problems Regarding Counterfactuals: An Introduction For Beginners “A Game-Theoretic… Read more »

July 2017 Newsletter

Posted by & filed under Newsletters.

A number of major mid-year MIRI updates: we received our largest donation to date, $1.01 million from an Ethereum investor! Our research priorities have also shifted somewhat, reflecting the addition of four new full-time researchers (Marcello Herreshoff, Sam Eisenstat, Tsvi Benson-Tilsen, and Abram Demski) and the departure of Patrick LaVictoire and Jessica Taylor. Research updates New at IAFF:… Read more »