Follow-up to: Security Mindset and Ordinary Paranoia (Two days later, Amber returns with another question.) AMBER: Uh, say, Coral. How important is security mindset when you’re building a whole new kind of system—say, one subject to potentially adverse optimization pressures, where you want it to have some sort of robustness property? CORAL: How novel is the… Read more »
Monthly Archives: November 2017
Security Mindset and Ordinary Paranoia
The following is a fictional dialogue building off of AI Alignment: Why It’s Hard, and Where to Start. (AMBER, a philanthropist interested in a more reliable Internet, and CORAL, a computer security professional, are at a conference hotel together discussing what Coral insists is a difficult and important issue: the difficulty of building “secure”… Read more »
Announcing “Inadequate Equilibria”
MIRI Senior Research Fellow Eliezer Yudkowsky has a new book out today: Inadequate Equilibria: Where and How Civilizations Get Stuck, a discussion of societal dysfunction, exploitability, and self-evaluation. From the preface: Inadequate Equilibria is a book about a generalized notion of efficient markets, and how we can use this notion to guess where society will… Read more »
A major grant from the Open Philanthropy Project
I’m thrilled to announce that the Open Philanthropy Project has awarded MIRI a three-year $3.75 million general support grant ($1.25 million per year). This grant is, by far, the largest contribution MIRI has received to date, and will have a major effect on our plans going forward. This grant follows a $500,000 grant we received… Read more »
November 2017 Newsletter
Eliezer Yudkowsky has written a new book on civilizational dysfunction and outperformance: Inadequate Equilibria: Where and How Civilizations Get Stuck. The full book will be available in print and electronic formats November 16. To preorder the ebook or sign up for updates, visit equilibriabook.com. We’re posting the full contents online in stages over the next… Read more »
