Soares, Tallinn, and Yudkowsky discuss AGI cognition

Posted by & filed under Analysis.

  This is a collection of follow-up discussions in the wake of Richard Ngo and Eliezer Yudkowsky’s first three conversations (1 and 2, 3).   Color key:   Chat     Google Doc content     Inline comments     7. Follow-ups to the Ngo/Yudkowsky conversation   [Bensinger][1:50]  (Nov. 23 follow-up comment) Readers who aren’t… Read more »

Christiano, Cotra, and Yudkowsky on AI progress

Posted by & filed under Analysis.

  This post is a transcript of a discussion between Paul Christiano, Ajeya Cotra, and Eliezer Yudkowsky on AGI forecasting, following up on Paul and Eliezer’s “Takeoff Speeds” discussion.   Color key:  Chat by Paul and Eliezer   Chat by Ajeya   Inline comments      8. September 20 conversation   8.1. Chess and Evergrande   [Christiano][15:28]… Read more »

Yudkowsky and Christiano discuss “Takeoff Speeds”

Posted by & filed under Analysis.

  This is a transcription of Eliezer Yudkowsky responding to Paul Christiano’s Takeoff Speeds live on Sep. 14, followed by a conversation between Eliezer and Paul. This discussion took place after Eliezer’s conversation with Richard Ngo, and was prompted by an earlier request by Richard Ngo that Eliezer respond to Paul on Takeoff Speeds. Color… Read more »

Ngo and Yudkowsky on alignment difficulty

Posted by & filed under Analysis.

  This post is the first in a series of transcribed Discord conversations between Richard Ngo and Eliezer Yudkowsky, moderated by Nate Soares. We’ve also added Richard and Nate’s running summaries of the conversation (and others’ replies) from Google Docs. Later conversation participants include Ajeya Cotra, Beth Barnes, Carl Shulman, Holden Karnofsky, Jaan Tallinn, Paul… Read more »

Discussion with Eliezer Yudkowsky on AGI interventions

Posted by & filed under Analysis, Conversations, MIRI Strategy.

  The following is a partially redacted and lightly edited transcript of a chat conversation about AGI between Eliezer Yudkowsky and a set of invitees in early September 2021. By default, all other participants are anonymized as “Anonymous”. I think this Nate Soares quote (excerpted from Nate’s response to a report by Joe Carlsmith) is… Read more »

November 2021 Newsletter

Posted by & filed under Newsletters.

MIRI updates MIRI won’t be running a formal fundraiser this year, though we’ll still be participating in Giving Tuesday and other matching opportunities. Visit to donate and to get information on tax-advantaged donations, employer matching, etc. Giving Tuesday takes place on Nov. 30 at 5:00:00am PT.  Facebook will 100%-match the first $2M donated — something that took less than… Read more »

October 2021 Newsletter

Posted by & filed under Newsletters.

Redwood Research is a new alignment research organization that just launched their website and released an explainer about what they're currently working on. We're quite excited about Redwood's work, and encourage our supporters to consider applying to work there to help boost Redwood's alignment research. MIRI senior researcher Eliezer Yudkowsky writes: Redwood Research is investigating a toy problem in… Read more »