MIRI Updates
Update January 2019: MIRI’s 2018 fundraiser is now concluded. Target 1 $500,000 CompletedTarget 2 $1,200,000In Progress $946,981 | | $0 | $300,000 | $600,000 | $900,000 | $1,200,000 Fundraiser concluded 345 donors contributed × Target Descriptions Target 1 Target...
For many years, MIRI’s goal has been to resolve enough fundamental confusions around alignment and intelligence to enable humanity to think clearly about technical AI safety risks—and to do this before this technology advances to the point of potential catastrophe....
This is the conclusion of the Embedded Agency series. Previous posts: Embedded Agents — Decision Theory — Embedded World-ModelsRobust Delegation — Subsystem Alignment A final word on curiosity, and intellectual puzzles: I described an embedded agent, Emmy,...
You want to figure something out, but you don’t know how to do that yet. You have to somehow break up the task into sub-computations. There is no atomic act of “thinking”; intelligence must be built up of non-intelligent...
Because the world is big, the agent as it is may be inadequate to accomplish its goals, including in its ability to think. Because the agent is made of parts, it can improve itself and become more capable. Improvements can...
An agent which is larger than its environment can: Hold an exact model of the environment in its head. Think through the consequences of every potential course of action. If it doesn’t know the environment perfectly, hold every...