MIRI’s mission is “to ensure that the creation of smarter-than-human intelligence has a positive impact.” One policy-relevant question is: How well should we expect policy makers to handle the invention of AGI, and what does this imply about how much...
MIRI aims to do research now that increases humanity’s odds of successfully managing important AI-related events that are at least a few decades away. Thus, we’d like to know: To what degree can we take actions now that will predictably...
In this post, I aim to summarize one common view on AI transparency and AI reliability. It’s difficult to identify the field’s “consensus” on AI transparency and reliability, so instead I will present a common view so that I can...
One of the most common objections we hear when talking about artificial general intelligence (AGI) is that “AGI is ill-defined, so you can’t really say much about it.” In an earlier post, I pointed out that we often don’t have...
In 2008, security expert Bruce Schneier wrote about the security mindset: Security requires a particular mindset. Security professionals… see the world differently. They can’t walk into a store without noticing how they might shoplift. They can’t use a computer without...
When asked their opinions about “human-level artificial intelligence” — aka “artificial general intelligence” (AGI) ((I use the HLAI and AGI interchangeably, but lately I’ve been using AGI almost exclusively, because I’ve learned that many people in the AI community react...
