top of page
OUR MISSION
Reduce p(doom)
Increase p(zoom)
p(doom) is the probability that advanced AI makes humanity extinct; p(zoom) is the probability that safe SuperIntelligence is the first SuperIntelligence developed
SuperIntelligence could save us - or end us. Design is everything.
OUR GOAL IS SIMPLE
Lower the chances AI wipes us out. Raise the chances it makes life better for everyone.​
We design systems that stay aligned with human values and actually make things safer as they get smarter.
Expected Value of Lives Saved
Our best estimate of lives that might be saved from visits to this site so far.
...
Designing Safe Superintelligence:
How aligned systems evolve safely
Safe Superintelligence in 3 Minutes:
Quick intro to
risk-reducing SI design
AI Safety Series:
Exploring ethical and technical safeguards for AGI
bottom of page





