The human brain has some capabilities that the brains of other animals lack. It is to these distinctive capabilities that our species owes its dominant position. Other animals have stronger muscles or sharper claws, but we have cleverer brains.If machine brains one day come to surpass human brains in general intelligence, then this new superintelligence could become very powerful. As the fate of the gorillas now depends more on us humans than on the gorillas themselves, so the fate of our species then would come to depend on the actions of the machine superintelligence.But we have one advantage: we get to make the first move. Will it be possible to construct a seed AI or otherwise to engineer initial conditions so as to make an intelligence explosion survivable? How could one achieve a controlled detonation?To get closer to an answer to this question, we must make our way through a fascinating landscape of topics and considerations. Read the book and learn about oracles, genies, singletons; about boxing methods, tripwires, and mind crime; about humanitys cosmic endowment and differential technological development; indirect normativity, instrumental convergence, whole brain emulation and technology couplings; Malthusian economics and dystopian evolution; artificial intelligence, and biologicalcognitive enhancement, and collective intelligence.This profoundly ambitious and original book picks its way carefully through a vast tract of forbiddingly difficult intellectual terrain. Yet the writing is so lucid that it somehow makes it all seem easy. After an utterly engrossing journey that takes us to the frontiers of thinking about the human condition and the future of intelligent life, we find in Nick Bostroms work nothing less than a reconceptualization of the essential task of our time.
##或许会被视作领域的奠基之作,可能在搭框架和 raise awareness 方面贡献明显。但实在太dry,对看过足够多SIFI、稍有ML背景的读者来说新鲜有意思的内容也不多。
评分##呵呵呵
评分##看不懂
评分##Too boring... Someone can definitely write a book with counter arguments. And AI is just like nuclear technologies: men should be more careful with ourselves, not the technologies.
评分##看标题还以为是那种媒体里常见的吸引眼球标题党然后不负责任地胡说八道一通的书。看内容发现还是比较中肯地陈述和分析的。 不过有些内容也比较空洞。比如连 AI 或者超级 AI 是否可能,以及会以什么样的形态出现都没搞清楚的情况下讨论 AI 出现的过程会有多快之类的问题就很没有着力点的感觉。到后面的部分就觉得有些无聊很快扫过了。
评分##太有勇气的一本书。有凭一人一书之力打造一个科学体系的架势,试图预测,理解和控制一个超越人类认知范围的物种。烧脑过瘾。
评分##有点枯燥,没看完
评分另一本脑洞大开的书。探讨了人工智能的不同形式,其可能带来的风险,以及人类可能采取的应对方式。
评分##Too boring... Someone can definitely write a book with counter arguments. And AI is just like nuclear technologies: men should be more careful with ourselves, not the technologies.