We discuss scenarios and branch points to four major possible consequences regarding future machine intelligence; 1) the singleton scenario where the first and only super-intelligence acquires a decisive strategic advantage, 2) the multipolar scenario where the singleton scenario is not technically denied but political or other factors in human society or multi-agent interactions between the intelligent agents prevent a single agent from gaining a decisive strategic advantage, 3) the ecosystem scenario where the singleton scenario is denied and many autonomous intelligent agents operate in such a way that they are interdependent and virtually unstoppable, and 4) the upper-bound scenario where cognitive capabilities that can be achieved by human-designed intelligent agents or their descendants are inherently limited to the sub-human level. We identify six major constraints that can form branch points to these scenarios; (1) constraints on autonomy, (2) constraints on the ability to improve self-structure, (3) constraints related to thermodynamic efficiency, (4) constraints on updating physical infrastructure, (5) constraints on relative advantage, and (6) constraints on locality.
翻译:我们讨论的情景和分支指出未来机器情报的四大可能后果; (1) 单吨情景,其中第一个和唯一的超级智能获得决定性战略优势; (2) 多极情景,其中单吨情景在技术上并不被剥夺,而是人类社会中的政治或其他因素或智能剂之间的多媒介互动阻止了单一剂获得决定性战略优势; (3) 生态系统情景,其中单吨情景被拒绝,许多自主智能剂以相互依存和几乎不可阻挡的方式运作; (4) 上限情景,其中人造智能剂或其后代能够实现的认知能力必然局限于次人类层面; 我们确定了可形成分支的六大制约因素; (1) 对自主性的限制,(2) 对改进自我结构能力的限制,(3) 与热力效率有关的限制,(4) 对更新有形基础设施的限制,(5) 对相对优势的限制,(6) 对地方的限制。</s>