Speaker：Max Tegmark

视频

原视频

摘要

• We also have to figure out, if we're going to be really ambitious, how to steer it and where we want to go with it.
  如果我们有足够的雄心壮志，就应当想出如何控制它们的方法，希望它朝着怎样的方向前进。

• This is the definition of artificial general intelligence -- AGI, which has been the holy grail of AI research since its inception.
  这就成了通用人工智能（Artificial general intelligence）——AGI，从一开始它就是人工智能研究最终的圣杯。

• Which means that there's a possibility that further AI progress could be way faster than the typical human research and development timescale of years, raising the controversial possibility of an intelligence explosion where recursively self-improving AI rapidly leaves human intelligence far behind, creating what's known as superintelligence.
  那就意味着有可能，进一步提升人工智能水平将会进行得非常迅速，甚至超越用年份来计算时间的典型人类研究和发展，提高到一种极具争议性的可能性，那就是智能爆炸，即能够不断做自我改进的人工智能很快就会遥遥领先人类，创造出所谓的超级人工智能。

• But this is going to require a change of strategy because our old strategy has been learning from mistakes.
  但这也需要策略上的改变，因为我们以往的策略往往都是从错误中学习的。

• One is that we should avoid an arms race and lethal autonomous weapons. Another Asilomar AI principle is that we should mitigate AI-fueled income inequality. You'll appreciate this principle that we should invest much more in AI safety research.
  其中一条规则是我们需要避免军备竞赛，以及致命的自动化武器出现；另一条阿西洛玛人工智能会议的原则是，我们应该要减轻由人工智能引起的收入不平等；你们会感谢这条准则，我们应该要投入更多以确保对人工智能安全性的研究。

• And this AI safety work has to include work on AI value alignment, because the real threat from AGI isn't malice, like in silly Hollywood movies, but competence -- AGI accomplishing goals that just aren't aligned with ours.
  这项人工智能安全性的工作必须包含对人工智能价值观的校准，因为 AGI 会带来的威胁通常并非出于恶意——就像是愚蠢的好莱坞电影中表现的那样，而是源于能力——AGI想完成的目标与我们的目标背道而驰。

• With friendly AI, we could simply build all of these societies and give people the freedom to choose which one they want to live in because we would no longer be limited by our intelligence, merely by the laws of physics.
  有了友善的人工智能，我们就能轻而易举地建立这些社会，让大家有自由去选择想要生活在怎样的社会里，因为我们不会再受到自身智慧的限制，唯一的限制只有物理的定律。

• We can be ambitious -- thinking hard about how to steer our technology and where we want to go with it to create the age of amazement.
  我们可以拥有雄心壮志——努力去找到操控我们科技的方法，以及向往的目的地，创造出真正令人惊奇的时代。