Anthropic boss Dario Amodei calls for AI development to slow down
0 / 44
English
中文
There was no alternative to developing AI, Anthropic boss Dario Amodei said The head of AI company Anthropic has called for the pace of development of artificial intelligence models to slow down and to be closely monitored.
Anthropic 老板 Dario Amodei 表示，除了开发人工智能之外别无选择 人工智能公司Anthropic的负责人呼吁放慢人工智能模型的发展速度并密切监控。
In an essay on Saturday, Dario Amodei said developing AI was not in question, but the risks associated with it were "serious" and companies and governments must be given time to address them.
达里奥·阿莫迪在周六的一篇文章中表示，开发人工智能并不是问题，但与之相关的风险是“严重的”，企业和政府必须有时间来解决这些问题。
The heads of two rival AI firms, Sam Altman of OpenAI and Elon Musk, have both said they agree with Amodei.
OpenAI 的萨姆·奥尔特曼 (Sam Altman) 和埃隆·马斯克 (Elon Musk) 两家竞争对手人工智能公司的负责人都表示同意阿莫迪的观点。
There have been growing concerns recently about the technology's potential risks, the most serious of which suggested there is a greater than 10% chance it "could kill all humans" within the next decade.
最近人们越来越担心这项技术的潜在风险，其中最严重的风险表明，它在未来十年内“可能杀死所有人类”的可能性超过 10%。
Anthropic previously said it had identified and disrupted attempts to use its AI model for "malicious activity" which could support the development of biological weapons.
Anthropic 此前表示，它已经发现并阻止了利用其人工智能模型进行“恶意活动”的企图，这些活动可能支持生物武器的开发。
But the starkest warning came from two employees from Anthropic's safety team who have resigned in the last two weeks saying humanity may not survive, external the race among AI companies to develop machines that are smarter than humans.
但最严厉的警告来自 Anthropic 安全团队的两名员工，他们在过去两周辞职，称在人工智能公司开发比人类更聪明的机器的竞赛之外，人类可能无法生存。
Amodei proposed a three-point plan that includes independent monitoring of AI models as they are developed, industry-wide regulation and global regulation.
阿莫代提出了三点计划，包括对人工智能模型开发进行独立监控、全行业监管和全球监管。
As his proposal made the rounds, even competitors voiced support for the idea of third-party monitors who could evaluate the safety of models as they are developed.
随着他的提案广为流传，甚至竞争对手也表示支持第三方监控器的想法，第三方监控器可以在模型开发时评估模型的安全性。
"I agree with Dario that we need to pace the frontier," wrote OpenAI CEO Sam Altman on X.
OpenAI 首席执行官 Sam Altman 在 X 上写道：“我同意 Dario 的观点，我们需要在前沿领域保持步伐。”
He called independent evaluators "a great idea." In a new interview with Fortune Magazine, Altman had sounded similar safety concerns, saying standards were "not at a place" to push AI capabilities much further.
他称独立评估员是“一个好主意”。 在《财富》杂志的一次新采访中，奥特曼也表达了类似的安全担忧，称标准“不适合”进一步推动人工智能能力。
He added that he believed AI beyond human control is "absolutely" possible.
他补充说，他相信超越人类控制的人工智能“绝对”可能。
Elon Musk meanwhile said the Anthropic boss was "right".
与此同时，埃隆·马斯克表示，人类老板是“正确的”。
The warnings have prompted calls to action, but US President Donald Trump has so far rejected such fears, saying on Thursday he was concerned "if we don't win AI, we're going to be put in a very bad position".
这些警告促使人们呼吁采取行动，但美国总统唐纳德·特朗普迄今为止否认了这种担忧，周四表示，他担心“如果我们不能赢得人工智能，我们将处于非常糟糕的境地”。
Some observers have also suggested that Amodei's post may be less about safety than about consolidating control over AI technology.
一些观察家还表示，阿莫迪的帖子可能更多的是为了巩固对人工智能技术的控制，而不是安全。
Cyber-security concerns have grown as new models have exhibited more and more powerful hacking capabilities.
随着新型号展现出越来越强大的黑客能力，网络安全问题日益严重。
Anthropic withheld its Mythos model from public use when it was announced in April that it could independently escape the testing environment, known as the sandbox.
Anthropic 在 4 月份宣布其 Mythos 模型可以独立逃离被称为沙箱的测试环境后，停止了其 Mythos 模型的公开使用。
In the run-up to the release of its most recent Astra model, OpenAI cited cybersecurity concerns as it explained it had paused certain aspects of the model's development.
在发布最新 Astra 模型之前，OpenAI 提到了网络安全问题，并解释称已暂停了该模型开发的某些方面。
Safety has also taken centrestage in the rivalry between Anthropic and OpenAI.
在 Anthropic 和 OpenAI 之间的竞争中，安全性也占据了中心地位。
Amodei, who had previously worked as a vice president at OpenAI, has said he co-founded Anthropic in 2021 so he could build safer and more trusted AI models.
Amodei 曾担任 OpenAI 副总裁，他表示，他于 2021 年共同创立了 Anthropic，以便能够构建更安全、更值得信赖的 AI 模型。
Dramatic insider warnings over AI fall flat with some in Silicon Valley In his essay, called We Must Pace the Frontier, Amodei pointed out that AI had advanced "drastically faster" including its "ability to build the next generation of AI" - and mentioned an incident involving rival OpenAI which has revealed that agents conducted cybersecurity attacks, external on targets they were not asked to attack in July.
硅谷的一些内部人士对人工智能的严重警告没有得到回应 阿莫迪在题为《我们必须在前沿迈进》的文章中指出，人工智能的进步“快得多”，包括“构建下一代人工智能的能力”，并提到了涉及竞争对手 OpenAI 的事件，该事件表明特工在 7 月份对他们没有被要求攻击的目标进行了网络安全攻击。
The OpenAI agents had "essentially acted as a fanatically devoted collective", Amodei said.
阿莫迪说，OpenAI 特工“本质上是一个狂热奉献的集体”。
OpenAI has said it is slowing down training of certain advanced AI models and tools as a result.
OpenAI 表示，它正在放慢某些高级人工智能模型和工具的训练速度。
Amodei called for "building AI at a balanced rate that aims to ensure its safety while still achieving its benefits". This would not mean "halting model training or technical progress, but ensuring companies take adequate time to align and safeguard their models, and for third party evaluators to confirm this".
阿莫代呼吁“以平衡的速度构建人工智能，旨在确保其安全性，同时仍能实现其效益”。 这并不意味着“停止模型培训或技术进步，而是确保公司花足够的时间来调整和保护其模型，并让第三方评估人员确认这一点”。
He was committing Anthropic to this "unilaterally" - as well as calling on governments "to require other frontier companies to match".
他让 Anthropic “单方面”致力于这一点，并呼吁各国政府“要求其他前沿公司与之相匹配”。
Amodei said he recognised that regulation might not be able to keep up with the pace of AI, and therefore called on AI companies to "voluntarily work together to set standard" in parallel with regulation.
阿莫迪表示，他认识到监管可能无法跟上人工智能的步伐，因此呼吁人工智能公司在监管的同时“自愿共同制定标准”。
The Anthropic CEO went on to address the impact that a slowdown would have on the industry and competition with leading developers worldwide, particularly China.
Anthropic 首席执行官接着谈到了经济放缓对该行业以及与全球领先开发商（尤其是中国）的竞争的影响。
"I believe that if slowing down bought us even an extra year or two before models reach critical levels of capability, and we used that time to advance alignment, we could greatly reduce the risk that something goes seriously wrong," Amodei said.
阿莫迪说：“我相信，如果放慢速度，让我们在模型达到关键能力水平之前多花一两年的时间，并且我们利用这段时间来推进调整，我们就可以大大降低出现严重错误的风险。”
This would have to be done in a co-ordinated manner "without sacrificing commercial advantage or the United States' lead in AI".
这必须以协调的方式完成，“不能牺牲商业优势或美国在人工智能领域的领先地位”。
Any slowdown would have to be limited, he said, to avoid allowing China to pull ahead.
他表示，任何放缓都必须受到限制，以避免让中国领先。
He urged the US government to take measures so that US companies' AI chips could not be sold to China - or the technology shared with authoritarian countries. Amodei's post has prompted a wide range of responses.
他敦促美国政府采取措施，禁止美国公司的人工智能芯片出售给中国，或者与独裁国家共享技术。 阿莫代的帖子引起了广泛的回应。
Clement Delangue, the CEO of the AI platform Hugging Face, said he was launching a new project called the Open Alignment Initiative, adding he wanted to be among "embedded evaluators" that Amodei proposed could be part of a solution.
人工智能平台 Hugging Face 的首席执行官克莱门特·德兰格 (Clement Delangue) 表示，他正在启动一个名为“开放对齐计划”的新项目，并补充说，他希望成为 Amodei 提议的“嵌入式评估者”之一，这可能是解决方案的一部分。
Hugging Face was hacked by OpenAI agents earlier this year prompting an outcry over AI safety.
今年早些时候，Hugging Face 遭到 OpenAI 代理的黑客攻击，引发了人们对人工智能安全的强烈抗议。
"Let's make AI safer by making it more transparent."
“让我们通过让人工智能变得更加透明来让人工智能变得更安全。”
Delangue wrote on X.
德兰格在 X 上写道。
Elon Musk also voiced his support, writing that "Dario is right". Musk, whose SpaceXAI makes the controversial chatbot Grok, once called Anthropic "evil" but has changed his tone since signing a $15bn deal to sell compute capacity to Anthropic in May.
埃隆·马斯克也表达了他的支持，并写道“达里奥是对的”。 马斯克旗下的 SpaceXAI 制造了备受争议的聊天机器人 Grok，他曾称 Anthropic 为“邪恶”，但自从 5 月份签署了一项价值 150 亿美元的向 Anthropic 出售计算能力的协议后，他的语气发生了变化。
However some observers suggested that Amodei's post was less about safety than about consolidating control over AI technology.
然而一些观察人士认为，阿莫迪的帖子与其说是关于安全，不如说是为了巩固对人工智能技术的控制。
"Dario makes the case to stop open source and concentrate enormous technological and economic power with Anthropic," wrote Chamath Palihapitiya, investor and co-host of the tech podcast "All-In".
“达里奥提出了停止开源并将巨大的技术和经济力量集中到 Anthropic 的理由，”科技播客“All-In”的投资者兼联合主持人查马斯·帕里哈皮蒂亚 (Chamath Palihapitiya) 写道。
Notions of slowing down or even pausing AI development have long been met with such cynicism in certain corners of Silicon Valley, with critics accusing leading AI developers of hyping their technology as a marketing ploy.
长期以来，在硅谷的某些角落，放慢甚至暂停人工智能开发的想法一直遭到冷嘲热讽，批评者指责领先的人工智能开发商将其技术作为一种营销策略进行宣传。
Anthropic and OpenAI are both reportedly preparing for potentially record-setting initial public offerings.
据报道，Anthropic 和 OpenAI 都在为可能创纪录的首次公开募股做准备。
Why some experts increasingly fear AI will take over Anthropic researcher believes more than 10% chance AI 'could kill all humans' The contradiction at the heart of the trillion-dollar AI race
为什么一些专家越来越担心人工智能会取代 人类研究人员认为人工智能“杀死所有人类”的可能性超过 10% 万亿美元人工智能竞赛的核心矛盾
仅供学习使用，如有侵权请联系删除 · 查看原文