AI 'kill switch' may need to be mandatory, Anthropic co-founder says
0 / 29
English
中文
AI "more powerful by the day", Anthropic co-founder tells BBC An artificial intelligence "kill switch" which can be checked by a third-party may need to be mandatory for companies, a co-founder of one of the world's largest AI firms has said.
人工智能"一天比一天更强大"，Anthropic联合创始人告诉BBC 世界上最大的人工智能公司之一的联合创始人表示，可以由第三方检查的人工智能"杀死开关"可能需要对公司来说是强制性的。
Jack Clark, one of seven founders of Anthropic, said a way of shutting off AI software completely if it gets too dangerous was the kind of thing society "might want to eventually pass rules around".
Anthropic的七位创始人之一杰克*克拉克（Jack Clark）表示，如果AI软件变得太危险，那么完全关闭AI软件的方法就是社会"可能希望最终通过规则"的那种事情。
Clark said "most labs have different ways of being able to pull the plug", including Anthropic, but said policymakers may need to enforce having one.
克拉克说，"大多数实验室都有不同的方式能够拔出插头"，包括Anthropic，但表示政策制定者可能需要强制拥有一个。
The rapid development of AI and fears over the risks that the technology poses to humanity have been thrust into the spotlight by a series of warnings from executives and staff at AI firms.
人工智能的快速发展以及对该技术给人类带来的风险的担忧已经被人工智能公司高管和员工的一系列警告推到了聚光灯下。
Some have said publicly there is a chance that the technology could, if unchecked, kill all humans.
有人公开表示，如果不加以控制，这项技术有可能杀死所有人。
Anthropic head Dario Amodei over the weekend called for the pace of AI development to slow and be more closely monitored, as the company has done before, though some have questioned the motivations behind this.
人工智能负责人Dario Amodei周末呼吁人工智能发展的步伐放慢并受到更密切的监控，就像该公司之前所做的那样，尽管有些人质疑这背后的动机。
Amodei did not say how exactly how AI development could be slowed down and said any action to reign in AI development should be done "without sacrificing commercial advantage".
Amodei没有说明如何减缓人工智能的发展，并表示任何控制人工智能发展的行动都应该"在不牺牲商业优势的情况下"完成。
Clark told the BBC that specifics around "kill switch" requirements and verification should be part of "the larger policy conversation" taking place around AI.
克拉克告诉BBC，围绕"杀死开关"要求和验证的具体细节应该是围绕人工智能进行的"更大的政策对话"的一部分。
"Should you mandate for companies to definitely have a kill switch?
"你应该要求公司绝对有一个杀死开关吗？
Is that kill switch verifiable by a third party?" he asked. "I think that's the kind of thing society is going to want to know and might want to eventually pass rules around."
这个杀死开关可以被第三方验证吗?"他问。 "我认为这是社会想要知道的事情，并且可能希望最终通过规则。"
Anthropic, which was formed in 2021 by a group of former employees of its rival OpenAI, is currently at the centre of a debate around AI safety.
Anthropic由其竞争对手OpenAI的一群前雇员于2021年组建，目前正处于围绕人工智能安全的辩论中心。
Last week, a post from an artificial intelligence researcher who quit Anthropic over concerns AI could wipe out humanity went viral.
上周，一位人工智能研究人员的一篇文章因担心人工智能可能消灭人类而退出了人类。
In response, Anthropic scientist Evan Hubinger said he personally thought the possibility of human extinction from AI was ">10% within the next decade".
对此，人类科学家Evan Hubinger表示，他个人认为人类从AI中灭绝的可能性"在未来十年内>10％"。
Computer scientist and Nobel Prize winner Geoffrey Hinton, known as the "Godfather of AI", told the BBC on Friday that a 10% chance of AI killing all humans was "not unreasonable", external.
被称为"AI教父"的计算机科学家和诺贝尔奖获得者杰弗里*辛顿（Geoffrey Hinton）周五告诉BBC，AI杀死所有人类的10％机会"并非不合理"，外部。
Asked what percentage he would put on all humans being killed by AI, Clark said: "I don't think these statistics are that useful", but added that allowing AI to continue as a "totally unregulated industry" was a bad idea.
当被问及他将把什么百分比放在所有被AI杀死的人类身上时，克拉克说："我认为这些统计数据没有那么有用"，但补充说，允许AI继续作为一个"完全不受管
"We are rolling dice with immense risks," Clark said.
"我们正在冒着巨大的风险掷骰子，"克拉克说。
"And the point is, we have to change the course of this industry." AI staff 'genuinely frightened' for humanity's future, ex-Anthropic researcher tells BBC UK government rejects 'kill switch' idea for dangerous AI US lawmakers have put forward legislation dubbed the Kill Switch Act that would require companies to have a way to shut down problematic AI tools.
"关键是，我们必须改变这个行业的进程。" 人工智能工作人员"真正害怕"人类的未来，前人类研究员告诉BBC 英国政府拒绝"杀死开关"危险AI的想法 美国立法者已经提出了被称为"杀死开关法案"的立法，要求公司有办法关闭有问题的AI工具。
It would also give certain government agencies the power to demand a tool be turned off or limited.
它还将赋予某些政府机构要求关闭或限制工具的权力。
However, US President Donald Trump has rejected the idea of any attempts to slow down AI, saying on social media "AI taking over the World, destroying Humanity, and all other things bad, is a HOAX".
然而，美国总统唐纳德特朗普拒绝了任何试图减缓人工智能的想法，在社交媒体上说"人工智能接管世界，摧毁人类以及所有其他坏事都是一个骗局"。
He said in a separate post: "There is a SICK conspiracy going on against AI and Data Centers, and the only one that is happy about it is China.
他在另一篇文章中说："有一个针对AI和数据中心的病态阴谋正在进行，唯一对此感到高兴的是中国。
WHOEVER WINS AI, WINS!"
谁赢了AI，谁赢了！"
In the UK, the government has recently rejected the idea of creating a kill switch, with a spokesperson saying it "would not prevent them being developed or misused elsewhere".
在英国，政府最近拒绝了创建一个杀死开关的想法，一位发言人说它"不会阻止它们在其他地方被开发或滥用"。
Meanwhile, some in the AI industry have suggested the fears around it destroying humanity are overstated or may be designed to generate hype. Anthropic created the popular chatbot Claude and has this year released a number of increasingly capable AI models, the technology underlying AI chatbots.
与此同时，人工智能行业的一些人提出，围绕它摧毁人类的恐惧被夸大了，或者可能被设计成炒作。 Anthropic创造了流行的聊天机器人Claude，今年发布了许多功能越来越强大的AI模型，这是ai聊天机器人的基础技术。
Alongside OpenAI, Anthropic has since self-reported a number of incidents in where AI agents, which are bots that operate somewhat autonomously, have acted in ways that were unexpected.
与OpenAI一起，Anthropic自那时以来自我报告了许多事件，其中AI代理（有点自主运行的机器人）以意想不到的方式行事。
Anthropic is reportedly preparing for a potentially record-setting initial public offering on the stock market, allowing people to buy shares in its firm.
据报道，Anthropic正在准备在股票市场上进行可能创纪录的首次公开募股，允许人们购买其公司的股票。
OpenAI, which was most recently valued at $852bn (£630bn), had been expected to do the same, but OpenAI's Altman said on Friday this would not happen this year due to the current debate around AI safety.
OpenAI最近的估值为852bn（£630bn），预计也会这样做，但OpenAI的Altman周五表示，由于目前围绕AI安全的争论，今年不会发生这种情况。
仅供学习使用，如有侵权请联系删除 · 查看原文