Recently The New York Times reported the following:
Anthropic’s I.P.O. Prospectus Spells Out a Future of
Promise and Peril (2/2)
The A.I. company took great pains to describe the many
benefits that can come from using its Claude chatbot and technology, but also
offered up a heavy dose of gloom.
By Mike Isaac - Mike Isaac covers Silicon Valley and
artificial intelligence from San Francisco.
Oct. 26, 2026
(continue)
And finally, Dr. Amodei notes that advancements in A.I.
could unburden us from needless bureaucracy. He sketches a future where DMV
lines are shortened, job seekers can receive services to find employment more
easily and Medicaid systems are navigable. Perhaps most of all, he claims the
technology can help “democratic governments deliver on their promises to
citizens.”
“Alongside our customers, we intend to apply our AI
models to revolutionize these and dozens of other areas of human endeavor.
Doing so may well represent the greatest economic opportunity in human
history.”
Though the prospectus is front-loaded with sweetness and
light, the paperwork has all the hallmarks of Anthropic’s anxieties. In page
after page, the company lists the many risks that A.I. poses to its business —
and society.
“AI can be misused by those who wish to do harm, for
example to conduct cyberattacks or to design biological weapons.”
At least some of this is already happening. Over the summer,
a series of cybersecurity breaches from Anthropic, OpenAI and other leading
A.I. labs kicked off an industrywide discussion on how to safeguard advanced
systems.
Dr. Amodei and the company go on to list the flip sides to
all the positive possibilities laid out at the beginning of the document. With
economic prosperity comes the potential for great upheaval.
“The incredible economic value of AI may come with
economic disruption, similar to what has happened with previous technologies
but greater in magnitude.”
And Anthropic suggests that just as democratic governments
may be empowered, so too could autocratic regimes. Dr. Amodei continues:
“Authoritarian governments may use AI to create high-tech
surveillance states, deepen repression, and make themselves much more difficult
to dislodge.”
No I.P.O. prospectus from Anthropic would have been complete
without Dr. Amodei’s biggest concern, and what some might call the ultimate
“risk factor” — a disclosure companies are required to make to investors about
issues that could adversely affect their business.
“Sufficiently advanced AI systems could, if not
developed, deployed, and operated with appropriate safeguards, oversight, and
security measures, pose catastrophic or existential risks to humanity.”
Put more simply: Yes, Anthropic believes its technology
could bring about conditions for human flourishing the likes of which have
never been seen. The company also believes it could bring about the end of the
world.
Most normal companies do not tend to address such weighty
philosophical matters when filing to go public. But Anthropic is far from a
normal company.
Translation
Anthropic 的 IPO 招股說明書描繪了充滿希望與風險的未來
(2/2)
這家人工智能公司不遺餘力地描述了使用其 Claude 聊天機器人和技術所能帶來的許多好處,但同時也透露出不少令人擔憂的資訊
(繼續)
最後,Amodei 博士指出,人工智能的進步可以讓我們擺脫不必要的官僚主義。他描繪了一個未來:車輛管理局排隊時間縮短,求職者可以更輕鬆地獲得就業服務,醫療補助系統也更方便易用。或許最重要的是,他認為這項技術可以幫助「民主政府兌現對公民的承諾」。
“我們計劃與客戶攜手,運用我們的人工智能模型,徹底革新人類活動的各個領域,包括上述領域以及其他數十個領域。這很可能代表著人類歷史上最大的經濟機遇。”
儘管招股說明書一開始充滿樂觀與希望,字裡行間卻透露出 Anthropic 公司焦慮不安的情緒。該公司在一頁又一頁的篇幅中列舉了人工智能對其業務和社會構成的諸多風險。
“人工智能可能被別有用心之人濫用,例如用於發動網路攻擊或設計生物武器。”
至少部分此類情況已經發生。今年夏天,Anthropic、OpenAI 和其他領先的人工智能實驗室接連遭遇網絡安全漏洞,引發了業界關於如何保護先進系統的廣泛討論。
Amodei 和該公司隨後列舉了文件開頭所列舉的所有正面可能性的反面。經濟繁榮往往伴隨著巨大的動盪。
“人工智能帶來的巨大經濟價值可能伴隨著經濟動盪,類似於以往技術帶來的衝擊,但規模更大。”
Anthropic 公司指出,正如民主政府可能因此獲得加大權力一樣,專制政權也可能獲得同樣的加大權力。
Amodei 繼續說:
“專制政府可能利用人工智能建立高科技監控國家,加深鎮壓,並使自身更難被推翻。”
所有 Anthropic 公司的 IPO 說明書都不能缺少 Amodei 最主要的擔憂,即一些人所謂的終極「風險因素」 - 公司必須向投資者披露可能對其公司業務產生不利影響的因素。
“如果開發、部署和運行過程中缺乏適當的保障措施、監督和安全措施,足夠先進的人工智能系統可能會對人類構成災難性甚至生存性的風險。”
簡而言之:Anthropic 公司相信其技術能夠創造前所未有的人類繁榮條件。該公司亦認為它可能導致世界末日。
大多數普通公司在提交上市申請時,通常不會涉及如此重大的哲學問題。但 Anthropic 絕非一間普通公司。
So, Amodei presents his company’s paperwork during
its initial public offering to tell the world that even with its
many risks, A.I. has the potential to bring about untold benefits to humanity. Amodei
and his six co-founders believe that AI is one of the most consequential
technologies in human history. Amodei’s biggest concern is that sufficiently
advanced AI systems, if not operated with appropriate safeguards, oversight,
and security measures, could pose catastrophic or existential risks to
humanity. Apparently, Anthropic believes its technology could bring about
conditions for human flourishing the likes of which have never been seen. The
company also believes it could bring about the end of the world.
Note:
1. DMV (車輛管理局) lines refers to the physical lines
or waiting times people experience at the Department of Motor Vehicles (DMV).
In the United States, the DMV is the government agency responsible for vehicle
registration and driver's licensing. Because almost every driver must visit the
DMV in person for certain tasks, its offices are notorious for long wait times,
slow administrative processes, and frustrating bureaucracy. (Google)
