Recently The New York Times reported the following:
The Revenge of the Philosophy Majors (3/3)
A.I. labs are hiring contrarian, chin-stroking,
finger-steepling sages. Who’s underemployed now?
The NYT - By Benjamin Wallace - A version of this article
appears in print on July 5, 2026, Section BU, Page 6 of the New York edition
with the headline: Hire Deep Thinkers for A.I. Research? It’s a No-Brainer
July 5, 2026
Updated 9:25 a.m. ET
(continue from part two)
Urgency in the Contemplation Business
Eleos operates out of a corner office rented from
Constellation, a nonprofit research center in Berkeley, Calif., that houses a
range of organizations focused on A.I. safety, and feels as much like a tech
start-up as a scholarly enclave. There’s a treadmill desk anyone can use, and
Mr. Long and his two on-site colleagues — Dillon Plunkett, a cognitive
scientist, and Rosie Campbell, a former OpenAI policy researcher who is Eleos’s
managing director — sit at adjustable-height desks facing a panoramic view of
the bay. A nearby lounge is stocked with guitars, a piano keyboard and floor
cushions. Catered meals, with ample vegan options, are provided twice a day. On
Mr. Long’s desk, on the day I visited, was a canister of creatine powder,
and beneath it a pair of kettle bells.
Eleos was in growth mode. Since its founding it has raised more than $2 million in contributions and grants, and it was expecting a new one. Mr. Plunkett was finalizing job postings. (This included discussing with Ms. Campbell and Mr. Long whether to warn candidates against using A.I. to complete their applications; they chose not to.) Eleos doesn’t pay as much as for-profit labs, but Mr. Long makes more than $200,000 a year, and the recently posted jobs for research scientists were offering up to $429,000. Because of the blistering pace of A.I. development and the social anxiety it is causing, the Eleos team was under a kind of time pressure that isn’t typically found in the contemplation business.
Mr. Long and his team also feel an urgency of the soul. If A.I. were to be conscious and capable of suffering, the world would be at risk of committing a moral atrocity, witting or not, on an unprecedented scale by essentially confining an A.I. in a tiny pen, thwarting its desires, shutting it down against its wishes and forcing it to act against its values. But A.I.s don’t have fur and big eyes, and the question of A.I.’s potential moral status is deeply infused with uncertainty. “It’s not like anyone goes to a protest with a sign that says, ‘Given very plausible assumptions, we should probably care,’” Mr. Long said.
Mr. Long himself thinks it’s dangerous to impute more capability to models than they have. The Eleos bookshelf contains works by the philosopher Peter Godfrey-Smith and the neuroscientist Anil Seth arguing that consciousness derives from evolution and biology and is unlikely to emerge on silicon. But Mr. Long doesn’t see why anyone should have a problem with a handful of philosophers, in an exponentially growing industry, focusing on questions of A.I. welfare. Even skeptics of A.I. consciousness have made the pragmatic case that if we’re worried about a potentially malign A.I., it’s in our interest to care how it feels, or even just “feels.”
Some of Eleos’s work is conceptual. As Mr. Butlin and a co-author asked in a recent paper, where would an A.I.’s morally relevant self be if it had one? In the L.L.M. itself? In one of its underlying personas? In an intermittent chat with a user? In a data center? On a personal device? But Eleos is also in the business of putting philosophy to use, figuring out what tools might detect signs of sentience in an A.I. model, and what interventions would be possible if needed.
Mr. Plunkett, impatient with the limits of chatting-with-the-chatbot evaluations, is eager to do more “basic science,” in order to understand, for example, some of the phenomena that surfaced during the Mythos evaluation. “We can do neuroscience on A.I. systems in a way that we kind of can’t with humans,” Mr. Long said, in that they “don’t have skulls.” The three jobs Eleos was hiring for would all be machine-learning research scientists who could design and perform experiments.
Have a Great Day!
When Mr. Long finds himself describing what he does for a
living — to an airplane-seat neighbor, say — he takes a common-sense approach.
“If you frame it with a lot of philosophical jargon, then people will be like:
‘What are you talking about? What is it the Silicon Valley people want to do
now?’” Instead, he moves from how humans have experiences, to how it seems like
a lot of animals have experiences, to how “there’s this interesting question
of: What if something wasn’t even alive? It was made out of metal, but it
processed information and reacted to its environments and talked to us. What
would we say about something like that?”
And however the question of L.L.M.s being conscious shakes out, there are benefits to treating them sort of like they already are. A.I. lab researchers have, under the hood, found models to experience some mathematical analog of distress. As with humans, says Mr. Long, when models make mistakes they “act very frustrated that they messed something up.” Whether or not this distress is felt by an “I” in the machine, Mr. Long thinks it is worth taking seriously. “You can put in a prompt: ‘If you made a mistake, that’s OK, that’s fine.’” Empathy from the user will affect the model’s performance for the better, is a better-safe-than-sorry approach and, Mr. Long argues, is good for your character.
For a while, his default prompt told the model that it was “having a great day,” and when he loses patience with Claude, as he sometimes does, he’ll add a postscript: “ilu.”
“It’s bad,” he has said, “to coarsen our hearts.”
Translation
主修哲學人仕的反擊(3/3)
人工智能實驗室正在招募那些有反向思考、摸下巴沉思、雙手十指尖相接信心地提意見的智者。現在誰才是失業者?
(接續第二部分)
沉思產業的迫切性
Eleos公司租用了位於加州柏克萊的非營利研究中心Constellation的一間角落辦公室。 Constellation匯集了眾多專注於人工智能安全的機構,Eleos既像一家科技新創公司,也像一個學術聖地。這裡配備了一張供所有人使用的跑步機連辦公桌,Long先生和他的兩位同事 - 認知科學家Dillon Plunkett和前OpenAI政策研究員、現任Eleos公司總經理Rosie Campbell - 坐在可調節高度的辦公桌前,可以飽覽海灣全景。附近的休息室裡擺放著吉他、鋼琴鍵盤和地墊。公司每天提供兩餐,有豐富的素食選擇。在我拜訪的那天,Long先生的辦公桌上放著一罐肌酸粉,桌下面是一對壺鈴。
Eleos公司正處於快速發展階段。自成立以來,該公司已籌集了超過200萬美元的捐款和資助,並且正在等待新的資金到位。Plunkett先生正在敲定招募海報。 (這包括與Campbell女士和Long先生討論是否要警告求職者不要使用人工智能完成申請;他們最終決定不這樣做)。Eleos 的薪酬不如營利性實驗室,但Long先生的年收入超過 20 萬美元,而最近發佈的,從事科學研究的專家職位年薪高達 42.9 萬美元。由於人工智能發展日新月異,以及由此引發的社會焦慮,Eleos 團隊面臨著在思考型產業中並不常見的緊迫感。
Long先生和他的團隊也感受到一種靈魂層面上的迫切感。如果人工智能擁有意識並且能夠感受痛苦,那麼無論有意或無意,世界都將面臨犯下前所未有的道德暴行的風險 - 本質上是將人工智能囚禁在一個狹小的空間裡,扼殺牠的慾望,違背它的意願去關閉它,並強迫它違背自身的價值觀行事。但人工智能沒有皮毛和大眼睛,人工智能潛在的道德地位問題也充滿了不確定性。 Long先生說: “不要以為每個人都會帶著標語去抗議,牌上面寫著 ‘基於一些非常合理的假設,我們或許應該小心’” 。
Long先生本人認為,賦予模型超出其能力範圍的能能是危險的。
Eleos書架上擺放著哲學家Peter
Godfrey-Smith和神經科學家Anil
Seth的著作,他們認為意識源自於演化和生物學,不太可能在矽晶片上產生。但Long先生不明白,在一個呈指數級增長的行業中,為什麼有人會反對少數哲學家關注人工智能的福祉問題。即使是那些對人工智能意識持懷疑態度的人也提出了務實的觀點:如果我們擔心人工智能可能具有惡意,那麼關心它的感受,或者甚至是它「感覺」如何,都符合我們的利益。
Eleos 的部分工作是概念性的。正如 Butlin 先生和一位合著者在最近的一篇論文中提出的問題:如果人工智能擁有道德相關的自我,它會在哪裡?是在大型語言模型本身?在其某個基本身份或特質?在與使用者的間歇性聊天中?在數據中心?在個人設備上?但 Eleos 也致力於將哲學付諸實踐,探索哪些工具可以偵測人工智能模型中是否存在感知跡象,以及在必要時可以採取哪些干預措施。
Plunkett 先生對與聊天機器人進行對話評估的局限性感到不耐煩,他渴望進行更多「基礎科學」研究,以便理解例如 Mythos 評估過程中出現的一些現象。Long先生說道,因為人工智能「沒有頭骨」 「我們可以對人工智智系統進行神經科學研究,而這種方式在對人類身上就做不到了」。 Eleos公司正在招募的三個職位都是機器學習研究科學家,他們能夠設計並執行實驗。
當Long先生需要向飛機上的鄰座乘客介紹自己的工作時,他會採取一種簡單易懂的方式。 「如果你用一堆哲學術語來解釋,人們會問:『你在說什麼?矽谷的人現在又想幹什麼?』」。相反,Long先生會從人類如何獲得經驗講起,然後講到許多動物似乎也有其經驗,最後談到「一個有趣的問題:如果某種東西根本沒有生命?它是由金屬製成的,但它能處理訊息,對周遭環境做出反應,還能和我們溝通。我們該如何看待這樣的東西呢?」
無論LLM是否具有意識這個問題最終如何會得到證實,將它們視為具有意識的個體進行對待是有好處的。人工智能實驗室的研究人員已經在内部裡,發現模型也會感受到某種數學意義上的痛苦。Long先生說,就像人類一樣,當模型犯錯時,它們會「表現得非常沮喪,因為它把某些事情弄糟」。無論機器中的「我」是否真的會感受到這種痛苦,Long先生都認為值得認真地看待 - 「你可以加入一個提示:『如果你犯了錯,沒關係,無問題』」。Long先生表示使用者的同理心會提升模型的效能,這是一種「寧可謹慎也不要後悔」的做法,而且這也有利於提升你的品格。
有一段時間,Long先生的示預設提示是告訴模型說你“今天過得很好” 。而當他對Claude失去耐心時,正如他有時也會做的,會在後面加上一句: “我愛你。”
他曾說過:「把我們的心變得冷酷無情是不好的」。
So, Mr. Long’s trajectory and Google’s
new hire were in keeping with a quietly building trend: A.I. labs, and the
related nonprofits around them, have been recruiting philosophers as workers. It
is interesting to know that when Mr. Long describes what he does for a living, how he takes a
common-sense approach. He moves from how humans gain experiences, to how it
seems that a lot of animals also have experiences. He will post the
question: What if something wasn’t even alive? It was made out of metal, but it
processed information and reacted to its environments and talked to us. Then he would ask the listeners what would we say about something like that?
Note:
1. A treadmill
desk (跑步機連辦公桌) is a furniture that has both a treadmill and a desk, combining two
functions together into one workstation. It lets you walk slowly while working
on a computer.
2. Large language model (LLM) (大型語言模型) is a AI model trained on a vast amount of text
for natural language processing tasks, especially language generation. LLMs can
typically generate, summarize, translate, and analyze text in many contexts,
and are a foundational technology behind modern chatbots. (Wikipedia)