Recently The New York Times reported the following:
Some Scientists Have ‘Magic Hands’ in the Lab. This A.I.
Is Learning Why. (2/2)
Even the most adept researchers may not know exactly what
they do to get successful results. An A.I. model is trying to figure it out by
watching every move.
The NYT - By Carl Zimmer
Aug. 27, 2026
(continue)
Renee Wegrzyn, a co-founder of Transfyr, became keenly aware
of this gap while doing research as a postdoctoral researcher. She jotted down
records of her experiments on proteins in a lab notebook, but it captured only
a fraction of her efforts.
When Dr. Wegrzyn published her results, she had to distill her records even further. “I did a postdoc that was three years long, and then it got summed up in a three-page paper,” she said.
Missing from those notes and reports were all the little decisions Dr. Wegrzyn had made while performing her research.
“All of those details could matter, but we just don’t know if they matter,” said Brian Nosek, an expert on replication at the University of Virginia who is not involved in Transfyr.
When a replicated study fails to produce the original results, that may mean the original study was wrong. Or maybe it was right, and the replicating scientists made an unwitting blunder. It can be hard for teams of scientists to agree on what happened.
In 1993, for example, the psychologist Frances Rauscher and her colleagues reported that people who listen to Mozart get a temporary boost on reasoning tests. The buzz around the so-called Mozart effect led other researchers to run experiments of their own.
Many of them couldn’t find any significant benefit, but Dr. Rauscher brushed off these failures. The other scientists didn’t find the Mozart effect because they weren’t good enough at running experiments, she said — they were not good scientific chefs.
The search for the Mozart effect went on for years. In the end, other scientists found little evidence that it exists.
Conflicts like these led some scientists to search for new ways to communicate tacit knowledge. In 2006, the biologist Moshe Pritsker created a journal called JoVE, which published videos of scientists carrying out complex experiments.
In 2014, the biologist Lenny Teytelman created a place where scientists could share their protocols and talk about them. Researchers use the website, called Protocols.io, to help train new members of their labs when the seasoned scientists with magic hands have moved on.
With Transfyr, Dr. Wegrzyn and Ms. Wagner are building a system that can slurp up enormous amounts of data about what happens in a lab, in the form of video, audio and sensor logs from lab equipment. Transfyr even tracks the source of supplies, down to the lot numbers of glove boxes.
(Why? “Maybe there’s a fume coming off the glove that is changing your experiment,” Ms. Wagner said.)
Dr. Nosek said that this new approach might reveal some secrets about why experiments succeed or fail. “What I really like about them is they’re going gangbusters into trying to unpack every detail,” he said. “It makes a lot of sense to go all in, and then figure out what actually matters.”
The company feeds its digital record of experiments to computers that have been trained to recognize the equipment used in biochemistry experiments. Artificial intelligence systems track the equipment, along with the hands of scientists, and decipher each action.
This analysis has revealed that lab workers are performing the same experiment in many different ways. “The variation we see even among well-trained scientists is pretty jaw-dropping,” Ms. Wagner said.
Sometimes those variations matter.
Recently, Transfyr hosted technicians from Dr. Livny’s lab, to watch them extract RNA from cells. Charlie Low, famous for her magic hands, was unwittingly doing a key step wrong, letting chemicals react for 120 seconds instead of 90 seconds.
“I didn’t realize that was even happening,” Ms. Low said. The mistake happened because she turned her timer on after starting the chemical reaction, not before. But it turns out that the extra time from that mistake improved the experiment.
In another trial, Transfyr has found that a protocol that takes six hours for one researcher may take eight hours for another. “It’s not a hard thing to see,” Ms. Wagner said. “But there’s no way to capture it at scale manually.”
Transfyr has signed up a diagnostics company and other clients who want the software to track their research. Ms. Wagner said that ultimately, it might be possible for the system not just to uncover mistakes but to document unexpected breakthroughs.
Rather than sifting notebooks for clues, the system can look back at every second of the work while querying A.I. about unusual things the workers did without realizing it.
Dr. Nosek said that Transfyr would have to present detailed results to prove that this system really does make science better. “Take 50 labs, track half the experiments with this stuff and don’t track the other half — then look for differences in progress,” he suggested.
Harry Collins, a sociologist at Cardiff University who has studied tacit knowledge for over 50 years, said he was optimistic about the effort because it was focused on molecular biology — a field that has matured to the point that many of its fundamental mysteries have been worked out.
But he was skeptical that Transfyr’s approach would reveal much in fields where scientists agree on far less, even about which experiments will reveal something important.
“You might be lucky now and again, but it’s not a silver bullet for scientific problems,” Dr. Collins said.
Translation
有些科學家在實驗室裡擁有「魔術手」。人工智能正在學習其中的奧秘。
(2/2)
即使是最熟練的研究人員,也可能不完全清楚自己是如何取得成功的。一款人工智能模型正試圖透過觀察他們的每一個動作來找出答案
(繼續)
Transfyr 的聯合創始人Renee
Wegrzyn在擔任博士後研究員時,敏銳地意識到了這一資訊缺口。她將自己對蛋白質的實驗記錄在實驗筆記本中,但這只記錄了她工作的一小部分。
當Wegrzyn博士發表她的研究成果時,她不得不進一步精簡記錄。她說: 「我做了三年的博士後研究,最後卻被總結成了一篇三頁的文件」。
這些筆記和報告中缺失了Wegrzyn博士在研究過程中所做的所有細微決定。
並未參與Transfyr計劃的維吉尼亞大學的重複性研究專家Brian Nosek說道:「所有這些細節都有機會很重要,但我們並不能確定它們是否真的這樣重要」。
當一項再次重複研究未能得出與原始研究相同的結果時,這可能意味著原始研究是錯誤的。或者,原始研究本身是正確的,只是重複研究的科學家們無意間犯了一個錯誤。科學家團隊很難就究竟發生了什麼事達成一致意見。
例如,1993年,心理學家Frances
Rauscher及其同事報告稱,聽莫札特音樂的人在推理測驗中的表現會暫時提升。圍繞所謂「莫札特效應」的熱議促使其他研究人員進行了自己的實驗。
他們中的許多人未能發現任何顯著的益處,但Rauscher博士對這些失敗不以為意。她說,其他科學家之所以沒有發現“莫札特效應”,是因為他們不夠擅長進行實驗 - 他們不是優秀的科學廚師。
對「莫札特效應」的探索持續了數年。最終,其他科學家幾乎沒有發現任何證據表明它存在。
諸如此類的衝突促使一些科學家尋找新的方式來交流融會知識。 2006年,生物學家Moshe Pritsker創辦了名為JoVE的期刊,該期刊發表了科學家們進行複雜實驗的影片。
2014年,生物學家Lenny Teytelman創建了一個平台,讓科學家分享和討論他們的實驗方案。研究人員利用這個名為Protocols.io的網站,在有魔術手的經驗豐富科學家離開後,幫助訓練實驗室的新成員。
連同Transfyr,Wegrzyn博士和Wagner女士正在開發一個系統,該系統能夠收集實驗室中發生的海量數據,包括視頻、音頻以及來自實驗室設備的傳感器日誌。 Transfyr甚至可以追蹤耗材的來源,精確到手套的装箱批號。
(為什麼?Wagner女士說:「也許是手套散發出的氣味影響了你的實驗」。)
Nosek博士表示,這種新方法或許能揭示實驗成敗的一些秘密。 他說:「我真正欣賞的是,他們正如火如荼地探究每一個細節」;「全力以赴是很有意義,之後找出什麼是真正重要的」。
該公司將實驗的電子記錄輸入電腦,這些電腦經過訓練,能夠識別生物化學實驗中使用的設備。人工智能系統會追蹤這些設備以及科學家的操作,並解讀每一個動作。
這項分析表明,實驗室工作人員會以許多不同的方式進行相同的實驗。 Wagner女士說: 「即使是訓練有素的科學家之間,我們也看到了令人震驚的差異」。
有時,這些差異至關重要。
最近,Transfyr公司接待了Livny博士實驗室的技術人員,讓他們觀摩從細胞中提取RNA的過程。以巧手聞名的Charlie Low無意中犯了一個關鍵錯誤,她讓化學反應持續了120秒,而不是90秒。
Low女士說: 「我根本沒意識到這一點」。這個錯誤是因為她在化學反應開始後才打開計時器,而不是之前。但結果證明,這個錯誤帶來的額外時間反而改善了實驗結果。
在另一項試驗中,Transfyr發現,一個研究人員需要6個小時才能完成的實驗方案,在另一個研究人員可能需要8個小時。 Wagner女士說: “這是很容易理解” , “但人手地大規模捕捉這種差異是不可能的。”
Transfyr已經與一家診斷公司和其他客戶簽約,希望利用該軟件追蹤他們的研究。Wagner女士表示,最終,該系統不僅能夠發現錯誤,還能記錄意想不到的突破。
系統無需翻閱筆記本尋找線索,而是可以回顧實驗的每一秒,並可向人工智能系統查詢關於做實驗的人在不知不覺中做出的不尋常的事情。
Nosek博士表示,Transfyr公司必須提供詳細的實驗結果,以證明這套系統確實能促進科學發展。他建議道: “選取50個實驗室,用這套系統追踪一半的實驗,另一半不追踪 - 然後觀察兩組實驗進展的差異。”
Cardiff大學的社會學家Harry Collins研究融會知識已有50餘年,他表示對這項研究持樂觀態度,因為它專注於分子生物學 - 一個發展成熟的領域,許多基本奧秘都已被解開。
但他懷疑Transfyr的方法能否在其他領域取得突破性進展,因為科學家們對許多問題的共識都遠不如分子生物學,甚至連哪些實驗能夠揭示重要資訊都難以達成共識。
Collins博士說: 「你或許偶爾會走運,但這並非解決科學問題的靈丹妙藥」。
So, failure to repeat an experiment can take
many forms. Chances are that a biotech company creates a promising new drug;
when it starts with large-scale production, suddenly it just doesn’t work. When
scientists carry out experiments, they keep careful records, but when other
researchers use that information to repeat the experiment, scientists may discover
that essential knowledge has not been written down. Scientists have generally come to
agree that tacit knowledge is an essential part of research. Now some
scientists are building a system that can generate enormous amounts of data
about what happens in a lab when an experiment is done. It is hoped that ultimately
it may be possible for the system not just to uncover mistakes but to document
unexpected breakthroughs.