AI研究代理收窄科學探索範圍

摘要

現在，人工智慧研究代理能夠產生研究構想、設計實驗、執行程式碼，並撰寫論文，從而提升了進行大規模人工智慧輔助科學發現的可能性。許多現有的代理框架明確鼓勵產生新穎且具高影響力的構想。然而，目前仍不清楚人工智慧輔助的構想生成，究竟會拓展科學探索的範疇，還是主要集中於現有研究的周邊。我們將人工智慧研究代理視為科學搜尋系統來進行研究。利用四種人工智慧研究代理框架與六種大型語言模型，我們根據人工智慧與機器學習領域中，由引用關係所定義的研究領域，從共享的種子文獻中產生了37,802個科學構想。接著，我們將這些人工智慧生成的構想，與相同研究領域的人類撰寫論文、從相同種子文獻衍生出的後續人類研究，以及種子文獻本身進行比較。在各項實驗中，出現了四個一致的現象。第一，人工智慧生成的構想比同一研究領域的人類撰寫論文明顯更加集中。第二，與後續的人類研究成果相比，人工智慧生成的構想依然更接近其起始文獻。第三，與人工智慧生成構想最相似的論文，後續獲得的引用數往往較低。第四，當人工智慧生成的構想與既有研究不同時，其差異主要源於對現有技術方法的重新組合，而非引入全新的研究問題。總體而言，目前的人工智慧研究代理似乎更擅長於進行局部的闡述與延伸，而非拓展科學探索的視野。

English

AI research agents can now generate research ideas, design experiments, run code, and draft papers, raising the possibility of large-scale AI-assisted scientific discovery. Many current agent frameworks explicitly encourage the generation of novel and high-impact ideas. Yet it remains unclear whether AI-assisted ideation broadens scientific exploration or mainly concentrates around existing work. We study AI research agents as scientific search systems. Using four AI research-agent frameworks and six large language models, we generate 37,802 scientific ideas from shared seed literature across citation-defined research areas in AI and machine learning. We then compare the resulting AI ideas against human-authored papers from the same research areas, follow-on human research emerging from the same seed literature, and the seed literature itself. Across experiments, four consistent patterns emerge. First, AI-generated ideas are substantially more concentrated than human-authored papers from the same research areas. Second, AI-generated ideas remain much closer to their starting literature than later human follow-on work does. Third, papers most similar to AI-generated ideas tend to receive lower subsequent citations. Fourth, when AI-generated ideas differ from prior work, the differences arise primarily from recombining existing technical methods rather than introducing fundamentally new research questions. Overall, current AI research agents appear better suited to local elaboration than to broadening scientific exploration.