一句话:立场论文分析LLMs对软件工程研究的双面影响,并呼吁社区以人为本地主动治理与规范其使用。
LLMs正在改变软件工程(SE)实践,也可能颠覆SE研究方式。这篇立场论文基于第二届哥本哈根SE人本AI研讨会讨论,用McLuhan媒体定律四元论分析LLMs对SE研究的影响:它通过加速构思与自动化增强研究能力,使部分传统实践过时,重新唤起历史方法的可取之处,并在极端使用时产生反转风险。文章强调人的能动性与监督、可解释性,以维护科学严谨与伦理责任,并呼吁社区主动把握机遇,制定框架与指南缓解风险,确保AI增强未来中的研究严谨性与影响力。
The adoption of Large Language Models (LLMs) is not only transforming software engineering (SE) practice but is also poised to fundamentally disrupt how research is conducted in the field. While perspectives on this transformation range from viewing LLMs as mere productivity tools to considering them revolutionary forces, we argue that the SE research community must proactively engage with and shape the integration of LLMs into research practices, emphasizing human agency in this transformation. As LLMs rapidly become integral to SE research—both as tools that support investigations and as subjects of study—a human-centric perspective is essential. Ensuring human oversight and interpretability is necessary for upholding scientific rigor, fostering ethical responsibility, and driving advancements in the field. Drawing from discussions at the 2nd Copenhagen Symposium on Human-Centered AI in SE, this position paper employs McLuhan's Tetrad of Media Laws to analyze the impact of LLMs on SE research. Through this theoretical lens, we examine how LLMs enhance research capabilities through accelerated ideation and automated processes, make some traditional research practices obsolete, retrieve valuable aspects of historical research approaches, and risk reversal effects when taken to extremes. Our analysis reveals opportunities for innovation and potential pitfalls that require careful consideration. We conclude with a call to action for the SE research community to proactively harness the benefits of LLMs while developing frameworks and guidelines to mitigate their risks, to ensure continued rigor and impact of research in an AI-augmented future.
@inproceedings{paperbot9177,
title = {Get on the Train or be Left on the Station: Using LLMs for Software Engineering Research},
author = {Bianca Trinkenreich and Fabio Calefato and Geir Hanssen and Kelly Blincoe and Marcos Kalinowski and Mauro Pezzè and Paolo Tell and Margaret-Anne Storey},
booktitle = {FSE},
year = {2025},
doi = {10.1145/3696630.3731666}
}