To main content

Get on the Train or be Left on the Station: Using LLMs for Software Engineering Research

Abstract

The adoption of Large Language Models (LLMs) is not only transforming software engineering (SE) practice but is also poised to fundamentally disrupt how research is conducted in the field. While perspectives on this transformation range from viewing LLMs as mere productivity tools to considering them revolutionary forces, we argue that the SE research community must proactively engage with and shape the integration of LLMs into research practices, emphasizing human agency in this transformation. As LLMs rapidly become integral to SE research—both as tools that support investigations and as subjects of study—a human-centric perspective is essential. Ensuring human oversight and interpretability is necessary for upholding scientific rigor, fostering ethical responsibility, and driving advancements in the field. Drawing from discussions at the 2nd Copenhagen Symposium on Human-Centered AI in SE, this position paper employs McLuhan's Tetrad of Media Laws to analyze the impact of LLMs on SE research. Through this theoretical lens, we examine how LLMs enhance research capabilities through accelerated ideation and automated processes, make some traditional research practices obsolete, retrieve valuable aspects of historical research approaches, and risk reversal effects when taken to extremes. Our analysis reveals opportunities for innovation and potential pitfalls that require careful consideration. We conclude with a call to action for the SE research community to proactively harness the benefits of LLMs while developing frameworks and guidelines to mitigate their risks, to ensure continued rigor and impact of research in an AI-augmented future.
Read the publication

Category

Academic chapter

Language

English

Author(s)

  • Bianca Trinkenreich
  • Fabio Calefato
  • Geir Kjetil Hanssen
  • Kelly Blincoe
  • Marcos Kalinowski
  • Mauro Pezzè
  • Paolo Tell
  • Margaret-Anne Storey

Affiliation

  • SINTEF Digital / Software Engineering, Safety and Security
  • IT University of Copenhagen
  • University of Bari Aldo Moro
  • University of Lugano
  • University of Victoria
  • Colorado State University
  • Pontifical Catholic University of Rio de Janeiro
  • The University of Auckland

Year

2025

Publisher

Association for Computing Machinery (ACM)

Book

FSE Companion '25: Proceedings of the 33rd ACM International Conference on the Foundations of Software Engineering

ISBN

9798400712760

Page(s)

1503 - 1507

View this publication at Norwegian Research Information Repository