Embargo Until 01/Mar/2028 - Author preprint (802.7 kB)
40 pages. Preprint of manuscript accepted in Elsevier Journal of Systems and Software. Exact publication details will be provided upon official publication.
[en] CI/CD practices play a significant role during collaborative software development by automating time-consuming and repetitive tasks such as testing, building, quality checking, dependency and security management. GitHub Actions, the CI/CD tool integrated into GitHub, allows repository maintainers to automate development workflows. We conducted a mixed methods analysis of GitHub Actions workflow changes over time. Through a preliminary qualitative analysis of 439 modified workflow files we identified seven types of conceptual changes to workflows. Next, we performed a quantitative analysis over 49K+ GitHub repositories totaling 267K+ workflow change histories and 3.4M+ workflow file versions from November 2019 to August 2025. This analysis revealed that repositories contain a median of three workflow files, and 7.3% of all workflow files are being changed every week. The changes made to workflows tend to be small, with about three-quarters containing only a single change. The large majority of the observed changes have to do with task configuration and task specification in workflow jobs. We did not find any conclusive evidence of the effect of LLM coding tools or other major technological changes on workflow creation and workflow maintenance frequency. Our findings highlight the need for improved tooling to support fine-grained maintenance tasks, such as a broader adoption of dependency management and AI-based support for ensuring and sustaining workflow security and quality.
Disciplines :
Computer science
Author, co-author :
Rostami Mazrae, Pooya ; Université de Mons - UMONS > Faculté des Sciences > Service de Génie Logiciel
Decan, Alexandre ; Université de Mons - UMONS > Faculté des Sciences > Service de Génie Logiciel
Mens, Tom ; Université de Mons - UMONS > Faculté des Sciences > Service de Génie Logiciel
Wessel, Mairieli; Radboud Universiteit Nijmegen > Faculty of Science > Institute for Computing and Information Sciences (iCIS)
Language :
English
Title :
An Empirical Study of the Evolution of GitHub Actions Workflows
R300 - Institut de Recherche en Technologies de l'Information et Sciences de l'Informatique
Funders :
F.R.S.-FNRS - Fonds de la Recherche Scientifique Direction générale de l'Enseignement non obligatoire et de la Recherche scientifique
Funding number :
J.0147.24; T.0149.22; F.4515.23; ARC-21/25 UMONS3 Action de Recherche Concertée financée par le Ministère de la Communauté française
Funding text :
This work is supported by the ARC-21/25 UMONS3 Action de Recherche Concertée financée par le Ministère de la Communauté française - Direction générale de l’Enseignement non obligatoire et de la Recherche scientifique, and by the Fonds de la Recherche Scientifique - FNRS under grant numbers T.0149.22, F.4515.23 and J.0147.24.