How GitHub Projects Are Adopting Agentic Coding Tools: Early Evidence from arXiv

Introduction

Agentic coding tools are moving beyond autocomplete and chat-based assistance. Some can now generate changes and submit pull requests directly to software projects, creating a new kind of collaboration between developers and software agents. But how are these tools actually being adopted inside real open-source projects?

The arXiv paper “Early Adoption of Agentic Coding Tools by GitHub Projects” shifts the focus from individual pull request outcomes to project-level behavior. The authors examine 25,264 agentic PRs across 2,361 popular GitHub repositories over a three-month observation window, asking how widely these tools are used, how productive they appear at the repository level, and how humans supervise agent-generated contributions.

Key findings

• Adoption is broad but shallow for most projects. The median repository generated only one to two agentic PRs during the three-month period. This suggests that while agentic coding has entered the open-source ecosystem, most projects are still experimenting rather than relying on it as a regular development channel.

• Small repositories appear more active. Projects with one to five contributors showed higher participation ratios and higher average levels of agentic PR activity than medium-sized and large projects. One possible reading is that smaller teams may be more willing to use automation to compensate for limited maintainer capacity, while larger projects may face more complex governance and review processes.

• Productivity varies sharply across projects. A small number of repositories exceeded an industry-reported estimate of 36 PRs per participant over the three-month period, but most remained below that level. The finding cautions against assuming that agentic coding tools automatically translate into large productivity gains everywhere.

• Single-human oversight dominates. The most common collaboration pattern involved one developer reviewing or modifying an agent’s contribution. Multi-human collaboration around agentic PRs was less common. In practice, the agent may create the initial contribution, but a human maintainer still plays a central gatekeeping role.

Why it matters

The study’s main contribution is not simply that agents can submit code. It shows that adoption depends on social and organizational workflows: who reviews the PR, how quality is checked, whether maintainers trust the output, and whether the project has a process for handling agent-generated work.

For engineering teams, the takeaway is that agentic coding should not be evaluated only by the number of generated PRs. A more useful question is whether those PRs reduce maintainer workload, fit existing review norms, and create a sustainable path from generated code to accepted code. For tool builders, the findings suggest that better code generation is only part of the challenge. Support for review, accountability, traceability, and collaboration may be just as important.

Because the paper captures an early stage of adoption, its results should be read as a snapshot rather than a final verdict. Still, the evidence is clear: agentic coding tools are beginning to reshape open-source workflows, but they have not removed the need for human oversight. At least for now, the dominant pattern is not autonomous software development, but supervised contribution by software agents.

Source: arXiv