collab.dev
SWE-agent

Collaboration Metrics for SWE-agent/SWE-agent

Newly Added

SWE-agent takes a GitHub issue and tries to automatically fix it, using your LM of choice. It can also be employed for offensive cybersecurity or competitive coding challenges. [NeurIPS 2024]

Feedback Compare

Contributor Distribution

Core Team PRs
Percentage of PRs created by the core team
64.0%
Community PRs
Percentage of PRs created by the community
31.0%
Bot PRs
Percentage of PRs created by bots
5.0%
Distribution of pull requests by the author's role. Core team includes all admins, members, and collaborators.

Review-Merge Coverage

Review-Merge Rate
Percentage of merged PRs that received reviews
36.0%

Review Coverage

Percentage of pull requests that received reviews before being merged.

Merge Time

Overall Median Merge Time
Median time from PR creation to merge
3.8 hours
Distribution of time taken for pull requests to merge from creation.

Request Approval Time

Overall Median Approval Time
Median time between review request and approval
58.7 minutes

PR Approval Time by Size

Median time between review request and approval for pull requests by size. Only pull requests with requested reviews are included.

Bot Activity

Bot Activity
Percentage of repository events performed by bots
10.0%
Unique Bots
Number of unique bots active in this repository
4
Breakdown of the types of bot activity to help understand the nature of automation and AI usage.

Review Funnel

Review Rate
Percentage of PRs that received reviews
36.0%
Approval Rate
Percentage of reviewed PRs that were approved
61.1%
Progression of pull requests from creation through review to approval.

Review Turnaround

Turnaround Time
Median time to first review
1.2 days
Reviewed in an Hour
PRs that received a review within 1 hour
16.7%

Review Turnaround Distribution

Time required to receive the first review on pull requests. If no review request exists, measures from pull request creation.

Review Wait Time

Overall Median Wait Time
Median overall wait time per PR
0 seconds
Wait time distribution among pull request stages to help identify bottlenecks and improve collaboration.