Skip to content

CI Speedup and More Wheels#1044

Merged
tridge merged 3 commits intoArduPilot:masterfrom
robertlong13:pr/ci-speedup
May 30, 2025
Merged

CI Speedup and More Wheels#1044
tridge merged 3 commits intoArduPilot:masterfrom
robertlong13:pr/ci-speedup

Conversation

@robertlong13
Copy link
Contributor

Brought the time from 30m to 8m, which I think we can live with. Also added Linux ARM, Windows, and Mac (x86, ARM, and universal). Funny enough, the bottleneck is still Linux x86. The Linux builds use docker, and the musl 32-bit wheel takes most of the time.

I've set it so that it only builds everything on push to master or release. PRs get only a fraction of the full build, and take about 3 minutes instead of 8. On PRs, I build Linux and Windows, 64-bit only, and for only 3.8 and 3.13 (which I deemed most likely to accidentally break in a PR). I could honestly leave all the python versions and all the OS and just disable 32-bit and it'd likely still be about 3 minutes, but I think I'll keep it the way I have it. We're still building everything after we merge, so we should be quick to catch any regressions. I also added the ability to manually trigger a run in case you see a PR that you think is risky enough to try a full build before merging.

The only wheels we're missing now are Windows ARM, because the Windows ARM runner doesn't come with enough stuff to compile lxml and lxml doesn't supply wheels WinARM. I'll just wait until lxml adds wheels for that, much to the dismay of all 0 people asking me for Windows ARM wheels.

I added concurrency rules so that subsequent PR pushes, or even rapid merging of several PRs, don't bog down CI.

Tested everything pretty thoroughly on my fork before opening.

@khancyr
Copy link
Contributor

khancyr commented May 26, 2025

Nice, I think you can speed up things even more by using some github caching.
We can cache pip dependency and the cibuildwheel cache directory . That would make things faster.
On second step we can look at using ccache to compile with cythonize

Not blocking comments, we can add this on a second step

@tridge
Copy link
Contributor

tridge commented May 30, 2025

@robertlong13 thanks!

@tridge tridge merged commit 51e3bba into ArduPilot:master May 30, 2025
20 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants