3.21.0 release tracker

[shonfeder]

Known blockers

• Feature gate readonly perms on promoted files #12746
  • Make promoted files read-only #12519 needs to be reverted or feature gated behind a dune version
  • We reverted this in Revert "Make promoted files read-only" #12808
• [OxCaml] Parameterized libraries: library instantiation #12088
  • We would like to complete at least the last substantive bit of work from Support for Parameterized Libraries:
• Copyfile stubs fail on alpine linux #12896
  • fix(copyfile): inline linux/version.h #12901
• breakage with dune format-dune-file and opam-dune-lint #12897
  • This will need an upper bound placed on dune for the opam repo package, then followup fixes for integration with the the package: Add upper bound of dune 3.21 to opam-dune-lint opam-repository#29213
  • followup fix fix: add lang version to dune-project before formatting ocurrent/opam-dune-lint#74
• Comment being stripped unnecessarily in cram test #12899
  • fix(cram): lexing of single space comment after output #12903
• dune hangs in mdx tests waiting for _build/default/_build/.rpc/dune #12900
  • This is reported as being present already in dune 3.20.2. We want to fix it ASAP, of course, but it is not a regression introduced in the current trunk, so it will get triaged as a normal bug.
  • (It is also a unusual edge condition).
• Nesting of INSIDE_DUNE and build concurrency #12737
  • OxCaml will need to update their opam file to use a released dune, so it would be good to get this fix for the concurrency issue with package management in.
  • We agreed in the dune-dev meeting today that we would not block on this, but target the fix for the next release.
• build broken on FreeBSD #12927
  • fix FreeBSD build #12926
• build broken on OpenBSD #13070
  • fix chore: bump ocaml-lmdb #13074
  • this was not introduced since the last release, and is not a blocking problem from mainstream use of stable dune functionality. It is not a blocking fix needed for the release.
• fs-io and top-closure packages fail to install from opam using with-tests #12947
  • fix: add copy rules for opam templates of fs-io and top-closure #12954
• Cram lexer crashes on >> in continuations
  • repro test(cram): show cram_lexer crash on >> characters #12963
  • fix fix(cram): allow >> in continuations #12969
  • cherry pick into release branch
• mariadb regression modules of library using ctypes without (modules) field are incorrectly validated #13001
  • introduced in fix(ctypes): mismatch between modules field and ctypes stanza #12124
  • repro test: ctypes modules field incorrectly validated #13000
  • fix Revert "fix(ctypes): add proper user message for missing modules" #13123
  • cherry pick into release branch
• Revert copyfile change from 804fa3f1ae043310ec574ce0f44d36c79a13c545 #13069
  • portable copyfile on macos was removed in refactor: remove the copy file impl config #11966
  • Users on older macos report issues since there is no alternative 3.20.2 build error: Error: posix_spawn(): Exec format error #12576
  • We don't try to support older macos versions, but in this case the patch is pretty simple so we might as well allow it.
  • cherrypick
• Identify regressions: the current release candidate branch has ~2000 more revedeps failures than the last one. Meaning something pervasive has been broken. Diagnoses and fixes are needed.

Preparation

• Run mirage tests: https://github.com/ocaml/dune/actions/runs/19950862217
• [new release] dune (17 packages) (3.21.0~alpha2) opam-repository#29042
  • regressions detected
• [new release] dune (17 packages) (3.21.0~alpha3) opam-repository#29070
  • regressions detected
• [new release] dune (17 packages) (3.21.0~alpha4) opam-repository#29096
• [new release] dune (17 packages) (3.21.0~alpha5) opam-repository#29189

Release

• Update dune changelog to 3.21.0 on 3.21 branch 832d238
• Open then pull request on opam-repository: [new release] dune (17 packages) (3.21.0) opam-repository#29216
• Triage (ensure it does not break anything)
• Update nix-overlays with the new version [link to nix-overlays PRs]

Post-release

• Merge dune changelog in main: [3.21] prepare 3.21.0~alpha3 release #12920
• Update ocaml.org changelog: Announce release of Dune 3.21 ocaml.org#3453
• Write a post about the release on Discuss: https://discuss.ocaml.org/t/ann-dune-3-21-0/17700
• Store the revdeps error file in the logs
• Create a next release milestone
• Increase lang dune number Bump dune to use 3.22 #13089

Last stage

• Close tracking issue