[v3-1-test] Convert all airflow distributions to be compliant with ASF requirements (#58138)

[github-actions]

According to https://www.apache.org/legal/src-headers.html#faq-binaries
all our released source packages and binaries should have both LICENCE
and NOTICE files - even if we do not have any 3rd-party software embedded.

This PR updates it accross the board and makes sure that all our
distributions contain both LICENCE and NOTICE file and that they
are added as "licence" information to all our distribution packages
when they are built.

This PR also modernizes all our pyproject.toml files with regards
to latest metadata for licenses:

• license-file is an array of glob patterns
• license is s license expression
• the deprecated Trove Classifier is removed

Inspired by #58131
(cherry picked from commit 11fbd84)

Co-authored-by: Jarek Potiuk jarek@potiuk.com

[potiuk]

cc: @ephraimbuddy -> can I still merge it ? This one will make our 3.1.3 to have better licence / notice and while "big" - it has almost no "real" changes for airflow-core or task-sdk (except fixing LICENSE and NOTICE exposing in packages to latest standards) - I wanted to check with your first - I think it has very low risk but it can already give us more "compliance"

[ephraimbuddy]

cc: @ephraimbuddy -> can I still merge it ? This one will make our 3.1.3 to have better licence / notice and while "big" - it has almost no "real" changes for airflow-core or task-sdk (except fixing LICENSE and NOTICE exposing in packages to latest standards) - I wanted to check with your first - I think it has very low risk but it can already give us more "compliance"

Yes. Ok to merge

[potiuk]

He he . As soon as I get it green that is :)

[potiuk]

The mypy issue will be fixed by upgrading to pytest 9 (backporting #58164)