feat: add ability to optionally disable internal HTTP send and receive spans

[omgitsaheadcrab]

Description

This PR addresses the issue where it is not possible to disable internal HTTP send and receive spans. For many members of the community these do not provide any value and only add noise to the traces. Other mechanisms of filtering them out, such as wrapping span processors or exporters are clunky.

Providing arguments that allow users to disable one or both of these would be of great benefit.

Fixes #831 and addresses user comments in the now closed PR #815

Type of change

Please delete options that are not relevant.

• Bug fix (non-breaking change which fixes an issue)
• New feature (non-breaking change which adds functionality)
• Breaking change (fix or feature that would cause existing functionality to not work as expected)
• This change requires a documentation update

How Has This Been Tested?

Please describe the tests that you ran to verify your changes. Provide instructions so we can reproduce. Please also list any relevant details for your test configuration

• TestAsgiApplication.test_exclude_internal_spans added to test logic
• Integration tests performed manually using fastapi and configuring the instrumentor.

Does This PR Require a Core Repo Change?

• Yes. - Link to PR:
• No.

Checklist:

See contributing.md for styleguide, changelog guidelines, and more.

• Followed the style guidelines of this project
• Changelogs have been updated
• Unit tests have been added
• Documentation has been updated

[linux-foundation-easycla]

The committers listed above are authorized under a signed CLA.

• ✅ login: omgitsaheadcrab / name: Tobias Backer Dirks (5b6ea8e, 2073d2a, b1e445e, 9daafa7, 52bd660, 15b4d60, b6faf30, 5b7759a, 90943e9, 906721b, 839dbf9, 0741bc6, a5bfd43, ddfb5e6, c074c62, 85648ee, 09a2ef4, f312d4a, 9c32d80, be1ebbf, 6909756, 3fc263e, 7ec823d)
• ✅ login: lzchen / name: Leighton Chen (1cc0495, f7b2a51, 59ef359, 6b2490a, 3f36b70)

[omgitsaheadcrab]

tox -e lint didn't give the same result as tox -elint-instrumentation-asgi.. I've refactored it by extracting the send_span and server_span logic to helpers rather than just disabling the pylint rule. Looks cleaner now too.

[xrmx]

Next time please better shut up pylint warnings on methods size and do the separation in helpers separately to ease review

[lzchen]

@omgitsaheadcrab

Changes look good to us! I think you have a few tests that are failing as a result of your changes.

[omgitsaheadcrab]

Ugh! I ran it with assert locally and it worked, didn't check the self.assertTrue suggestion. I'm away from home on leave now so I'll see if I can fix whatever broke from another pc 🤔

[omgitsaheadcrab]

@xrmx @lzchen I'm back from annual leave now and I've updated the test. Apologies for letting this sit so long!