Skip to content

Add Initial Support for Instrumenting OpenAI Python Library - Chat Completion Create#2759

Merged
lzchen merged 53 commits intoopen-telemetry:mainfrom
Scale3-Labs:openai-opentelemetry
Oct 22, 2024
Merged

Add Initial Support for Instrumenting OpenAI Python Library - Chat Completion Create#2759
lzchen merged 53 commits intoopen-telemetry:mainfrom
Scale3-Labs:openai-opentelemetry

Conversation

@karthikscale3
Copy link
Contributor

@karthikscale3 karthikscale3 commented Jul 31, 2024 •
edited
Loading

Description

This PR adds support for tracing the official python openai library.

This pull request introduces initial support for instrumenting the OpenAI Python library, specifically targeting the chat.completion.create method. This implementation aligns with the GenAI semantic conventions.

Fixes #1796

Type of change

Please delete options that are not relevant.

  • Bug fix (non-breaking change which fixes an issue)
  • New feature (non-breaking change which adds functionality)
  • Breaking change (fix or feature that would cause existing functionality to not work as expected)
  • This change requires a documentation update

How Has This Been Tested?

This is a work in progress PR at the moment and I plan to add unit tests and update this space.

Does This PR Require a Core Repo Change?

  • Yes. - Link to PR:
  • No.

Checklist:

See contributing.md for styleguide, changelog guidelines, and more.

  • Followed the style guidelines of this project
  • Changelogs have been updated
  • Unit tests have been added
  • Documentation has been updated

@karthikscale3 karthikscale3 marked this pull request as draft July 31, 2024 07:15
xrmx
xrmx reviewed Jul 31, 2024
View reviewed changes
Copy link
Contributor

@xrmx xrmx left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Added a first round of comments, thanks!

xrmx
xrmx reviewed Jul 31, 2024
View reviewed changes
@linux-foundation-easycla
Copy link

linux-foundation-easycla bot commented Aug 7, 2024 •
edited
Loading

CLA Signed

The committers listed above are authorized under a signed CLA.

lmolkova
lmolkova reviewed Aug 8, 2024
View reviewed changes
lmolkova
lmolkova reviewed Aug 8, 2024
View reviewed changes
Copy link
Member

@lmolkova lmolkova left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Great start, thanks a lot for doing this!

@lmolkova lmolkova mentioned this pull request Aug 16, 2024
Merged
1 task
xrmx
xrmx reviewed Aug 19, 2024
View reviewed changes
xrmx
xrmx reviewed Aug 19, 2024
View reviewed changes
lmolkova pushed a commit to open-telemetry/opentelemetry-specification that referenced this pull request Aug 28, 2024
@arminru
Update instrumentation library naming guidance to avoid conflicts bet…
6672dbc 
…ween external and otel instrumentations (#4187)

Some package managers (PyPi) don't provide means to reserve namespaces
for projects. We also have a number of **external** instrumentation
libraries in python that follow current guidance and use
`opentelemetry-instrumentation-{component}` naming pattern.

These libraries are hard to distinguish from otel-authored ones. Also,
when someone (legitimately following existing guidance) creates an
external instrumentation package like this, it blocks our ability to
have OTel-authored instrumentation with this 'good' name.

See
open-telemetry/opentelemetry-python-contrib#2759 (comment)
for real-life example.

## Changes

This PR changes the recommendation to:
- otel authored instrumentation should use
`opentelemetry-instrumentation-*` pattern
- external instrumentation should not use this pattern and should prefix
lib name with their company/project/etc name

* ~~[ ] Related issues #~~
* ~~[ ] Related [OTEP(s)](https://github.com/open-telemetry/oteps) #~~
* ~~[ ] Links to the prototypes (when adding or changing features)~~
* [x]
[`CHANGELOG.md`](https://github.com/open-telemetry/opentelemetry-specification/blob/main/CHANGELOG.md)
file updated for non-trivial changes
* ~~[ ]
[`spec-compliance-matrix.md`](https://github.com/open-telemetry/opentelemetry-specification/blob/main/spec-compliance-matrix.md)
updated if necessary~~

---------

Co-authored-by: Armin Ruech <7052238+arminru@users.noreply.github.com>
@lzchen lzchen added the gen-ai Related to generative AI label Aug 28, 2024
@alizenhom
Copy link
Contributor

alizenhom commented Oct 19, 2024

@lzchen addressed all of the above comments

xrmx
xrmx requested changes Oct 21, 2024
View reviewed changes
lzchen
lzchen approved these changes Oct 21, 2024
View reviewed changes
Copy link
Contributor

@lzchen lzchen left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@karthikscale3 @alizenhom

Great job on this! LGTM

@karthikscale3
Copy link
Contributor Author

karthikscale3 commented Oct 21, 2024

@karthikscale3 @alizenhom

Great job on this! LGTM

Thanks for the quick reviews @lzchen !

@karthikscale3 karthikscale3 reopened this Oct 21, 2024
@karthikscale3
Copy link
Contributor Author

karthikscale3 commented Oct 22, 2024 •
edited
Loading

@lzchen / @xrmx - Thanks again for all your reviews. If everything looks good, do you mind merging the PR? We don't seem to have the access to merge it.

@lzchen lzchen merged commit beed0aa into open-telemetry:main Oct 22, 2024
carlosalberto pushed a commit to carlosalberto/opentelemetry-specification that referenced this pull request Oct 31, 2024
@arminru
Update instrumentation library naming guidance to avoid conflicts bet…
cb8e044 
…ween external and otel instrumentations (open-telemetry#4187)

Some package managers (PyPi) don't provide means to reserve namespaces
for projects. We also have a number of **external** instrumentation
libraries in python that follow current guidance and use
`opentelemetry-instrumentation-{component}` naming pattern.

These libraries are hard to distinguish from otel-authored ones. Also,
when someone (legitimately following existing guidance) creates an
external instrumentation package like this, it blocks our ability to
have OTel-authored instrumentation with this 'good' name.

See
open-telemetry/opentelemetry-python-contrib#2759 (comment)
for real-life example.

## Changes

This PR changes the recommendation to:
- otel authored instrumentation should use
`opentelemetry-instrumentation-*` pattern
- external instrumentation should not use this pattern and should prefix
lib name with their company/project/etc name

* ~~[ ] Related issues #~~
* ~~[ ] Related [OTEP(s)](https://github.com/open-telemetry/oteps) #~~
* ~~[ ] Links to the prototypes (when adding or changing features)~~
* [x]
[`CHANGELOG.md`](https://github.com/open-telemetry/opentelemetry-specification/blob/main/CHANGELOG.md)
file updated for non-trivial changes
* ~~[ ]
[`spec-compliance-matrix.md`](https://github.com/open-telemetry/opentelemetry-specification/blob/main/spec-compliance-matrix.md)
updated if necessary~~

---------

Co-authored-by: Armin Ruech <7052238+arminru@users.noreply.github.com>
@dasiths
Copy link

dasiths commented Nov 2, 2024

Thank for the contribution. When is this planned for release?

@dasiths dasiths mentioned this pull request Nov 2, 2024
Merged
@karthikscale3
Copy link
Contributor Author

karthikscale3 commented Nov 4, 2024

Thank for the contribution. When is this planned for release?

@dasiths - We are planning to release it soon (likely later this week). cc @lmolkova

@jsburckhardt
Copy link

jsburckhardt commented Nov 7, 2024

Thank for the contribution. When is this planned for release?

@dasiths - We are planning to release it soon (likely later this week). cc @lmolkova

Saw it got released yesterday in v0.49b0 - but still not in pypi :(

@lmolkova
Copy link
Member

lmolkova commented Nov 7, 2024

it will be released separately (now and in the future), release is still in progress, got stuck on some minor issues. Hope to finish tomorrow.

@karthikscale3
Copy link
Contributor Author

karthikscale3 commented Nov 7, 2024

it will be released separately (now and in the future), release is still in progress, got stuck on some minor issues. Hope to finish tomorrow.

Thanks @lmolkova

@alizenhom alizenhom mentioned this pull request Dec 13, 2024
Closed
6 tasks
xrmx pushed a commit to xrmx/opentelemetry-python-contrib that referenced this pull request Jan 24, 2025
@karthikscale3 @xrmx
Add Initial Support for Instrumenting OpenAI Python Library - Chat Co…
7cb2cbc 
…mpletion Create (open-telemetry#2759)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@lmolkova lmolkova lmolkova approved these changes

@xrmx xrmx xrmx approved these changes

@lzchen lzchen lzchen approved these changes

+2 more reviewers

@alizenhom alizenhom alizenhom left review comments

@codefromthecrypt codefromthecrypt codefromthecrypt approved these changes

Reviewers whose approvals may not affect merge requirements

Assignees

No one assigned

Labels

gen-ai Related to generative AI

Projects

Python PR digest
Status: Done

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

Contributing an OpenAI instrumentor.

9 participants

@karthikscale3 @truptiparkar7 @lmolkova @lzchen @alizenhom @dasiths @jsburckhardt @xrmx @codefromthecrypt