Skip to content

Latest commit

 

History

History
43 lines (26 loc) · 2.31 KB

CONTRIBUTING.md

File metadata and controls

43 lines (26 loc) · 2.31 KB

Contributing to DeepEval 🥳

Thanks for thinking about contributing to DeepEval! We accept fixes, improvements, or even entire new features. Some reasons why you might want to contribute:

  • there's a bug that you want fixed
  • there's a cool new feature you're thinking about that might be useful for DeepEval
  • there's a metric or benchmark that you want implemented
  • there's room for improvement in the docs

How to contribute

We follow fork and pull request workflow. To know more about it, check out this guide.

Set up your development environment

  1. Create a python virtual environment.
  2. We recommend using Poetry to install dependencies. If you haven't already, see the Poetry docs.
  3. Install the dependencies using:
poetry install

Our expectations (not a lot :)

To contribute, all we ask for is to follow existing patterns within the codebase. For example, if you're looking to add a new benchmark, look at how the different modules in the existing benchmarks are structured and implemented, and we encourage you to reuse helper functions and methods shared by similar modules.

Other than that, there are no strict rules to follow, except for optionally running black to ensure good formatting. Also, there's no need to worry about failing test cases in GitHub Actions, as these are mostly for internal use and will only pass if triggered by a user with the correct permissions within Confident AI.

Thank you and come ask any questions or discuss any new PRs you have in mind on our Discord!

Issue lifecycle & staleness policy

  • Stale closure: We close issues with no activity for ≥ 12 months.

  • Reopening: If your issue is still relevant:

    1. Leave a comment mentioning one or more maintainers from MAINTAINERS.md and include any new details (version, repro steps, logs).
    2. If you don’t get a response in a few days, open a new issue and reference the old one.

Exclusions: Labeled issues.

Why: Keeps the tracker actionable and reflects the current roadmap. If your issue still matters, please comment and we’ll re-open.