Backport 1325 to 2.2

[engechas]

Issue #, if available: opensearch-project/security-analytics#718

Description of changes:
Manually resolves backport of #1325

CheckList:

• Commits are signed per the DCO using --signoff

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.

[engechas]

CI failures look unrelated

* What went wrong:
Could not determine the dependencies of task ':alerting:integTest'.
> Server returned HTTP response code: 403 for URL: https://ci.opensearch.org/ci/dbc/distribution-build-opensearch/2.2.2/6720/linux/x64/tar/builds/opensearch/plugins/opensearch-notifications-2.2.2.0.zip