[meta] 6.6.0 Release

[codebrain]

Leftover Work

New Features 6.5.0

• ML. Reverse engineer Grok patterns from categorization results - [ML] Reverse engineer Grok patterns from categorization results elasticsearch#30125 - skipped as marked experimental

Enhancements 6.5.0

• Add keywords_pattern to Keyword Marker Token Filter. Add keywords_pattern to Keyword Marker Token Filter. #3558
• Return statistics about forecasts as part of the job stats and usage API - [ML] Return statistics about forecasts as part of the jobsstats and usage API elasticsearch#31647 Return statistics about forecasts as part of the job stats and usage API #3593
• [ML] Add description to ML filters - [ML] Add description to ML filters elasticsearch#31330 - skipped as filters are marked experimental
• Rename ranking evaluation quality_level to metric_score - Rename ranking evaluation quality_level to metric_score elasticsearch#32168 - skipped as rank_eval is marked experimental and not implemented yet
• Rename ranking evaluation response unknown_docs section - Rename ranking evaluation response unknown_docs section elasticsearch#32166 skipped as rank_eval is marked experimental and not implemented yet
• Add Expected Reciprocal Rank metric - Add Expected Reciprocal Rank metric elasticsearch#31891 skipped as rank_eval is marked experimental and not implemented yet
• Add details section for dcg ranking metric - Add details section for dcg ranking metric elasticsearch#31177 skipped as rank_eval is marked experimental and not implemented yet
• [ML] Add a timeout option to file structure finder [ML] Add a timeout option to file structure finder elasticsearch#34117 - skipped as marked experimental
• [ML] Allow asynchronous job deletion [ML] Allow asynchronous job deletion elasticsearch#34058
• Make certain ML node settings dynamic ([ML] Review and upgrade static node settings and into dynamic cluster settings elasticsearch#33565) Make certain ML node settings dynamic (#33565) elasticsearch#33961 - no change needed, API not affected
• Adding node_count to ML Usage ([ML] Add the number of ML nodes to the ML feature set usage info elasticsearch#33850) Adding node_count to ML Usage (#33850) elasticsearch#33863 - Add node count to ML usage response #3603
• [ML] Minor improvements to categorization Grok pattern creation [ML] Minor improvements to categorization Grok pattern creation elasticsearch#33353 - does not affect REST API
• [ML] Delete forecast API ([ML] Delete forecast API elasticsearch#31134) [ML] Delete forecast API (#31134) elasticsearch#33218 - Delete forecast API #3591
• [Rollup] Add support for date histo format when searching [Rollup] Add support for date histo format when searching elasticsearch#34537 - Add support for date histogram format. #3594
• [Rollup] Only allow aggregating on multiples of configured interval [Rollup] Only allow aggregating on multiples of configured interval elasticsearch#32052 - internal ES change, no API changes required

New API's 6.4.0

• xpack.ml.delete_calendar.json - Ml calendar apis #3569
• xpack.ml.delete_calendar_event.json - Ml calendar apis #3569
• xpack.ml.delete_calendar_job.json - Ml calendar apis #3569
• xpack.ml.get_calendar_events.json - Ml calendar apis #3569
• xpack.ml.get_calendars.json - Ml calendar apis #3569
• xpack.ml.post_calendar_events.json - Ml calendar apis #3569
• xpack.ml.put_calendar.json - Ml calendar apis #3569
• xpack.ml.put_calendar_job.json - Ml calendar apis #3569
• xpack.ml.get_calendar_job.json - Ml calendar apis #3569
• xpack.ml.update_filter.json - experimental, do not implement
• xpack.ml.info.json - Implement ML Info Api #3571
• xpack.security.delete_privileges.json - Add security APIs #3584
• xpack.security.get_privileges.json - Add security APIs #3584
• xpack.security.has_privileges.json - Add security APIs #3584
• xpack.security.put_privilege.json - Add security APIs #3584
• xpack.security.put_privileges.json - Add security APIs #3584

New API's 6.5.0

• delete_by_query_rethrottle.json (@russcam )
• update_by_query_rethrottle.json (@russcam)
• xpack.ml.delete_forecast.json - Delete forecast API #3591
• xpack.ml.find.file_structure.json - experimental, do not implement
• xpack.security.get_user_privileges.json - Add security APIs #3584

6.6.0

Breaking changes

Ranking:

• Forbid negative scores in function_score query Forbid negative scores in function_score query elasticsearch#35709 (issue: Forbid negative query scores elasticsearch#33309) - This shouldn't require any changes to the client

Search:

• Throw a parsing exception when boost is set in span_or query Query DSL should disallow setting boosts on inner span queries elasticsearch#28390 Throw a parsing exception when boost is set in span_or query (#28390) elasticsearch#34112 (issue: Query DSL should disallow setting boosts on inner span queries elasticsearch#28390)

Watcher:

• Fix metric stats names Watcher: fix metric stats names elasticsearch#34951 (issue: Watcher Stats metrics parameters are mislabeled elasticsearch#34865) - fixed in new xpack.watcher.stats.json json spec

Deprecations

Aggregations:

• Deprecate dots in aggregation names Deprecate dots in aggregation names elasticsearch#31468 (issues: Terms order aggregation name cannot contain a period elasticsearch#17600, Make bucketsPath syntax for lower and upper standard deviation bounds in the extended_stats aggregation more obvious elasticsearch#19040) - This shouldn't require any changes to the client

Core:

• Deprecate use of scientific notation in epoch time parsing Core: Deprecate use of scientific notation in epoch time parsing elasticsearch#36691 - This shouldn't require any changes to the client

Search:

• Deprecate the _termvector endpoint. Deprecate the _termvector endpoint. elasticsearch#36098 (issue: More consistent naming for term vector[s] elasticsearch#8484) - endpoint regeneration has resolved this
• Deprecate _source_include and _source_exclude url parameters Deprecate _source_include and _source_exclude url parameters elasticsearch#33475 (issue: inconsistency between source filtering names in query parameter vs request body elasticsearch#22792) - endpoint regeneration has solved this

Security::

• Undeprecate /_license endpoints Undeprecate /_license endpoints elasticsearch#35974 (issue: Deprecate X-Pack centric license endpoints elasticsearch#35959) - no client changes required

Watcher::

• Undeprecate /_watcher endpoints Undeprecate /_watcher endpoints elasticsearch#36269 - no client changes required

New features

Enhancements

Aggregations

• Refactor children aggregator into a generic ParentJoinAggregator #34845 (issue: #34210)
• Add parent-aggregation to parent-join module #34210 (issue: #9705)

[vohanka]

Hello @codebrain,
may I ask if you are going to solve these issues

Refactor children aggregator into a generic ParentJoinAggregator #34845 (issue: #34210)

Add parent-aggregation to parent-join module #34210 (issue: #9705)

in near future?

Thank you very much for your answer.

Libor.

[codebrain]

Hi @vohanka - this ticket is my current workload, so I will be addressing those issues shortly. When they are addressed I will ping you on the PR so you can track them. Thanks.

[russcam]

@vohanka I've opened #3609 to address in the next release

[vohanka]

Hello @codebrain and @russcam - great work, thank you very much.

[vohanka]

Thank you for support works great.

[codebrain]

Superceded by #3615