Rare Terms Aggregation Performance Optimization

[sandeshkr419]

Unsure about existing performance of Rare Terms Aggregation at the moment, but looking through initial code at high level, it looks like that this aggregation also utilizes iterating through each document.

The idea is to utilize the terms frequency from Lucene similar to #11643 and avoid iterating through individual documents.

Next Steps:

• Measure/gather existing performance of rare terms aggregation
• Improve upon the implementation if it can be done with above ideation

[peternied]

[Triage - attendees 1 2 3 4 5 6]

• This looks like a duplicate of [RFC] "Significant Terms" Aggregation Performance Ideas #13124

@sandeshkr419 Lets make these issues distinct if they need to be tracked separately, but overall idea capture around aggregation perf seems like a single topic

[sandeshkr419]

Hi @peternied - keeping these issues separate since the underlying search operations, their code flows and ideas to optimize will be different. They do fall under the aggregation category and there is a probablity that these may share some optimization ideas but for now lets track each of them separately without one being influenced by the other.