Add cache plugin and tiered cache documentation#6708
Add cache plugin and tiered cache documentation#6708kolchfa-aws merged 10 commits intoopensearch-project:mainfrom
Conversation
Signed-off-by: Sagar Upadhyaya <sagar.upadhyaya.121@gmail.com>
Signed-off-by: Sagar Upadhyaya <sagar.upadhyaya.121@gmail.com>
Signed-off-by: Sagar Upadhyaya <sagar.upadhyaya.121@gmail.com>
sgup432
requested review from
AMoo-Miki,
Naarcha-AWS,
dlvenable,
hdhalter,
kolchfa-aws,
natebower,
stephen-crawford and
vagimeli
as code owners
sgup432
changed the title
hdhalter
added
release-notes
|
@sgup432 Thanks for writing the docs. I will review shortly and push my edits to the same PR. Do you have a GitHub issue where you'd like to collect users' feedback for this feature? |
|
@kolchfa-aws |
hdhalter
changed the title
Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
Yes! We can point to that page for installation instructions. |
Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
|
@sgup432 Please advise on the naming of the section and also provide the name and location of the plugin that the users need to install for ehcache. Thanks! |
Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
natebower
left a comment
natebower
left a comment
There was a problem hiding this comment.
@sgup432 @kolchfa-aws Please see my comments and changes and let me know if you have any questions. Thanks!
_search-plugins/caching/index.md
Outdated
|
|
||
| # Caching | ||
|
|
||
| OpenSearch relies heavily on different types of on-heap cache to accelerate data retrieval, providing significant improvement in search latencies. However, cache size is limited by the amount of memory available on a node. If you are processing a larger dataset that can potentially be cached, the cache size limit causes a lot of cache evictions and misses. The increasing number of evictions impacts performance because OpenSearch needs to process the query again, causing high resource consumption. |
_search-plugins/caching/index.md
Outdated
|
|
||
| In addition to existing OpenSearch custom on-heap cache stores, cache plugins provide the following cache stores: | ||
|
|
||
| - **Disk cache**: This cache stores a precomputed result of a query on disk. You can use disk cache to cache much larger datasets, provided that the disk latencies are acceptable. |
There was a problem hiding this comment.
"the" precomputed result (if there is only one result for the query)?
Co-authored-by: Nathan Bower <nbower@amazon.com> Signed-off-by: kolchfa-aws <105444904+kolchfa-aws@users.noreply.github.com>
Signed-off-by: kolchfa-aws <105444904+kolchfa-aws@users.noreply.github.com>
Co-authored-by: Nathan Bower <nbower@amazon.com> Signed-off-by: kolchfa-aws <105444904+kolchfa-aws@users.noreply.github.com>
kolchfa-aws
left a comment
kolchfa-aws
left a comment
There was a problem hiding this comment.
LGTM. Thanks, @sgup432! Changed the title to "Caching"
4 participants
Description
Adding a new doc for cache plugins introduced as part of 2.13.
Also adding a doc for tiered cache which is one of the implementation provided via cache plugin.
Note: This is an experimental feature.
Issues Resolved
Closes #6300
Checklist
For more information on following Developer Certificate of Origin and signing off your commits, please check here.