Skip to content

Add PaginatedPublisher to replace ScrollPublisher to support both scroll and search after api for search queries#3724

Open
jk-leong wants to merge 1 commit intoPhilippus:series/9.xfrom
jk-leong:add-publisher-for-search-after-queries
Open

Add PaginatedPublisher to replace ScrollPublisher to support both scroll and search after api for search queries#3724
jk-leong wants to merge 1 commit intoPhilippus:series/9.xfrom
jk-leong:add-publisher-for-search-after-queries

Conversation

@jk-leong
Copy link
Copy Markdown

Related Issue:

Following up from issue to add search after functionality for publisher:
#2666

Reason for change:

Elasticsearch now recommends the use of search after API over scroll api for deep pagination.
https://www.elastic.co/docs/reference/elasticsearch/rest-apis/paginate-search-results#scroll-search-results

Changes made:

  • Replaced ScrollPublisher with PaginatedPublisher that supports a mode param that if passed in with SearchAfter object will use the search_after api

@jk-leong
Copy link
Copy Markdown
Author

Hi @Philippus ! Will need your help to review this PR to check if there's anything I have missed out 😄

@jk-leong jk-leong force-pushed the add-publisher-for-search-after-queries branch 3 times, most recently from b885b88 to 28f5f29 Compare November 25, 2025 08:48
@jk-leong
Copy link
Copy Markdown
Author

Fixed the lint issues @Philippus

@jk-leong jk-leong force-pushed the add-publisher-for-search-after-queries branch from 28f5f29 to 62e441d Compare December 16, 2025 07:30
@jk-leong jk-leong marked this pull request as draft December 16, 2025 07:33
@jk-leong jk-leong marked this pull request as ready for review December 16, 2025 07:33
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant