Skip to content

#366 Fix(http): Prevent duplication when handling pagination#3655

Merged
robertcheramy merged 4 commits intoytti:masterfrom
kquilliam:master
Nov 30, 2025
Merged

#366 Fix(http): Prevent duplication when handling pagination#3655
robertcheramy merged 4 commits intoytti:masterfrom
kquilliam:master

Conversation

@kquilliam
Copy link
Contributor

Pre-Request Checklist

  • Passes rubocop code analysis (try rubocop --auto-correct)
  • Tests added or adapted (try rake test)
  • Changes are reflected in the documentation
  • User-visible changes appended to CHANGELOG.md

Description

Fixed loop logic that held onto data on subsequent paginated runs, resulting in duplicated nodes. This was likely to occur with Netbox and large inventory >1000 nodes, beyond the default MAX_PAGE_SIZE of 1000 when utilizing limit=1000 with the Netbox source. For example, if you had 1200 nodes and were pulling batches of 1000, you would end up with 1400 nodes because 1000-1200 were duped. Behavior is as described in a bug report over in the oxidized-web project for #3676 but wasnt related to oxidized-web directly so I am correcting it here.

Should close issue in oxidized-web #3676

@robertcheramy
Copy link
Collaborator

The CI failing on ruby-head is OK - it has been fixed on master.
Please document your change in CHANGELOG.md.

@robertcheramy robertcheramy self-assigned this Nov 18, 2025
@robertcheramy
Copy link
Collaborator

Note - I transferred issue from oxidized-web to oxidized, it now has the ID #3676.

@kquilliam kquilliam closed this Nov 18, 2025
@kquilliam kquilliam reopened this Nov 18, 2025
@kquilliam
Copy link
Contributor Author

Changelog has been updated

@robertcheramy robertcheramy merged commit f4b1b80 into ytti:master Nov 30, 2025
7 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants