Skip to content

Fix vector serialization and comparison#4

Merged
JKamsker merged 1 commit intovectorsfrom
codex/review-pull-request-#2
Sep 20, 2025
Merged

Fix vector serialization and comparison#4
JKamsker merged 1 commit intovectorsfrom
codex/review-pull-request-#2

Conversation

@JKamsker
Copy link
Copy Markdown
Owner

@JKamsker JKamsker commented Sep 20, 2025

Summary

  • serialize vector lengths using UInt16 consistently and guard against oversized vectors
  • read vector payloads via UInt16/Single helpers and compare vectors lexicographically in BsonValue
  • add regression tests covering max-length roundtrips, comparison ordering, and index support for vectors

Testing

  • dotnet test LiteDB.Tests/LiteDB.Tests.csproj -f net8.0

https://chatgpt.com/codex/tasks/task_e_68cf23842d508326a6ae644112371251

@JKamsker JKamsker merged commit 9ceab3c into vectors Sep 20, 2025
@JKamsker JKamsker deleted the codex/review-pull-request-#2 branch September 20, 2025 22:33
JKamsker added a commit that referenced this pull request Nov 2, 2025
@JKamsker
auto: spatial plugin iteration #4 (T021, T022, T023)
b3460cc
JKamsker added a commit that referenced this pull request Nov 2, 2025
@JKamsker
auto: spatial plugin iteration #4 (T021, T022, T023)
8135a41
JKamsker added a commit that referenced this pull request Nov 2, 2025
@JKamsker
auto: vectorsearch plugin iteration #4 (T031, T032, T033, T035, T036)
bed7ba2
JKamsker added a commit that referenced this pull request Nov 2, 2025
@JKamsker
auto: vectorsearch plugin iteration #4 (T063, T064, T065, T066, T069,…
0e5ce0e 
… T070, T071, T072, T073, T074, T075, T076, T077, T078, T079)
JKamsker added a commit that referenced this pull request Nov 2, 2025
@JKamsker
auto: vectorsearch plugin iteration #4 (T037, T038, T039, T040, T041,…
e261fc8 
… T042, T043, T044, T045, T046, T047, T048, T049, T050, T051, T052, T053, T054, T055, T056, T057, T058, T059, T060)
JKamsker added a commit that referenced this pull request Nov 3, 2025
@JKamsker
auto: vectorsearch plugin iteration #4 (T011)
b6ac4ed
JKamsker added a commit that referenced this pull request Nov 3, 2025
@JKamsker
auto: vectorsearch plugin iteration #4 (T020)
5aea604
JKamsker added a commit that referenced this pull request Nov 8, 2025
@JKamsker
auto: vectorsearch plugin iteration #4 (T042)
17c830e
JKamsker added a commit that referenced this pull request Nov 12, 2025
@JKamsker
auto: vectorsearch plugin iteration #4 (T005, T006)
390a31b
JKamsker added a commit that referenced this pull request Nov 12, 2025
@JKamsker
auto: vectorsearch plugin iteration #4 (T005, T006)
b981b82
JKamsker added a commit that referenced this pull request Nov 12, 2025
@JKamsker
auto: vectorsearch plugin iteration #4 (T011)
a015a74
JKamsker added a commit that referenced this pull request Nov 12, 2025
@JKamsker
auto: vectorsearch plugin iteration #4 (T020)
cd0dda4
JKamsker added a commit that referenced this pull request Nov 12, 2025
@JKamsker
auto: vectorsearch plugin iteration #4 (T042)
b7c368a
JKamsker added a commit that referenced this pull request Nov 12, 2025
@JKamsker
auto: vectorsearch plugin iteration #4 (T005, T006)
ae9169c
JKamsker added a commit that referenced this pull request Nov 12, 2025
@JKamsker
001 vector core cleanup (#121)
432642b 
* feat: Add data model and implementation plan for Vector Core Cleanup

- Introduced data model documentation for VectorComponentRecord, MigrationDecision, PluginInfrastructureGap, and VerificationStep.
- Created an implementation plan outlining the steps for vector inventory refresh and migration guidance.
- Added quickstart guide for environment preparation and verification processes.
- Documented research findings on inventory validation, performance budget, query metadata extensibility, BSON type migration, storage page extensibility, and index entry point strategy.
- Developed a comprehensive feature specification detailing user scenarios, functional requirements, migration priorities, and success criteria.
- Established a task list for the Vector Core Cleanup project, organized by user stories and phases, to facilitate incremental delivery and parallel execution.

* auto: vectorsearch plugin iteration #1 (T001, T002, T003, T004)

* auto: vectorsearch plugin iteration #2 (T005, T006, T007, T008, T009, T010)

* auto: vectorsearch plugin iteration #3 (T011, T012, T013, T014, T015, T016, T017, T018, T019, T020, T021, T022, T023, T024, T025, T026, T027, T028, T029, T030, T031, T032, T033, T034, T035, T036)

* auto: vectorsearch plugin iteration #4 (T037, T038, T039, T040, T041, T042, T043, T044, T045, T046, T047, T048, T049, T050, T051, T052, T053, T054, T055, T056, T057, T058, T059, T060)

* auto: vectorsearch plugin iteration #5 (T061, T062, T063, T064, T065, T066, T067, T068, T069, T070, T071, T072, T073, T074, T075, T076, T077, T078, T079, T080, T081, T082, T083, T084, T085, T086, T087, T088, T089)

* auto: vectorsearch plugin iteration #6 (T090, T091, T092, T093, T094, T095, T096, T097, T098, T099, T100)

* feat: Implement vector findings resolution

- Updated copilot instructions to include new multi-targeted C# libraries and LiteDB core library details.
- Modified automation script to target the new vector findings spec.
- Added OpenAPI contract for plugin extensibility to facilitate vector-oriented extension points.
- Created data model documentation for vector-related entities and their relationships.
- Established implementation plan for vector findings resolution, detailing project structure and complexity tracking.
- Developed quickstart guide for exercising the new plugin-managed vector implementation.
- Documented research findings on query metadata, BSON type registration, storage page factory, index strategy replacement, migration tooling, observability, and performance guardrails.
- Drafted feature specification outlining user scenarios, requirements, and success criteria for vector findings resolution.
- Compiled tasks for implementing vector findings resolution, organized by user story and execution phases.

* .

* auto: vectorsearch plugin iteration #1 (T001, T002, T003)

* auto: vectorsearch plugin iteration #2 (T004, T005, T006, T007, T008, T009)

* auto: vectorsearch plugin iteration #3 (T010)

* auto: vectorsearch plugin iteration #4 (T011)

* auto: vectorsearch plugin iteration #5 (T012)

* auto: vectorsearch plugin iteration #6 (T013)

* auto: vectorsearch plugin iteration #7 (T014)

* auto: vectorsearch plugin iteration #8 (T015)

* auto: vectorsearch plugin iteration #9 (T016)

* auto: vectorsearch plugin iteration #1 (T017)

* auto: vectorsearch plugin iteration #2 (T018)

* auto: vectorsearch plugin iteration #3 (T019)

* auto: vectorsearch plugin iteration #4 (T020)

* auto: vectorsearch plugin iteration #5 (T021)

* auto: vectorsearch plugin iteration #6 (T022)

* auto: vectorsearch plugin iteration #7 (T023)

* update auto script

* auto: vectorsearch plugin iteration #1 (T023)

* auto: vectorsearch plugin iteration #2 (T024, T025)

* auto: vectorsearch plugin iteration #3 (progress)

* auto: vectorsearch plugin iteration #8 (added no-progress tracking)

* auto: vectorsearch plugin iteration #1 (T026, T027, T028)

* auto: vectorsearch plugin iteration #2 (T030)

* auto: vectorsearch plugin iteration #9 (refined safety shims and migration documentation)

* Phase 4: Done

* Remove unintended artifacts

* .

* auto: vectorsearch plugin iteration #1 (T033, T034, T035, T036, T037, T038, T039)

* auto: vectorsearch plugin iteration #2 (T041)

* auto: vectorsearch plugin iteration #3 (T040)

* auto: vectorsearch plugin iteration #4 (T042)

* auto: vectorsearch plugin iteration #5 (T043)

* Ensure vector pages are reclaimed

* Fix aggrssive filtering for dotproduct

* test1

* Add tests for missing vector plugin

* Fix: exception on missing vector plugin

* Fix local runners

* Fix full framework tests

* Release snapshot buffers when page decoding fails

* Allow SDK to roll forward to .NET 10

* add plan

* Update task and progress file paths for vector stability migration

* auto: vectorsearch plugin iteration #1 (T001, T002)

* auto: vectorsearch plugin iteration #2 (T003)

* auto: vectorsearch plugin iteration #3 (T004)

* auto: vectorsearch plugin iteration #4 (T005, T006)

* auto: vectorsearch plugin iteration #5 (T007)

* auto: vectorsearch plugin iteration #6 (T008)

* auto: vectorsearch plugin iteration #8 (T009, T010, T011)

* auto: vectorsearch plugin iteration #9 (T012, T013, T014)

* auto: vectorsearch plugin iteration #10 (T015)

* auto: vectorsearch plugin iteration #11 (T016)

* auto: vectorsearch plugin iteration #12 (T017)

* auto: vectorsearch plugin iteration #13 (T018)

* auto: vectorsearch plugin iteration #14 (T019)

* auto: vectorsearch plugin iteration #15 (T020, T021, T022)

* auto: vectorsearch plugin iteration #16 (T023)

* Add lifecycle md
JKamsker added a commit that referenced this pull request Nov 16, 2025
@JKamsker
auto: vectorsearch plugin iteration #4 (T004)
c658f40
JKamsker added a commit that referenced this pull request Nov 16, 2025
@JKamsker
auto: vectorsearch plugin iteration #4 (T009)
ba414f8
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

codex

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

1 participant

@JKamsker