Skip to content

Support vector similarity operator in predicates#3

Merged
JKamsker merged 3 commits intovectorsfrom
codex/implement-and-test-vector_sim-function
Sep 20, 2025
Merged

Support vector similarity operator in predicates#3
JKamsker merged 3 commits intovectorsfrom
codex/implement-and-test-vector_sim-function

Conversation

@JKamsker
Copy link
Copy Markdown
Owner

@JKamsker JKamsker commented Sep 20, 2025

Summary

  • allow the tokenizer to treat VECTOR_SIM as an infix operand and evaluate it with arithmetic precedence so comparison predicates parse correctly
  • unwrap SQL reader results in the vector similarity test to assert on the returned documents
  • add fluent query helpers that expose vector similarity filters without hand-written expression strings

Testing

  • dotnet test LiteDB.sln --settings tests.runsettings

https://chatgpt.com/codex/tasks/task_e_68cf10de9f94832694960d44a961ae50

@JKamsker JKamsker merged commit fff562b into vectors Sep 20, 2025
@JKamsker JKamsker deleted the codex/implement-and-test-vector_sim-function branch September 20, 2025 21:54
JKamsker added a commit that referenced this pull request Nov 2, 2025
@JKamsker
auto: spatial plugin iteration #3 (T020)
94e4e57
JKamsker added a commit that referenced this pull request Nov 2, 2025
@JKamsker
auto: spatial plugin iteration #3 (T020)
405f099
JKamsker added a commit that referenced this pull request Nov 2, 2025
@JKamsker
auto: vectorsearch plugin iteration #3 (T027, T028, T029, T030)
fb6e5f5
JKamsker added a commit that referenced this pull request Nov 2, 2025
@JKamsker
auto: vectorsearch plugin iteration #3 (T052, T053, T054, T055, T056,…
d2e54cd 
… T057, T058, T059, T060, T061, T062)
JKamsker added a commit that referenced this pull request Nov 2, 2025
@JKamsker
auto: vectorsearch plugin iteration #3 (T011, T012, T013, T014, T015,…
0257a6f 
… T016, T017, T018, T019, T020, T021, T022, T023, T024, T025, T026, T027, T028, T029, T030, T031, T032, T033, T034, T035, T036)
JKamsker added a commit that referenced this pull request Nov 3, 2025
@JKamsker
auto: vectorsearch plugin iteration #3 (T010)
26b9428
JKamsker added a commit that referenced this pull request Nov 3, 2025
@JKamsker
auto: vectorsearch plugin iteration #3 (T019)
0cef671
JKamsker added a commit that referenced this pull request Nov 3, 2025
@JKamsker
auto: vectorsearch plugin iteration #3 (progress)
7025aa6
JKamsker added a commit that referenced this pull request Nov 8, 2025
@JKamsker
auto: vectorsearch plugin iteration #3 (T040)
32c4168
JKamsker added a commit that referenced this pull request Nov 12, 2025
@JKamsker
auto: vectorsearch plugin iteration #3 (T004)
5ac5270
JKamsker added a commit that referenced this pull request Nov 12, 2025
@JKamsker
auto: vectorsearch plugin iteration #3 (T004)
3d6b6fc
JKamsker added a commit that referenced this pull request Nov 12, 2025
@JKamsker
auto: vectorsearch plugin iteration #3 (T010)
9bb5424
JKamsker added a commit that referenced this pull request Nov 12, 2025
@JKamsker
auto: vectorsearch plugin iteration #3 (T019)
ea5dd3f
JKamsker added a commit that referenced this pull request Nov 12, 2025
@JKamsker
auto: vectorsearch plugin iteration #3 (progress)
c558d45
JKamsker added a commit that referenced this pull request Nov 12, 2025
@JKamsker
auto: vectorsearch plugin iteration #3 (T040)
a3b30cb
JKamsker added a commit that referenced this pull request Nov 12, 2025
@JKamsker
auto: vectorsearch plugin iteration #3 (T004)
2c71613
JKamsker added a commit that referenced this pull request Nov 12, 2025
@JKamsker
001 vector core cleanup (#121)
432642b 
* feat: Add data model and implementation plan for Vector Core Cleanup

- Introduced data model documentation for VectorComponentRecord, MigrationDecision, PluginInfrastructureGap, and VerificationStep.
- Created an implementation plan outlining the steps for vector inventory refresh and migration guidance.
- Added quickstart guide for environment preparation and verification processes.
- Documented research findings on inventory validation, performance budget, query metadata extensibility, BSON type migration, storage page extensibility, and index entry point strategy.
- Developed a comprehensive feature specification detailing user scenarios, functional requirements, migration priorities, and success criteria.
- Established a task list for the Vector Core Cleanup project, organized by user stories and phases, to facilitate incremental delivery and parallel execution.

* auto: vectorsearch plugin iteration #1 (T001, T002, T003, T004)

* auto: vectorsearch plugin iteration #2 (T005, T006, T007, T008, T009, T010)

* auto: vectorsearch plugin iteration #3 (T011, T012, T013, T014, T015, T016, T017, T018, T019, T020, T021, T022, T023, T024, T025, T026, T027, T028, T029, T030, T031, T032, T033, T034, T035, T036)

* auto: vectorsearch plugin iteration #4 (T037, T038, T039, T040, T041, T042, T043, T044, T045, T046, T047, T048, T049, T050, T051, T052, T053, T054, T055, T056, T057, T058, T059, T060)

* auto: vectorsearch plugin iteration #5 (T061, T062, T063, T064, T065, T066, T067, T068, T069, T070, T071, T072, T073, T074, T075, T076, T077, T078, T079, T080, T081, T082, T083, T084, T085, T086, T087, T088, T089)

* auto: vectorsearch plugin iteration #6 (T090, T091, T092, T093, T094, T095, T096, T097, T098, T099, T100)

* feat: Implement vector findings resolution

- Updated copilot instructions to include new multi-targeted C# libraries and LiteDB core library details.
- Modified automation script to target the new vector findings spec.
- Added OpenAPI contract for plugin extensibility to facilitate vector-oriented extension points.
- Created data model documentation for vector-related entities and their relationships.
- Established implementation plan for vector findings resolution, detailing project structure and complexity tracking.
- Developed quickstart guide for exercising the new plugin-managed vector implementation.
- Documented research findings on query metadata, BSON type registration, storage page factory, index strategy replacement, migration tooling, observability, and performance guardrails.
- Drafted feature specification outlining user scenarios, requirements, and success criteria for vector findings resolution.
- Compiled tasks for implementing vector findings resolution, organized by user story and execution phases.

* .

* auto: vectorsearch plugin iteration #1 (T001, T002, T003)

* auto: vectorsearch plugin iteration #2 (T004, T005, T006, T007, T008, T009)

* auto: vectorsearch plugin iteration #3 (T010)

* auto: vectorsearch plugin iteration #4 (T011)

* auto: vectorsearch plugin iteration #5 (T012)

* auto: vectorsearch plugin iteration #6 (T013)

* auto: vectorsearch plugin iteration #7 (T014)

* auto: vectorsearch plugin iteration #8 (T015)

* auto: vectorsearch plugin iteration #9 (T016)

* auto: vectorsearch plugin iteration #1 (T017)

* auto: vectorsearch plugin iteration #2 (T018)

* auto: vectorsearch plugin iteration #3 (T019)

* auto: vectorsearch plugin iteration #4 (T020)

* auto: vectorsearch plugin iteration #5 (T021)

* auto: vectorsearch plugin iteration #6 (T022)

* auto: vectorsearch plugin iteration #7 (T023)

* update auto script

* auto: vectorsearch plugin iteration #1 (T023)

* auto: vectorsearch plugin iteration #2 (T024, T025)

* auto: vectorsearch plugin iteration #3 (progress)

* auto: vectorsearch plugin iteration #8 (added no-progress tracking)

* auto: vectorsearch plugin iteration #1 (T026, T027, T028)

* auto: vectorsearch plugin iteration #2 (T030)

* auto: vectorsearch plugin iteration #9 (refined safety shims and migration documentation)

* Phase 4: Done

* Remove unintended artifacts

* .

* auto: vectorsearch plugin iteration #1 (T033, T034, T035, T036, T037, T038, T039)

* auto: vectorsearch plugin iteration #2 (T041)

* auto: vectorsearch plugin iteration #3 (T040)

* auto: vectorsearch plugin iteration #4 (T042)

* auto: vectorsearch plugin iteration #5 (T043)

* Ensure vector pages are reclaimed

* Fix aggrssive filtering for dotproduct

* test1

* Add tests for missing vector plugin

* Fix: exception on missing vector plugin

* Fix local runners

* Fix full framework tests

* Release snapshot buffers when page decoding fails

* Allow SDK to roll forward to .NET 10

* add plan

* Update task and progress file paths for vector stability migration

* auto: vectorsearch plugin iteration #1 (T001, T002)

* auto: vectorsearch plugin iteration #2 (T003)

* auto: vectorsearch plugin iteration #3 (T004)

* auto: vectorsearch plugin iteration #4 (T005, T006)

* auto: vectorsearch plugin iteration #5 (T007)

* auto: vectorsearch plugin iteration #6 (T008)

* auto: vectorsearch plugin iteration #8 (T009, T010, T011)

* auto: vectorsearch plugin iteration #9 (T012, T013, T014)

* auto: vectorsearch plugin iteration #10 (T015)

* auto: vectorsearch plugin iteration #11 (T016)

* auto: vectorsearch plugin iteration #12 (T017)

* auto: vectorsearch plugin iteration #13 (T018)

* auto: vectorsearch plugin iteration #14 (T019)

* auto: vectorsearch plugin iteration #15 (T020, T021, T022)

* auto: vectorsearch plugin iteration #16 (T023)

* Add lifecycle md
JKamsker added a commit that referenced this pull request Nov 16, 2025
@JKamsker
auto: vectorsearch plugin iteration #3 (T003)
fef8846
JKamsker added a commit that referenced this pull request Nov 16, 2025
@JKamsker
auto: vectorsearch plugin iteration #3 (T008)
e87b8b9
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

codex

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

1 participant

@JKamsker