PARA Project — HNSW ANN & Multi-Vector ColBERT Deep Dive
Active PARA project (para: project) tracing the full lifecycle of dense and multi-vector (int8 / bfloat16) retrieval from pyvespa schema definition to C++ searchlib HNSW graph maintenance and vespa/eval late-interaction scoring.
Deliverables
- Pre-Filtering Blueprint Audit: Completed in hnsw-single-pass-prefiltering.
- Tensor Type & Wire Format Audit: Completed in vespa-tensor-type-system-and-algebra and bridge-java-cpp-tensor-serialization.
- Next Milestone: Extract an invariant card on HNSW level generation and RCU link-list updates during concurrent feeding in
vespa/searchlib/src/vespa/searchlib/tensor/hnsw_graph.h.