Skip to content

Implement CacheCode for HNSW indices #6745

Description

@wjones127

Follow up to #6223, which implements it for IVF_PQ indexes.

Cache codec serializes and deserializes index cache entries.

Key requirements:

  • Add a unit test that validates that after prewarm a serializing backend will not require IO to serve HNSW queries.
  • Use zero copy Arrow IPC utilities to do serde lance-arrow/src/ipc.rs

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions