Skip to content

Added ingestor.store() support in NV-Ingest#446

Open
smasurekar wants to merge 1 commit intodevelopfrom
dev/smasurekar/nv-ingest-store
Open

Added ingestor.store() support in NV-Ingest#446
smasurekar wants to merge 1 commit intodevelopfrom
dev/smasurekar/nv-ingest-store

Conversation

@smasurekar
Copy link
Collaborator

NV-Ingest .store() for citation assets; read via source_location

Citation images and structured assets are written by NV-Ingest ingestor.store() (MinIO) instead of the ingestor’s __put_content_to_minio path. The RAG server and VLM load them using source.source_location and MinioOperator.get_object() (plus object_key_from_storage_uri). Document summaries are unchanged (get_payload / thumbnail IDs).

Citation storage is not backward compatible: Citation media that was written to MinIO under unique-thumbnail object keys (JSON payloads) is no longer what the RAG server resolves at query time. NV-Ingest now persists assets through .store(), and the server loads them via source_location. Older vectors may still reference the thumbnail-based layout; re-ingesting aligns metadata and object paths so citation images resolve correctly.

Checklist

  • I am familiar with the Contributing Guidelines.
  • All commits are signed-off (git commit -s) and GPG signed (git commit -S).
  • New or existing tests cover these changes.
  • The documentation is up to date with these changes.
  • If adjusting docker-compose.yaml environment variables have you ensured those are mimicked in the Helm values.yaml file.

@smasurekar smasurekar added the enhancement New feature or request label Mar 25, 2026
@smasurekar smasurekar force-pushed the dev/smasurekar/nv-ingest-store branch from b2071c2 to 80c8ecc Compare March 25, 2026 05:41
Signed-off-by: Swapnil Masurekar <smasurekar@nvidia.com>
@smasurekar smasurekar force-pushed the dev/smasurekar/nv-ingest-store branch from 80c8ecc to 3151721 Compare March 25, 2026 06:02
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

enhancement New feature or request

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant