Skip to content

Commit 73bb7d1

Browse files
authored
fix: Avoid reading all mmaped sparse vectors into memory (qdrant#130)
1 parent a8bcf78 commit 73bb7d1

File tree

1 file changed

+0
-3
lines changed

1 file changed

+0
-3
lines changed

dataset_reader/sparse_reader.py

Lines changed: 0 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -63,9 +63,6 @@ def read_csr_matrix(filename: Union[Path, str], do_mmap=True) -> Iterator[Sparse
6363
values, columns, index_pointer = mmap_sparse_matrix_fields(filename)
6464
else:
6565
values, columns, index_pointer = read_sparse_matrix_fields(filename)
66-
values = values.tolist()
67-
columns = columns.tolist()
68-
index_pointer = index_pointer.tolist()
6966

7067
yield from csr_to_sparse_vectors(values, columns, index_pointer)
7168

0 commit comments

Comments
 (0)