Skip to content

Commit 4b666f2

Browse files
author
Haiyang Shi
committed
[Fix] Fix BaseKVCacheManager
Signed-off-by: Haiyang Shi <[email protected]>
1 parent 512afaa commit 4b666f2

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

python/aibrix_kvcache/aibrix_kvcache/cache_manager.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -802,7 +802,7 @@ def _get_impl(
802802
Returns:
803803
The memory regions corresponding to the tokens.
804804
"""
805-
prefix = cache_key.tokens
805+
prefix = cache_key.prefix
806806
tokens = cache_key.tokens
807807

808808
if prefix is not None and len(prefix) % self.block_ntokens != 0:

0 commit comments

Comments
 (0)