Open
Description
API Change Detected
Function: rocm_aiter.reshape_and_cache_with_pertoken_quant
Import: import aiter as rocm_aiter
Commit: c1debd87ce0391aa27438d9e07e76e4fea7c4b70
Previous State
(*args, custom_build_args={}, **kwargs)
Current State
(key: torch.Tensor, value: torch.Tensor, key_cache: torch.Tensor, value_cache: torch.Tensor, k_dequant_scales: torch.Tensor, v_dequant_scales: torch.Tensor, slot_mapping: torch.Tensor, asm_layout: bool)
Parameter Changes
- Removed parameters: kwargs, args, custom_build_args
- Added parameters: key, key_cache, v_dequant_scales, value, value_cache, k_dequant_scales, slot_mapping, asm_layout
Error (if any)
None
Metadata
Metadata
Assignees
Labels
No labels