[Feature Tracking] MLA-FP8 Hopper kernel

[yzh119]

Pipeline design

Stages

• LOAD-Q
• LOAD-K
• GEMM-QK
• SMEM-TRANSPOSE-K
• GEMM-PV-LEFT
• GEMM-PV-RIGHT
• WRITE-O

2WG Example

• WG1: LOAD-K(1,1) -> LOAD-Q(q) -> LOAD-K(1, 2) -> SMEM-TRANSPOSE-K(1, 1) -> GEMM-PV-LEFT(1, 1) -> LOAD-K(1, 3) -> SMEM-TRANSPOSE-K(1, 2) -> GEMM-PV-LEFT(1, 2) -> ...
• WG2: GEMM-QK(1, 1) -> GEMM-PV-RIGHT(1, 1) -> GEMM-QK(1, 2) -> GEMM-PV-RIGHT(1, 2) -> ...