You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
In the Cutlass implementation, the Q matrix is prefetched outside the loop but loaded inside the loop.
This improves FA performance by avoiding register spilling.
A similar strategy should be evaluated for FA in Triton.
The text was updated successfully, but these errors were encountered:
In the Cutlass implementation, the Q matrix is prefetched outside the loop but loaded inside the loop.
This improves FA performance by avoiding register spilling.
A similar strategy should be evaluated for FA in Triton.
The text was updated successfully, but these errors were encountered: