the Stage of the MACs

[niebowen666]

The output of profile is macs and params.
Does the macs just about the forward stage?
Or it include the calculation complexity of forward, backward and optimization？

[sovrasov]

The estimation is done only for forward pass, backward and optimizer stages are not included