In dist training, update loss running avg every step, sync on log#2340

rwightman merged 2 commits intomainhuggingface/pytorch-image-models:mainfrom

dist_loss_trackinghuggingface/pytorch-image-models:dist_loss_trackingCopy head branch name to clipboard