What does EMA stand for ?

[Coderx7]

Hi, during training, I can see there is sometihng called, Test(EMA), what is it? and what does it do?
thanks a lot

[AnhMinhTran]

Exponential Moving Average, from the way I understand it, it helps with moving of the average of trained parameters, so something similar to label smoothing I guess? More information can be found here in the docs

https://fastai.github.io/timmdocs/training_modelEMA