About the ZINC evaluation #88
Description
Hey!
I've two questions about the results reported for ZINC.
- For every seed, how was the best MAE for the test reported: is it on the epoch in which the best validation MAE occurs? Additionally, in the table there is a report of the best epoch number, but over 4 seeds - what does that mean?
- How is the MAE calculated for validation and test? It seems like it is calculated as the average of the averages of each batch in the val/test loaders - rather than the average over all the data. Is that correct?
Thx!