-
Hi all, I'm trying to tune AGEM's hyperparameters with the code below.
In my output logs, I noticed the following pattern:
For last set of hyperparams (ppe = 30, ss = 500):
However, if I train only using last set of hyperparams (ppe = 30, ss = 500):
So there is clearly a bug in the code I've written. I can't quite put a finger on it, but perhaps I need to re-initialize the model before each iteration of tuning? I'm also confused about the |
Beta Was this translation helpful? Give feedback.
Replies: 1 comment 4 replies
-
@AndreaCossu maybe you had a bit more experience with tuning AGEM and you can give @christam96 a quick feedback? |
Beta Was this translation helpful? Give feedback.
@AndreaCossu maybe you had a bit more experience with tuning AGEM and you can give @christam96 a quick feedback?
I don't know if this is related to Avalanche though. But maybe should be discussed in https://github.com/ContinualAI/reproducible-continual-learning if we discover a bug in AGEM.