Skip to content

Local minima not handled #1

@LucAlexander

Description

@LucAlexander

Loss will reach a local minima and then over compensate and shoot up the other side to -NAN.
Writing code to handle local minima will help handle this, as well as a system which keeps track of if the loss increases rather than decreases after a batch/pass. A regulator essentially

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't working

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions