1 Matching Annotations
  1. Oct 2022
  2. optimization.cbe.cornell.edu optimization.cbe.cornell.edu
    Adam - Cornell University Computational Optimization Open Textbook - Optimization Wiki
    1
    1. FairyCop 10 Oct 2022
      instead of adapting learning rates based on the average first moment as in RMSP,

      RMSProp uses the second moment, not the first. Also, the moment is the average. That is, EMA of the gradient squares is an approximation of the second moment.

      correction
    Visit annotations in context

    Tags

    Annotators

    URL

    optimization.cbe.cornell.edu/index.php