Commit Graph

13 Commits

Author SHA1 Message Date
Connor Olding dc8969469d move param/sigma decay into es methods 2018-06-28 11:03:28 +02:00
Connor Olding f52fabc549 fix and rewrite ARS telling (it was super broken!) 2018-06-21 17:13:35 +02:00
Connor Olding 102eefe98c add PowerSign momentum to ARS, antithetic by default 2018-06-21 05:15:05 +02:00
Connor Olding e3695bfb84 rename weight* to param* outside of nn.lua 2018-06-16 00:33:47 +02:00
Connor Olding f3fc95404c overhaul learning rates:
- rename mean_adapt to weight_rate
- sigma and covar update rates can be specified separately
  (sigma_rate, covar_rate)
- base decays on current rates instead of initially configured rates
  (this might break stuff)
- base_rate takes the place of learning_rate
2018-06-16 00:29:15 +02:00
Connor Olding 422468dd47 more comments 2018-06-14 22:15:49 +02:00
Connor Olding 63583789c3 use locals; fix fitness_shaping and graycode 2018-06-13 22:52:37 +02:00
Connor Olding ac4c534185 fix non-antithetic case for ARS 2018-06-13 22:46:09 +02:00
Connor Olding 601d78bfda add evaluation counting to ARS, cleanup 2018-06-13 21:54:04 +02:00
Connor Olding b4e49d08b9 restore step logging, remove adamant (for now) 2018-06-13 01:42:36 +02:00
Connor Olding 74eb2bfbef fix antithetic ARS 2018-06-12 20:57:31 +02:00
Connor Olding bcb6cb9da1 add xNES optimizer 2018-06-09 18:56:10 +02:00
Connor Olding fe9494b0d5 refactor ARS out of main (breaks a bunch of stuff) 2018-06-09 18:56:10 +02:00