7 Commits

Author	SHA1	Message	Date
Connor Olding	dc8969469d	move param/sigma decay into es methods	2018-06-28 11:03:28 +02:00
Connor Olding	b0058db80e	TODOs and delete an unused variable	2018-06-16 00:38:09 +02:00
Connor Olding	e3695bfb84	rename weight* to param* outside of nn.lua	2018-06-16 00:33:47 +02:00
Connor Olding	f3fc95404c	overhaul learning rates: ... - rename mean_adapt to weight_rate - sigma and covar update rates can be specified separately (sigma_rate, covar_rate) - base decays on current rates instead of initially configured rates (this might break stuff) - base_rate takes the place of learning_rate	2018-06-16 00:29:15 +02:00
Connor Olding	b4e49d08b9	restore step logging, remove adamant (for now)	2018-06-13 01:42:36 +02:00
Connor Olding	5c64fcf395	overhaul SNES (importance sampling, adaptation sampling, etc)	2018-06-13 01:19:32 +02:00
Connor Olding	3eebbc534a	add SNES optimizer	2018-06-10 16:40:20 +02:00