Commit Graph

19 Commits

Author SHA1 Message Date
Connor Olding e5fd937ef6 remove cruft from YellowFin
i might just remove YellowFin itself because it isn't working for me.
2017-07-25 21:38:09 +00:00
Connor Olding 5183cd38f8 add GB output layers for classification 2017-07-23 03:55:19 +00:00
Connor Olding ee83ffa88e add debug mode to MomentumClip to print norms 2017-07-23 03:54:37 +00:00
Connor Olding b20a34c2de fix MomentumClip with nesterov enabled 2017-07-22 05:05:29 +00:00
Connor Olding 217a19110a fix case when no callbacks are given 2017-07-21 19:45:34 +00:00
Connor Olding 4a108a10ae allow MomentumClip, SineCLR, WaveCLR in config 2017-07-21 19:43:57 +00:00
Connor Olding 928850c2a8 lower process priority 2017-07-11 12:44:26 +00:00
Connor Olding 112e263056 fix code i forgot to test, plus some tweaks 2017-07-11 11:36:11 +00:00
Connor Olding e145f0422f more YellowFin bullshit
i give up on this optimizer. its design is flawed.
2017-07-11 11:22:36 +00:00
Connor Olding 85c9b3b5c1 finish(?) implementing YellowFin 2017-07-03 09:48:22 +00:00
Connor Olding c41700ab8d add momentum with gradient clipping
i may refactor out clipping later,
but it's too nice not have right now.
2017-07-03 09:44:16 +00:00
Connor Olding 6a3f047ddc rename alpha to lr where applicable 2017-07-02 05:39:51 +00:00
Connor Olding 9706aaabbb add WIP YellowFin optimizer implementation 2017-07-02 02:55:19 +00:00
Connor Olding 22dc651cce move lament into core 2017-07-01 02:22:34 +00:00
Connor Olding 7da93e93a8 move graph printing into Model class 2017-07-01 02:17:46 +00:00
Connor Olding 69786b40a1 begin work on multiple input/output nodes 2017-07-01 00:44:56 +00:00
Connor Olding a7c4bdaa2e remove dead line and punctuate comment 2017-06-30 21:13:37 +00:00
Connor Olding c02fba01e2 various
use updated filenames.
don't use emnist by default.
tweak expando integer handling.
add some comments.
2017-06-26 00:16:51 +00:00
Connor Olding a770444199 shorten names 2017-06-25 22:08:07 +00:00