Commit graph

27 commits

Author SHA1 Message Date
049d966710 remove biasing from Conv1Dper in favor of Bias layer 2017-08-02 11:30:08 +00:00
f507dc10f8 remove DenseOneLess
not useful.
2017-08-02 10:52:26 +00:00
4d2251f69f allow weight sharing; disableable gradient clearing 2017-08-02 10:29:58 +00:00
89fcd25962 fix wording 2017-08-02 07:00:33 +00:00
e4fa5bf63f add positional control to convolution 2017-08-02 06:47:37 +00:00
5074dcb2aa add Decimate and Undecimate layers 2017-08-02 06:47:15 +00:00
8b3b8d8288 add rough 1D circular convolution 2017-08-02 03:58:24 +00:00
5d9efa71c1 move SquaredHalved to core 2017-07-25 22:14:17 +00:00
e5fd937ef6 remove cruft from YellowFin
i might just remove YellowFin itself because it isn't working for me.
2017-07-25 21:38:09 +00:00
5183cd38f8 add GB output layers for classification 2017-07-23 03:55:19 +00:00
ee83ffa88e add debug mode to MomentumClip to print norms 2017-07-23 03:54:37 +00:00
b20a34c2de fix MomentumClip with nesterov enabled 2017-07-22 05:05:29 +00:00
217a19110a fix case when no callbacks are given 2017-07-21 19:45:34 +00:00
4a108a10ae allow MomentumClip, SineCLR, WaveCLR in config 2017-07-21 19:43:57 +00:00
928850c2a8 lower process priority 2017-07-11 12:44:26 +00:00
112e263056 fix code i forgot to test, plus some tweaks 2017-07-11 11:36:11 +00:00
e145f0422f more YellowFin bullshit
i give up on this optimizer. its design is flawed.
2017-07-11 11:22:36 +00:00
85c9b3b5c1 finish(?) implementing YellowFin 2017-07-03 09:48:22 +00:00
c41700ab8d add momentum with gradient clipping
i may refactor out clipping later,
but it's too nice not have right now.
2017-07-03 09:44:16 +00:00
6a3f047ddc rename alpha to lr where applicable 2017-07-02 05:39:51 +00:00
9706aaabbb add WIP YellowFin optimizer implementation 2017-07-02 02:55:19 +00:00
22dc651cce move lament into core 2017-07-01 02:22:34 +00:00
7da93e93a8 move graph printing into Model class 2017-07-01 02:17:46 +00:00
69786b40a1 begin work on multiple input/output nodes 2017-07-01 00:44:56 +00:00
a7c4bdaa2e remove dead line and punctuate comment 2017-06-30 21:13:37 +00:00
c02fba01e2 various
use updated filenames.
don't use emnist by default.
tweak expando integer handling.
add some comments.
2017-06-26 00:16:51 +00:00
a770444199 shorten names 2017-06-25 22:08:07 +00:00
Renamed from optim_nn.py (Browse further)