 Connor Olding
|
db65fbdd62
|
add Neumann optimizer
|
2018-01-12 15:42:04 +00:00 |
|
|
Connor Olding
|
1ebb897f14
|
use @ operator
|
2017-10-19 04:12:16 +00:00 |
|
|
Connor Olding
|
763246df98
|
add RMSpropCentered to model from config
|
2017-09-26 23:12:40 +00:00 |
|
|
Connor Olding
|
9bb26b1ec5
|
add Huber loss
|
2017-09-25 16:37:52 +00:00 |
|
|
Connor Olding
|
eb16377ba6
|
add Adagrad optimizer
|
2017-09-25 16:06:45 +00:00 |
|
|
Connor Olding
|
615f43c550
|
support AddSign and PowerSign in config
|
2017-09-25 06:09:36 +00:00 |
|
|
Connor Olding
|
fe54002671
|
remove DumbLearner
|
2017-09-25 06:09:07 +00:00 |
|
|
Connor Olding
|
9a7ffe5f0d
|
add AddSign and PowerSign optimizers
|
2017-09-25 04:02:17 +00:00 |
|
|
Connor Olding
|
dcbaef3032
|
use MomentumClip in warmup for stability
|
2017-09-16 17:30:52 +00:00 |
|
|
Connor Olding
|
e22316a4c9
|
move losses into Model and refactor methods
|
2017-09-16 17:05:25 +00:00 |
|
|
Connor Olding
|
910facf98d
|
move NLL to core
|
2017-08-05 10:59:05 +00:00 |
|
|
Connor Olding
|
de5af4f7f4
|
allow argument passthru to normalizer in _mr_make_norm
|
2017-08-05 10:40:39 +00:00 |
|
|
Connor Olding
|
957ee86e20
|
add PolyLearner: polynomial learning scheduler
|
2017-08-05 10:40:06 +00:00 |
|
|
Connor Olding
|
cc89465adc
|
tweak comment
|
2017-08-05 10:39:59 +00:00 |
|
|
Connor Olding
|
2e74c9160c
|
tweak CubicGB defaults
|
2017-08-03 03:39:25 +00:00 |
|
|
Connor Olding
|
001a997e09
|
correction: batches, not epochs.
|
2017-08-03 03:38:07 +00:00 |
|
|
Connor Olding
|
049d966710
|
remove biasing from Conv1Dper in favor of Bias layer
|
2017-08-02 11:30:08 +00:00 |
|
|
Connor Olding
|
f507dc10f8
|
remove DenseOneLess
not useful.
|
2017-08-02 10:52:26 +00:00 |
|
|
Connor Olding
|
4d2251f69f
|
allow weight sharing; disableable gradient clearing
|
2017-08-02 10:29:58 +00:00 |
|
|
Connor Olding
|
89fcd25962
|
fix wording
|
2017-08-02 07:00:33 +00:00 |
|
|
Connor Olding
|
e4fa5bf63f
|
add positional control to convolution
|
2017-08-02 06:47:37 +00:00 |
|
|
Connor Olding
|
5074dcb2aa
|
add Decimate and Undecimate layers
|
2017-08-02 06:47:15 +00:00 |
|
|
Connor Olding
|
8b3b8d8288
|
add rough 1D circular convolution
|
2017-08-02 03:58:24 +00:00 |
|
|
Connor Olding
|
5d9efa71c1
|
move SquaredHalved to core
|
2017-07-25 22:14:17 +00:00 |
|
|
Connor Olding
|
e5fd937ef6
|
remove cruft from YellowFin
i might just remove YellowFin itself because it isn't working for me.
|
2017-07-25 21:38:09 +00:00 |
|
|
Connor Olding
|
5183cd38f8
|
add GB output layers for classification
|
2017-07-23 03:55:19 +00:00 |
|
|
Connor Olding
|
ee83ffa88e
|
add debug mode to MomentumClip to print norms
|
2017-07-23 03:54:37 +00:00 |
|
|
Connor Olding
|
b20a34c2de
|
fix MomentumClip with nesterov enabled
|
2017-07-22 05:05:29 +00:00 |
|
|
Connor Olding
|
217a19110a
|
fix case when no callbacks are given
|
2017-07-21 19:45:34 +00:00 |
|
|
Connor Olding
|
4a108a10ae
|
allow MomentumClip, SineCLR, WaveCLR in config
|
2017-07-21 19:43:57 +00:00 |
|
|
Connor Olding
|
928850c2a8
|
lower process priority
|
2017-07-11 12:44:26 +00:00 |
|
|
Connor Olding
|
112e263056
|
fix code i forgot to test, plus some tweaks
|
2017-07-11 11:36:11 +00:00 |
|
|
Connor Olding
|
e145f0422f
|
more YellowFin bullshit
i give up on this optimizer. its design is flawed.
|
2017-07-11 11:22:36 +00:00 |
|
|
Connor Olding
|
85c9b3b5c1
|
finish(?) implementing YellowFin
|
2017-07-03 09:48:22 +00:00 |
|
|
Connor Olding
|
c41700ab8d
|
add momentum with gradient clipping
i may refactor out clipping later,
but it's too nice not have right now.
|
2017-07-03 09:44:16 +00:00 |
|
|
Connor Olding
|
6a3f047ddc
|
rename alpha to lr where applicable
|
2017-07-02 05:39:51 +00:00 |
|
|
Connor Olding
|
9706aaabbb
|
add WIP YellowFin optimizer implementation
|
2017-07-02 02:55:19 +00:00 |
|
|
Connor Olding
|
22dc651cce
|
move lament into core
|
2017-07-01 02:22:34 +00:00 |
|
|
Connor Olding
|
7da93e93a8
|
move graph printing into Model class
|
2017-07-01 02:17:46 +00:00 |
|
|
Connor Olding
|
69786b40a1
|
begin work on multiple input/output nodes
|
2017-07-01 00:44:56 +00:00 |
|
|
Connor Olding
|
a7c4bdaa2e
|
remove dead line and punctuate comment
|
2017-06-30 21:13:37 +00:00 |
|
|
Connor Olding
|
c02fba01e2
|
various
use updated filenames.
don't use emnist by default.
tweak expando integer handling.
add some comments.
|
2017-06-26 00:16:51 +00:00 |
|
|
Connor Olding
|
a770444199
|
shorten names
|
2017-06-25 22:08:07 +00:00 |
|