 Connor Olding
|
c92082e07a
|
fix momentum quantity in Neumann optimizer
|
2019-02-17 07:47:05 +01:00 |
|
|
Connor Olding
|
5a07cdac32
|
add mixup variant of batchize
|
2019-02-11 20:30:31 +01:00 |
|
|
Connor Olding
|
2cfcc9062e
|
use the constant recommended by the paper
|
2019-02-06 18:41:55 +01:00 |
|
|
Connor Olding
|
594483c6d4
|
correct "frequency" to "period"
|
2019-02-06 18:41:38 +01:00 |
|
|
Connor Olding
|
50e0311051
|
allow passing model through Ritual init
|
2019-02-05 22:16:46 +01:00 |
|
|
Connor Olding
|
fd2fc4bd76
|
begin rewriting Ritual
|
2019-02-05 06:09:35 +01:00 |
|
|
Connor Olding
|
2c921d34c2
|
add Yogi optimizer
|
2019-02-05 04:19:48 +01:00 |
|
|
Connor Olding
|
7deaa3c3f6
|
reword some comments
|
2019-02-05 04:19:14 +01:00 |
|
|
Connor Olding
|
7227559912
|
reset learning rates in optimizers
|
2019-02-05 04:15:28 +01:00 |
|
|
Connor Olding
|
bd07d983be
|
add polynomial features layer
|
2019-02-05 04:13:56 +01:00 |
|
|
Connor Olding
|
54ea41711b
|
refactor gradient filtering
|
2019-02-03 15:10:43 +01:00 |
|
|
Connor Olding
|
0d28882ef0
|
remove YellowFin because it's not worth maintaining
|
2019-02-03 15:03:03 +01:00 |
|
|
Connor Olding
|
5fd2b7b546
|
remove old versions of optimizers
|
2019-02-03 14:43:04 +01:00 |
|
|
Connor Olding
|
1e6887cdbd
|
comment on Softmax alpha term
|
2019-02-03 14:31:34 +01:00 |
|
|
Connor Olding
|
b8c40d2e2f
|
rewrite some comments
|
2019-02-03 14:30:58 +01:00 |
|
|
Connor Olding
|
94f27d6f2a
|
add Adadelta optimizer
|
2019-02-03 14:30:47 +01:00 |
|
|
Connor Olding
|
f60535aa01
|
generalize Adam-like optimizers
|
2019-02-03 14:30:03 +01:00 |
|
|
Connor Olding
|
c6ebd02ea9
|
comply to PEP 8
|
2018-03-24 06:26:02 +01:00 |
|
|
Connor Olding
|
a685db1489
|
add exact GELU activation
|
2018-03-22 12:02:17 +01:00 |
|
|
Connor Olding
|
7161f983ab
|
fix __name__ being incorrect due to extra __all__
this fixes tracebacks and checks for __main__,
among other things.
|
2018-03-17 14:09:15 +01:00 |
|
|
Connor Olding
|
ec71d4956e
|
fix module leaking for real
|
2018-03-13 03:27:11 +01:00 |
|
|
Connor Olding
|
843524b80a
|
move ActivityRegularizer to regularizer.py
|
2018-03-13 02:34:44 +01:00 |
|
|
Connor Olding
|
b74e0941dc
|
fix Swish inits
|
2018-03-12 02:17:28 +01:00 |
|
|
Connor Olding
|
bd1e80b8de
|
activation layers inherit a dummy class
|
2018-03-11 22:34:46 +01:00 |
|
|
Connor Olding
|
cb4e6d3725
|
add Swish and SiLU activations
|
2018-03-11 03:34:00 +01:00 |
|
|
Connor Olding
|
91cdea3b26
|
fix inequalities in HardClip
oldest trick in the book
|
2018-03-10 05:03:26 +01:00 |
|
|
Connor Olding
|
a6519f5455
|
improve notes on dependencies
|
2018-03-09 10:17:31 +01:00 |
|
|
Connor Olding
|
bd4f2a9478
|
fix missing import for ActivityRegularizer
|
2018-03-09 10:09:50 +01:00 |
|
|
Connor Olding
|
9a45b26b7f
|
add rough stratified k-folding utility class
|
2018-03-08 02:41:45 +01:00 |
|
|
Connor Olding
|
65bc9b8a6f
|
optionally allow gradients to passthru Input layer
|
2018-03-08 02:40:56 +01:00 |
|
|
Connor Olding
|
4746103978
|
add HardClip activation layer
|
2018-03-08 02:40:42 +01:00 |
|
|
Connor Olding
|
44cae4ad50
|
add LookupLearner
|
2018-03-07 01:58:17 +01:00 |
|
|
Connor Olding
|
8abbb1e713
|
add NoiseInjector and NoiseMultiplier layers
|
2018-03-07 01:54:48 +01:00 |
|
|
Connor Olding
|
604ffb9fa1
|
add variant of L1L2 regularization using averages
|
2018-03-07 01:53:40 +01:00 |
|
|
Connor Olding
|
713fd2adbe
|
add experimental soft-clipped optimizers
|
2018-03-07 01:52:26 +01:00 |
|
|
Connor Olding
|
3aa3b70a9f
|
add AMSgrad optimizer
|
2018-03-07 01:30:04 +01:00 |
|
|
Connor Olding
|
0641c747c9
|
add Arcsinh activation
|
2018-03-07 01:29:48 +01:00 |
|
|
Connor Olding
|
8ce2ec1ad4
|
add missing import
|
2018-02-10 11:28:43 +01:00 |
|
|
Connor Olding
|
39bbf27860
|
add onehot utility function
|
2018-02-02 08:52:32 +01:00 |
|
|
Connor Olding
|
e7783188bb
|
tweak float exports
|
2018-02-02 08:51:39 +01:00 |
|
|
Connor Olding
|
169303813d
|
basic PEP 8 compliance
rip readability
|
2018-01-22 19:40:36 +00:00 |
|
|
Connor Olding
|
c81ce0afbb
|
rename stuff and add a couple missing imports
|
2018-01-21 22:16:36 +00:00 |
|
|
Connor Olding
|
bbdb91fcb1
|
merge and split modules into a package
|
2018-01-21 22:07:57 +00:00 |
|
|
Connor Olding
|
db65fbdd62
|
add Neumann optimizer
|
2018-01-12 15:42:04 +00:00 |
|
|
Connor Olding
|
1ebb897f14
|
use @ operator
|
2017-10-19 04:12:16 +00:00 |
|
|
Connor Olding
|
a85ee67780
|
allow CLRs to use optimizer's learning rate
|
2017-10-19 04:03:44 +00:00 |
|
|
Connor Olding
|
763246df98
|
add RMSpropCentered to model from config
|
2017-09-26 23:12:40 +00:00 |
|
|
Connor Olding
|
9bb26b1ec5
|
add Huber loss
|
2017-09-25 16:37:52 +00:00 |
|
|
Connor Olding
|
eb16377ba6
|
add Adagrad optimizer
|
2017-09-25 16:06:45 +00:00 |
|
|
Connor Olding
|
c964f143d2
|
not true
|
2017-09-25 07:12:19 +00:00 |
|