Commit graph

28 commits

Author SHA1 Message Date
94f27d6f2a add Adadelta optimizer 2019-02-03 14:30:47 +01:00
f60535aa01 generalize Adam-like optimizers 2019-02-03 14:30:03 +01:00
c6ebd02ea9 comply to PEP 8 2018-03-24 06:26:02 +01:00
a685db1489 add exact GELU activation 2018-03-22 12:02:17 +01:00
7161f983ab fix __name__ being incorrect due to extra __all__
this fixes tracebacks and checks for __main__,
among other things.
2018-03-17 14:09:15 +01:00
ec71d4956e fix module leaking for real 2018-03-13 03:27:11 +01:00
843524b80a move ActivityRegularizer to regularizer.py 2018-03-13 02:34:44 +01:00
b74e0941dc fix Swish inits 2018-03-12 02:17:28 +01:00
bd1e80b8de activation layers inherit a dummy class 2018-03-11 22:34:46 +01:00
cb4e6d3725 add Swish and SiLU activations 2018-03-11 03:34:00 +01:00
91cdea3b26 fix inequalities in HardClip
oldest trick in the book
2018-03-10 05:03:26 +01:00
a6519f5455 improve notes on dependencies 2018-03-09 10:17:31 +01:00
bd4f2a9478 fix missing import for ActivityRegularizer 2018-03-09 10:09:50 +01:00
9a45b26b7f add rough stratified k-folding utility class 2018-03-08 02:41:45 +01:00
65bc9b8a6f optionally allow gradients to passthru Input layer 2018-03-08 02:40:56 +01:00
4746103978 add HardClip activation layer 2018-03-08 02:40:42 +01:00
44cae4ad50 add LookupLearner 2018-03-07 01:58:17 +01:00
8abbb1e713 add NoiseInjector and NoiseMultiplier layers 2018-03-07 01:54:48 +01:00
604ffb9fa1 add variant of L1L2 regularization using averages 2018-03-07 01:53:40 +01:00
713fd2adbe add experimental soft-clipped optimizers 2018-03-07 01:52:26 +01:00
3aa3b70a9f add AMSgrad optimizer 2018-03-07 01:30:04 +01:00
0641c747c9 add Arcsinh activation 2018-03-07 01:29:48 +01:00
8ce2ec1ad4 add missing import 2018-02-10 11:28:43 +01:00
39bbf27860 add onehot utility function 2018-02-02 08:52:32 +01:00
e7783188bb tweak float exports 2018-02-02 08:51:39 +01:00
169303813d basic PEP 8 compliance
rip readability
2018-01-22 19:40:36 +00:00
c81ce0afbb rename stuff and add a couple missing imports 2018-01-21 22:16:36 +00:00
bbdb91fcb1 merge and split modules into a package 2018-01-21 22:07:57 +00:00