Commit Graph

23 Commits

Author SHA1 Message Date
Connor Olding ec71d4956e fix module leaking for real 2018-03-13 03:27:11 +01:00
Connor Olding 843524b80a move ActivityRegularizer to regularizer.py 2018-03-13 02:34:44 +01:00
Connor Olding b74e0941dc fix Swish inits 2018-03-12 02:17:28 +01:00
Connor Olding bd1e80b8de activation layers inherit a dummy class 2018-03-11 22:34:46 +01:00
Connor Olding cb4e6d3725 add Swish and SiLU activations 2018-03-11 03:34:00 +01:00
Connor Olding 91cdea3b26 fix inequalities in HardClip
oldest trick in the book
2018-03-10 05:03:26 +01:00
Connor Olding a6519f5455 improve notes on dependencies 2018-03-09 10:17:31 +01:00
Connor Olding bd4f2a9478 fix missing import for ActivityRegularizer 2018-03-09 10:09:50 +01:00
Connor Olding 9a45b26b7f add rough stratified k-folding utility class 2018-03-08 02:41:45 +01:00
Connor Olding 65bc9b8a6f optionally allow gradients to passthru Input layer 2018-03-08 02:40:56 +01:00
Connor Olding 4746103978 add HardClip activation layer 2018-03-08 02:40:42 +01:00
Connor Olding 44cae4ad50 add LookupLearner 2018-03-07 01:58:17 +01:00
Connor Olding 8abbb1e713 add NoiseInjector and NoiseMultiplier layers 2018-03-07 01:54:48 +01:00
Connor Olding 604ffb9fa1 add variant of L1L2 regularization using averages 2018-03-07 01:53:40 +01:00
Connor Olding 713fd2adbe add experimental soft-clipped optimizers 2018-03-07 01:52:26 +01:00
Connor Olding 3aa3b70a9f add AMSgrad optimizer 2018-03-07 01:30:04 +01:00
Connor Olding 0641c747c9 add Arcsinh activation 2018-03-07 01:29:48 +01:00
Connor Olding 8ce2ec1ad4 add missing import 2018-02-10 11:28:43 +01:00
Connor Olding 39bbf27860 add onehot utility function 2018-02-02 08:52:32 +01:00
Connor Olding e7783188bb tweak float exports 2018-02-02 08:51:39 +01:00
Connor Olding 169303813d basic PEP 8 compliance
rip readability
2018-01-22 19:40:36 +00:00
Connor Olding c81ce0afbb rename stuff and add a couple missing imports 2018-01-21 22:16:36 +00:00
Connor Olding bbdb91fcb1 merge and split modules into a package 2018-01-21 22:07:57 +00:00