 Connor Olding
|
96dfc904b1
|
add ISRLU activation
needs testing
|
2020-03-17 07:27:03 -07:00 |
|
|
Connor Olding
|
0aba113cb7
|
update comments
|
2019-03-22 12:52:44 +01:00 |
|
|
Connor Olding
|
2cfcc9062e
|
use the constant recommended by the paper
|
2019-02-06 18:41:55 +01:00 |
|
|
Connor Olding
|
bd07d983be
|
add polynomial features layer
|
2019-02-05 04:13:56 +01:00 |
|
|
Connor Olding
|
1e6887cdbd
|
comment on Softmax alpha term
|
2019-02-03 14:31:34 +01:00 |
|
|
Connor Olding
|
c6ebd02ea9
|
comply to PEP 8
|
2018-03-24 06:26:02 +01:00 |
|
|
Connor Olding
|
a685db1489
|
add exact GELU activation
|
2018-03-22 12:02:17 +01:00 |
|
|
Connor Olding
|
7161f983ab
|
fix __name__ being incorrect due to extra __all__
this fixes tracebacks and checks for __main__,
among other things.
|
2018-03-17 14:09:15 +01:00 |
|
|
Connor Olding
|
b74e0941dc
|
fix Swish inits
|
2018-03-12 02:17:28 +01:00 |
|
|
Connor Olding
|
bd1e80b8de
|
activation layers inherit a dummy class
|
2018-03-11 22:34:46 +01:00 |
|
|
Connor Olding
|
cb4e6d3725
|
add Swish and SiLU activations
|
2018-03-11 03:34:00 +01:00 |
|
|
Connor Olding
|
91cdea3b26
|
fix inequalities in HardClip
oldest trick in the book
|
2018-03-10 05:03:26 +01:00 |
|
|
Connor Olding
|
4746103978
|
add HardClip activation layer
|
2018-03-08 02:40:42 +01:00 |
|
|
Connor Olding
|
0641c747c9
|
add Arcsinh activation
|
2018-03-07 01:29:48 +01:00 |
|
|
Connor Olding
|
169303813d
|
basic PEP 8 compliance
rip readability
|
2018-01-22 19:40:36 +00:00 |
|
|
Connor Olding
|
c81ce0afbb
|
rename stuff and add a couple missing imports
|
2018-01-21 22:16:36 +00:00 |
|
|
Connor Olding
|
bbdb91fcb1
|
merge and split modules into a package
|
2018-01-21 22:07:57 +00:00 |
|