Commit graph

33 commits

Author SHA1 Message Date
18e4376aae add normalizing and no-biasing features to DenseBroadcast 2018-06-24 12:18:30 +02:00
7bb9c79367 allow Dense layers without biasing 2018-06-13 01:02:41 +02:00
7cecd57d05 tweak inits and norm_in for variances of 1 2018-06-12 23:39:13 +02:00
0d28db0fc4 allow division of input size in Dense layers 2018-06-12 05:37:35 +02:00
6c554e0f49 use local in LayerNorm 2018-06-12 05:36:57 +02:00
771650613c move dot_mv to nn 2018-06-10 16:34:20 +02:00
d6cc49cde1 fix learning without negate_trials 2018-06-09 18:56:10 +02:00
2b4bffb401 add Reshape and DenseBroadcast layers 2018-06-09 16:17:52 +02:00
ae331ce60b remove remnants of backwards pass 2018-06-09 15:24:12 +02:00
374fa4d876 cleanup 2018-06-08 02:45:07 +02:00
9c8c1ccd0c add tanh activation 2018-05-14 08:27:20 +02:00
ec19774af5 localize a couple more things 2018-05-12 23:08:00 +02:00
a836314b8b refactor game and utility functions 2018-05-12 22:44:53 +02:00
7f34de8e7c add cosine activation 2018-05-12 21:51:00 +02:00
deb1ea7de0 add LayerNorm layer 2018-05-07 05:55:58 +02:00
c7c657513e fix softmax 2018-05-03 16:48:12 +02:00
b453438055 add graycode-like distribution option 2018-05-03 16:48:12 +02:00
bb44d6696e remove backprop code 2018-03-26 16:33:23 +02:00
d384635000 select outputs from array instead of binary combinations 2017-09-08 10:43:32 +00:00
88dcd203a1 tweaks and fixes 2017-09-08 10:40:19 +00:00
5a8c0f6140 add graphviz printing and stuff 2017-09-07 23:06:43 +00:00
acc8378980 add and utilize Merge and Embed layers 2017-09-07 23:06:30 +00:00
3b4e195ae6 add frameskip 2017-09-07 21:20:53 +00:00
3d64df0574 preliminary batches and backwards passes
also adds negated noise trials because i forgot to commit that earlier
2017-09-07 19:18:11 +00:00
3e3b4d9207 looking forwards 2017-09-07 19:12:58 +00:00
db603753f4 support multiple nodal inputs 2017-09-07 19:09:44 +00:00
2d4ce31c7e organization etc. 2017-09-07 19:07:26 +00:00
16b38a7151 improve node traversal and export more stuff 2017-09-07 19:04:36 +00:00
693eeb991e various 2017-07-06 03:26:27 +00:00
9017af0d13 various work 2017-06-29 09:50:33 +00:00
e2d29352c4 basic learning 2017-06-29 04:51:02 +00:00
75ad46bfe9 2017-06-28 17:14:56 -07:00
29f3c278ea 2017-06-28 02:33:18 -07:00