Commit Graph

188 Commits

Author SHA1 Message Date
Connor Olding 9706aaabbb add WIP YellowFin optimizer implementation 2017-07-02 02:55:19 +00:00
Connor Olding d8bf6d1c5b easier logging of losses etc. 2017-07-02 02:53:31 +00:00
Connor Olding 1b1184480a allow optimizers to adjust their own learning rate 2017-07-02 02:52:07 +00:00
Connor Olding 22dc651cce move lament into core 2017-07-01 02:22:34 +00:00
Connor Olding 7da93e93a8 move graph printing into Model class 2017-07-01 02:17:46 +00:00
Connor Olding 1352de7006 merge the right commit this time 2017-07-01 01:15:16 +00:00
Connor Olding 69786b40a1 begin work on multiple input/output nodes 2017-07-01 00:44:56 +00:00
Connor Olding a530558fc1 begin support for multiple input/output layers 2017-06-30 21:51:26 +00:00
Connor Olding a7c4bdaa2e remove dead line and punctuate comment 2017-06-30 21:13:37 +00:00
Connor Olding a4c1c5c04c update readme 2017-06-26 01:49:46 +00:00
Connor Olding c02fba01e2 various
use updated filenames.
don't use emnist by default.
tweak expando integer handling.
add some comments.
2017-06-26 00:16:51 +00:00
Connor Olding a770444199 shorten names 2017-06-25 22:08:07 +00:00
Connor Olding 1a2a8702a0 add missing imports 2017-06-21 13:07:57 +00:00
Connor Olding c7193690c1 fix default ftml parameter 2017-06-21 12:31:41 +00:00
Connor Olding 5a4b3d2934 add Follow The Moving Leader optimizer 2017-06-21 12:20:27 +00:00
Connor Olding 9c0cbba3ff move epsilon out of square-root (big improvement) 2017-06-21 00:13:53 +00:00
Connor Olding 9b85b49ee5 add minimal example to readme 2017-06-18 01:58:40 +00:00
Connor Olding 264c3abd83 allow integer expando values 2017-06-18 01:58:34 +00:00
Connor Olding 35f380c5d0 rename broken variables 2017-06-17 23:41:02 +00:00
Connor Olding a4081606f7 shuffle by default 2017-06-17 17:12:59 +00:00
Connor Olding cf1b7c1c13 various parameter tweaks 2017-06-17 16:46:39 +00:00
Connor Olding e5cea3f847 add SELU stuff 2017-06-17 16:45:50 +00:00
Connor Olding 7e38f45a3f add cosine activation 2017-06-09 12:32:44 +00:00
Connor Olding d3c23912c1 add Softplus and LeCunTanh; use LeCunTanh 2017-04-23 18:58:33 +00:00
Connor Olding 0332c2662b reword readme 2017-04-12 05:23:07 +00:00
Connor Olding 5cb28eeef7 tweak and fix 2017-04-11 12:49:49 +00:00
Connor Olding c49e498aa0 add dropout and deterministic predictions 2017-04-11 10:39:42 +00:00
Connor Olding 9b730b0516 reorganize some code 2017-04-11 10:11:08 +00:00
Connor Olding 87ffa014ca update mnist example with new features 2017-04-11 04:48:53 +00:00
Connor Olding d08b5b91a1 convert target losses to log10 format 2017-04-11 04:47:30 +00:00
Connor Olding 904423d631 add saturating activity regularizer 2017-04-11 04:46:54 +00:00
Connor Olding b6597e8b6c fix SGDR restart iteration and add WaveCLR 2017-04-11 04:46:40 +00:00
Connor Olding a448ff3e8a add weight regularization 2017-04-10 14:36:08 +00:00
Connor Olding 0619163447 fix shape assertions 2017-04-10 10:34:58 +00:00
Connor Olding a78fc98215 greatly refactor weight handling 2017-04-10 10:08:41 +00:00
Connor Olding c3e2dd56bf refactor shape-handling a little 2017-04-10 08:26:38 +00:00
Connor Olding 1d729b98aa fix epoch incrementing 2017-03-22 21:41:24 +00:00
Connor Olding 19a9583da9 add generator-based training method 2017-03-22 18:41:50 +00:00
Connor Olding 53a7d92288 . 2017-03-19 05:11:38 +00:00
Connor e2b179b2e6 Create README.md 2017-03-14 03:10:47 -07:00
Connor Olding 3bbb556809 . 2017-03-12 23:42:21 -07:00
Connor Olding ec08ba7684 . 2017-03-12 17:41:28 -07:00
Connor Olding 0306b6f1e0 . 2017-03-12 03:53:14 -07:00
Connor Olding 205d64a8a0 . 2017-03-01 01:12:56 +00:00
Connor Olding 65fe5cad85 . 2017-02-28 00:36:04 +00:00
Connor Olding fcdb7e1918 . 2017-02-27 22:52:39 +00:00
Connor Olding a1b1daf3bf . 2017-02-27 22:48:49 +00:00
Connor Olding 547017a6fc . 2017-02-27 22:19:25 +00:00
Connor Olding 06eb28b23e . 2017-02-27 09:10:21 +00:00
Connor Olding 5f87c7a56b . 2017-02-27 02:43:51 +00:00