raML - Next Actual Milestone
So yesterday I've decided to try and write raML's model for the famous MNIST dataset. So I added one-hot encoding, generalized some cost functions, and just ran it as it is. So since I don't have categorical_crossentropy implemented, I just used MSE for now. And since I don't have batches, the model actually took quite some time to train (a couple of minutes), which I wasn't happy about. So today's goals are: 1. Time Profiling 2. Softmax 3. Categorical crossentropy 4. Batches Progress Did time profiling, everything actually seems very reasonable besides data download (on a slow side) and training (because of lack of batches) Added softmax (but still testing). Vectorized derivatives !! Added caching for the datasets! Wow!