Human Interactions are Hard!
It's never clear what the right thing to say is, at the moment, especially, when your words can and will be used against you . Stress, man, stress! On a different note, raML project (yeap, what an awesome name) is going great! Here is a sigmoid trained with MSE. Yeah, yeah, I shouldn't use MSE for logistic, but that's not the point! Update: Alright, fine! To all the (non-existing) haters, I've added the CrossEntropy Loss. Kids, the demo below is why you should use appropriate loss function. We can see that MSE after 100k epochs is as good as CrossEntropy after 10k! Woah, that's cool! (Note to skeptics: yes, I've also compared both at 10k and MSE is much worse. Note to skeptics^2: yes, all initial conditions were the same, stop doubting!)