Posts by Ramil (148)

Human Interactions are Hard!

It's never clear what the right thing to say is, at the moment, especially, when your words can and will be used against you . Stress, man, stress! On a different note, raML project (yeap, what an awesome name) is going great! Here is a sigmoid trained with MSE. Yeah, yeah, I shouldn't use MSE for logistic, but that's not the point! Update: Alright, fine! To all the (non-existing) haters, I've added the CrossEntropy Loss. Kids, the demo below is why you should use appropriate loss function. We can see that MSE after 100k epochs is as good as CrossEntropy after 10k! Woah, that's cool! (Note to skeptics: yes, I've also compared both at 10k and MSE is much worse. Note to skeptics^2: yes, all initial conditions were the same, stop doubting!)

Yay

The ML framework is coming along! Thinking deeply and carefully about all of the involved math and cs. Looking really good so far! Wrote the Dense layer, the logic for forward, and backpropagation. Next up: activation functions and better cost functions! Oh, and of course, since I have the generalized Dense layer coded, I'm gonna write the Sequential model wrapper. NO, I'M NOT STEALING FROM KERAS. This is a screenshot of me training a simple Linear Regression.

Weekly Updates

This week was pretty fun! Talked to a lot of super-smart people with and without credentials. Makes me miss the university life. If *unspoken* things go well, will be starting the next big life chapter. Hopefully :) Side project: building ML framework from scratch is actually pretty interesting! Linear algebra plus vectorization and broadcasting. Definitely going to keep going with it

Visual Studio Code

Found another reason to LOVE VS - you can run jupyter notebooks within it. Woah

Near Future Goal

Haven't done ML in a while, so I thought it would be nice to go over Andrew Ng's courses and maybe develop my own ML framework ¯\_(ツ)_/¯ Sep 16 update: going pretty good so far! I've implemented the first dense layer and did the first simple linear regression. Yay.

1 ... 15 16 17 ... 30