Posts by Ramil (142)

Ramil 2020-10-08

Where To Begin

Opening the next chapter in my life, starting next week I'll be working as a Data Scientist in Event Dynamic. This is going to be awesome! The team is super talented. Let's see how it works out :) I don't remember where I got it from, but someone smart once said that things that happen in our lives are the result of our habits 2 years ago. Now, the 2-year period is subjective (it's probably closer to 6 months), but the main point is the existence of the delay between the present and the past. Your hard work won't have an immediate effect, but nor will the laziness.

Ramil 2020-10-05

raML - Back at it!

Progress Couple of days later Finally got to implementing mini batches to enable fast training. Was observing very strange behavior, only later realized I forgot to change Sigmoid to Identity activation in the output layer, so no wonder the model didn't exactly give good predictions for housing prices :P Anyway, after fixing some things, here is a mini batch training of the mnist dataset ("but Ramil, it doesn't make sense to use MSE here", yes, yes, but I don't have Softmax implemented correctly yet). So this is the fitting going once through all data with 32 sized batches. The good thing is that it seems noisy, as it should be. Reminder to future me: Next major goal to speed things up is to write convolutions.

Ramil 2020-10-03

Life Update

As the saying goes, life happens all at once (is it even a saying actually?). Anyway, brain CPU is loaded thinking about many different things that will impact me and my family. So, unfortunately, raML is put on a short hold. However good news, it now has a logo :) because it got the point when it's not worth being included in the Development section of the website. Philosophy/Psychology. Saying no isn't easy. Often, we are either overly excited or are too scared to make rational decisions, but it's important to try and get rid of as much of the human bias as possible. I can't remember the last time when my initial reaction matched what I ended up doing after doing some sober thinking. On the other hand, there are times when the most rational thing to do is to act spontaneously and grab the opportunity by what seems to be its tail. And yeah, you will be grabbing a lot of things that aren't tails at all, but you have to train yourself to recognize when a rushed decision is necessary. Sounds like a contradiction? Basically the rule is - default to making sober decision, but train your spider sense to know when it's not possible.

Ramil 2020-09-30

raML - Next Actual Milestone

So yesterday I've decided to try and write raML's model for the famous MNIST dataset. So I added one-hot encoding, generalized some cost functions, and just ran it as it is. So since I don't have categorical_crossentropy implemented, I just used MSE for now. And since I don't have batches, the model actually took quite some time to train (a couple of minutes), which I wasn't happy about. So today's goals are: 1. Time Profiling 2. Softmax 3. Categorical crossentropy 4. Batches Progress Did time profiling, everything actually seems very reasonable besides data download (on a slow side) and training (because of lack of batches) Added softmax (but still testing). Vectorized derivatives !! Added caching for the datasets! Wow!

Ramil 2020-09-28

raML - Goals Update

Big: 1. Optimizers 2. Kernel Weight Regularization 3. Validation 4. Lambda Layer (harder to do efficiently than I thought, might need to use sympy) Medium: 1. PyPi Update: Restructured raML as a package - can (almost) pip install it now :) Oh man, that looks nice! Update 2: Done with basic Validation. Added (smart) dataset splitting, validation and validation plots

1 ... 12 13 14 ... 29