Mohit KumarSep 5, 20205 min readMeditating with Microprocessors Series: Part-1: AI based hardware (Microprocessor) tuningThe catch is that the deeper they go into sleep states, the more is the time they take to come back to full awareness to execute instruction
Mohit KumarAug 28, 20194 min readRNN Series:LSTM internals:Part-3: The Backward PropagationIntroduction In this multi-part series, we look inside LSTM forward pass. If you haven’t already read it I suggest run through the...
Mohit KumarAug 26, 20193 min readRNN Series: LSTM internals: Part-2: The Forward passIntroduction In this multi-part series, we look inside LSTM forward pass. If you haven’t already read it I suggest run through the...
Mohit KumarAug 26, 20195 min readRNN Series: LSTM internals: Part-1: The Big PictureIntroduction LSTMs today are cool. Everything, well almost everything, in the modern Deep Learning landscape is made of LSTMs. I know...
Mohit KumarAug 24, 20193 min readSoftmax and Cross-entropyIntroduction This is a loss calculating function post the yhat(predicted value) that measures the difference between Labels and predicted...
Mohit KumarAug 24, 20194 min readSoftmax and its Gradient Softmax, why its chosen, its gradient, its relationship with cross-entropy loss and the combined gradient. In this article, I “dumb” it down
Mohit KumarJul 31, 20195 min readIntroduction: Why another technical blog?Artificial Intelligence especially deep learning employs extremely complex models. Complexity stems from two major sources. Firstly,...