Recently I’ve been looking into model compression, and the next few posts will look into the SoTA for that area of research. In this post I will cover some general topics such as what is model compression and how I think when I look at it. What is model compression The subject of model compression …
Category: Uncategorised
Learning a discretized mixture of logits
I have been trying to wrap my head around the way PixelCNN++ is using discretized mixture of logistic distributions to sample pixels and could not find a single comprehensive source about it, so I wrote a blog post incorporating everything I learned along the way