• Today we talked about LLN and CLT with an application in Monte Carlo integration. The half of the lecture focused on information theory, and we discussed relative entropy, and mutual information.

  • Next time, we will finish information theory after discussing some properties of entropy, relative entropy, and mutual information.