Claude Shannon's A mathematical theory of communication is an oft cited
classic in information theory. Let's dive in and try to tease apart the
"why"s that are often overlooked when people build on top of the introduced
theory. They are definitely things that I didn't consider to be obvious
without the benefit of reading the paper.