https://nzxhuong.github.io/enTue, 01 Apr 2025 18:02:06 GMTNikola (getnikola.com)http://blogs.law.harvard.edu/tech/rsshttps://nzxhuong.github.io/posts/understanding-shannon-information-and-entropy/Ngo Truong<div><p>Many materials on this topic start with Claude Shannon’s concept of information. So let’s start with that. <br> Information, in Shannon's theory, is defined in the context of transferring a message from a source (transmitter) to a receiver over a channel. Imagine tossing a coin. In this scenario, the coin toss outcome acts as the source (transmitter), and you, observing the outcome, are the receiver.</p> <p><a href="https://nzxhuong.github.io/posts/understanding-shannon-information-and-entropy/">Read more…</a> (1 min remaining to read)</p></div>entropyinformation theorymathjaxprobabilityhttps://nzxhuong.github.io/posts/understanding-shannon-information-and-entropy/Tue, 01 Apr 2025 17:11:30 GMT