Skip to main content
 

@Bizarro1303 I think the definition (both then and now) is that set forward by Claude Shannon in 1948 in "A Mathematical Theory of Communication". Shannon was an early colleague of N. Weiner who pioneered the version Kolmogorov references.
http://math.harvard.edu/~ctm/home/text/others/shannon/entropy/entropy.pdf