Response to Quora Question: Are there any popular science books on information theory?
There are a small handful that may meet your requirements:
Information, Entropy, Life and the Universe: What We Know and What We Do Not Know by Arieh Ben-Naim
http:/
An Introduction to Information Theory: Symbols, Signals and Noise by John R. Pierce
http:/
The Information: A History, A Theory, A Flood by James Gleick
http:/
Decoding the Universe: How the New Science of Information Is Explaining Everything in the Cosmos, from Our Brains to Black Holes by Charles Seife
http:/
Complexity: A Guided Tour by Melanie Mitchell
http:/
Programming the Universe: A Quantum Computer Scientist Takes on the Cosmos by Seth Lloyd
http:/
The Mathematical Theory of Communication by Claude E. Shannon and Warren Weaver
http:/
The Ben-Naim book is coming out at the end of May, and is probably the best popular science book on the topic that you're likely to find (I've read most of an early draft). Following that it's still very hard to beat Pierce's presentation all these years later. Seife wasn't too bad while Gleick comes at things from the most broad viewpoint and covers more history than anything else. Lloyd's book mentions it tangentially. Mitchell's book is excellent, and though it only has one chapter on information theory, some of the other areas it covers are tangential to the subject and very interesting in their own right.
Finally, after Ben-Naim and Robinson, I'd really recommend the UofI Press edition of Shannon/Weaver. Though you can get a copy of Shannon's paper for free online, the introduction by Warren Weaver is really excellent (and similar to Robinson's presentation) and then one can delve into a bit of Shannon's actual math, which isn't too difficult and should be able to be followed by most reasonable high school students. Shannon's text is the only one I've listed that has any mathematical equations, but the Weaver half of the book is certainly a popular science presentation without any math.
[1503.02776] The Emergence of Life as a First Order Phase Transition
We demonstrate a phase transition from non-life to life, defined as non-replicating and replicating systems respectively, and characterize some of its dynamical properties. The transition is first order and demonstrates many characteristics one might expect from a newly emergent biosphere. During the phase transition the system experiences an explosive growth in diversity, with restructuring of both the extant replicator population and the environment. The observed dynamics have a natural information-theoretic interpretation, where the probability for the transition to occur depends on the mutual information shared between replicators and environment. Through the transition, the system undergoes a series of symmetry breaking transitions whereby the information content of replicators becomes increasingly distinct from that of their environment. Thus, the replicators that nucleate the transition in the non-life phase are often not those which are ultimately selected in the life phase. We discuss the implications of these results for understanding the emergence of life, and natural selection more broadly.
#arXiv, #itbio
Interestingly, Erwin Schrödinger's seminal paper "What is Life?" came out in 1944, almost contemporaneously with the creation of information theory in 1948. Unbeknownst to most Claude Shannon's (the researcher who created the field of information theory and whose Masters thesis literally launched the digital revolution) Ph.D. thesis (1940) was entitled: "An Algebra for Theoretical Genetics," so he could certainly be said to be the god-father of the entire area.
Since then, certainly dozens of researchers have looked at the potential of using information theory to create a better hard core definition of what life really is (certainly the place where any self-respecting Platonist would begin.)
One of the best definitions and frameworks I've seen thus far has to be that of Christoph Adami. To start, and depending on your level of sophistication, take a look at his recent arXiv paper (Information-theoretic considerations concerning the origin of life - http:/
For further references, I maintain a nice list of resources at Information Theory and Biology Resources (http:/
If you really want to blow the top off of your definitions, you might also consider taking a much broader look at the universe (a distant reading, so-to-speak) and read through David Christian's conceptualization (Maps of Time: An Introduction to Big History: David Christian, William H. McNeill http:/