Biomedical and Electrical Engineer with interests in information theory, evolution, genetics, abstract mathematics, microbiology, big history, IndieWeb, mnemonics, and the entertainment industry including: finance, distribution, representation
sslv3 handshake failure · Issue #16 · kylewm/KnownReactions https:/
## While trying to do this:
Like a [post ](http:/
## I encountered this error:
. In some simplified cases, epidemiological inference methods can estimate transmission trees [2], branching rates through time [5] and other aspects of epidemic spread [7]. However, none of these approaches is currently applicable if there is non-tree-like evolution, or where datasets are large. Furthermore, the range of models for which we can write down a tree likelihood is very limited. This raising nice new problems in probability, statistical inference and ecological modelling. Recently, more general processes (e.g. Lambda-coalescents, which allow multiple rather than strictly pairwise coalescent events) are beginning to be used to model populations with large offspring variance, or even to model selection in a non-parametric fashion [3]. This is potentially a powerful tool particularly for bacteria, which may acquire resistance to antibiotics and spread rapidly as a consequence, yielding both highly variable effective offspring numbers and a need to model selection carefully.
2. Understanding spaces of evolutionary trees: There are a large number of possible labelled, rooted binary trees for a given set of nn tips (ie for a given set of sequence data): (2n−3)!!=(2n−3)(2n−5)...(3)(1)(2n−3)!!=(2n−3)(2n−5)...(3)(1). This works out to 1018410184 trees on 100 tips; in contrast, current datasets for evolving bacteria contain thousands of tips. Not even the tools of Bayesian inference, the natural approach in such situations, can systematically explore spaces this big. This motivates the development of mathematical approaches for the exploration of tree space. These include new approaches to continuous tree spaces, including those from tropical geometry [8], and the use of tree metrics [1]. These in turn can lead to tools for averaging trees , and for navigating tree space in efficient ways [6] -- with profound applications in statistical inference from sequence data. Generalizing metrics to the case of evolutionary networks (for example tree-based networks) is another natural and important question.
3. Summarising trees and networks using combinatorial tools: Uncovering shape features, spectral features and other ways to describe trees using quantities that are mathematically tractable will be of considerable interest [4]. As one example, where likelihoods are truly intractable, rapid tools for likelihood-free inference can be used to infer evolutionary processes from sequence data, but only where there are informative ways to summarize key features of the data. Trees are natural combinatorial structures with connections to data; for example, a binary tree is a sequence of partitions of the set of tips (sequences in a dataset), where each partition is one block smaller than the previous one, moving back through time from the partition with each tip on its own to the partition with all tips in one block as we move from the tips of the tree to the root. If the tree is not binary (ie it allows multifurcations), more than two blocks can combine at a branching event. Because of the natural link to partitions, the study of tree shapes links to the enumeration of partitions and to lattice path combinatorics. These in turn allow the characterization and enumeration of possible tree shapes. Meanwhile the study of motifs in other biological networks has been fruitful, and could be extended to tree and evolutionary network shapes. Trees and evolutionary networks are of course also graphs (with an added time dimension); the tools of algebraic graph theory are now finding application in this area of mathematical biology.
The community's response to the idea for this workshop has been very positive. A * beside a participant's name indicates that they have expressed enthusiasm for the workshop, and plan to attend.
References [1] Louis J Billera, Susan P Holmes, and Karen Vogtmann. Geometry of the space of phylogenetic trees. Adv. Appl. Math., 27(4):733–767, November 2001. [2] Xavier Didelot, Jennifer Gardy, and Caroline Colijn. Bayesian inference of infectious disease transmission from whole-genome sequence data. Mol. Biol. Evol., 31(7):1869–1879, July 2014. [3] Alison M Etheridge, Robert C Griffiths, and Jesse E Taylor. A coalescent dual process in a moran model with genic selection, and the lambda coalescent limit. Theor. Popul. Biol., 78(2):77–92, September 2010. [4] Fanny Gascuel, Regis Ferriere, Robin Aguilee, and Amaury Lambert. How ecology and landscape dynamics shape phylogenetic trees. Syst. Biol., 64(4):590–607, July 2015. [5] Amaury Lambert and Tanja Stadler. Birth–death models and coalescent point processes: The shape and probability of reconstructed phylogenies. Theor. Popul. Biol., 90(0):113–128, December 2013. [6] Tom M W Nye. An algorithm for constructing principal geodesics in phylogenetic treespace. IEEE/ACM Trans. Comput. Biol. Bioinform., 11(2):304–315, March 2014. [7] David A Rasmussen, Erik M Volz, and Katia Koelle. Phylodynamic inference for structured epidemiological models. PLoS Comput. Biol., 10(4):e1003570, April 2014. 2 [8] David Speyer and Bernd Sturmfels. The tropical grassmannian. Adv. Geom., 4(3):389–411, 2004.
Some additional thoughts on information theory and complexity for models in ecology.
In addition to some of my commentary on <a href="http://biology.stackexchange.com/a/40555/6629">StackExchange</a>, I'll include a few additional thoughts which may be of help/assistance.
First for those who don't have the background, I <i>highly</i> recommend reading the two seminal papers on information theory and statistical mechanics by ET Jaynes and the standard text on information theory <i><a href="http://amzn.to/1NThEjd">Elements of Information Theory</a></i> by Thomas M. Cover and Joy A. Thomas.
In addition to the information theoretic related areas, you might want to take a look at the discipline of complexity theory, which has primarily grown out of the Santa Fe Institute over the past several decades and which includes information theory as part of its disciplines. If you're unfamiliar with the broader topic, Melanie Mitchell has an excellent overview with her book <i><a href="http://amzn.to/1YbcUZ4">Complexity: A Guided Tour</a></i>. Also related to complexity is the area of cellular automata which one could view as a very base model of more complex ecological systems. Here, perhaps Stephen Wolfram's <i><a href="http://amzn.to/1kwIAtM">A New Kind of Science</a></i> or <i><a href="http://amzn.to/1Ybd3Me">Cellular Automata and Complexity</a></i> will be enlightening. The broader theories coming out of these primarily mathematical areas may be useful to you.
In particular, given the types of models in ecosystems, I might suggest taking a look at some of the mathematical modeling going on at the intersection of complexity and economics. For a relatively simple introduction to this area, one could look at the relatively introductory text <i><a href="http://amzn.to/1kwJ6Ic">Complexity and the Economy</a></i> by W. Brian Arthur which is very interesting. The economy is essentially a very specific type of ecology dealing with human beings, assets, and the monetary system.
Another area which I've seen a lot of literature over the last few years is applicable to the ideas of resiliency and complexity in cities, for assisting in designing more robust city planning. This really isn't that far from the naturally evolving systems being looked at in ecology settings.
For those looking for researchers in the area of complexity, I have a <a href="https://twitter.com/ChrisAldrich/lists/complexity/members">list of many who are on twitter</a> in a variety of sub-areas. In addition to individuals, it also includes a number of institutes and related organizations as well.
I'd also suggest, that for the broadest theoretical setting, one could actually start with the topic known as "Big History" which takes the broadest approach of looking at history and the evolution of the cosmos over 13.7 billion years since the big bang. This conceptualization includes ideas like evolution, complexity, and emergence on the biggest scales, a set of theories that could be similarly applied to ecologies both large and small. For this viewpoint, I would suggest two works by David Christian including <i><a href="http://amzn.to/1kwJPJy">Maps of Time: An Introduction to Big History</a></i> and <i><a href="http://amzn.to/1YbdExx">Big History: The Big Bang, Life on Earth, and the Rise of Humanity</a></i>.
In essence, with many of these topics and viewpoints, one is treating individual animals or even entire species as elementary particles and then using the mathematical models of statistical thermodynamics to tease out specific types of data or trends. As layers of overlapping "particles" interact with each other, they cause emergent types properties, and then these resultant emergent properties combine to create further layers of emergent properties, none of which might have been necessarily deduced from the initial conditions. Within Big History, these types of emergence go from the big bang and basic particles in the early universe to the ultimate evolution of humankind by way of a variety of stages.
A general foothold into the overlap of maximum entropy methods and biology:
John Harte's work on applying the mathematical theory of maximum entropy to ecology is certainly one of the better known examples of the application of this area of mathematics to science, in part because he literally wrote the textbook: [Maximum Entropy and Ecology: A Theory of Abundance, Distribution, and Energetics (Oxford Series in Ecology and Evolution)][1]
To be clear, maximum entropy (also known as MaxEnt in some of the literature, though most/all researchers use the longer form in publications) is a mathematical tool stemming from the fields of probability theory, statistics, and information theory. It's use is classically most often seen in thermodynamics, statistical thermodynamics, physics, and information theory, primarily because these were the areas in which E.T. Jaynes was working when he posited the idea. [Wikipedia has links to his two seminal papers.][2]But because of it's mathematical form, it can be applied in a multitude of areas, typically where one can utilize probabilistic methods.
If you're looking for additional areas of application, simply google the phrase "applied maximum entropy" and you'll find a [wealth of areas][3] including: econometrics, natural language processing, nuclear medicine, queuing systems, mass spectrometry, image processing, machine learning, and many others.
For ecology related work, a cross search on maximum entropy and "genetics", "evolution", "species", and similar words will provide a wealth of papers like ["A maximum entropy approach to species distribution modeling"][4].
Given the generic nature of your question, I might suggest that you'll find E.T. Jaynes' paper ["On the Rationale of Maximum-Entropy Methods" (IEEE, 1982)][5] useful.
Those generally interested in the broader applications of information theoretic methods to biology will likely appreciate some of the work that came out of last year's [NIMBioS Workshop on Information and Entropy in Biological Systems][6] (which Harte both attended and presented at), the [BIRS Workshop Biological and Bio-Inspired Information Theory][7], and the 2014 [CECAM Entropy in Biomolecular Systems][8]. The NIMBios Workshop was organized by John Baez, a physicist, who has worked with MaxEnt methods and explored them on his blog "[Azimuth][9]".
Those with a more sophisticated mathematical background (including measure theory, functional analysis, etc.) may appreciate Henryk Gzyl's text [The Method of Maximum Entropy (World Scientific: Series on Advances in Mathematics for Applied Sciences, Vol 29, 1995)][10].
[1]: http:/
[2]: https:/
[3]: https:/
[4]: http:/
[5]: ftp:/
[6]: http:/
[7]: http:/
[8]: http:/
[9]: https:/
[10]: http:/
The Evolution of Information Gathering: Operational Constraints
Cynthia F. Kurtz
1991 Master's Thesis, SUNY Stony Brook, Ecology & Evolution
Abstract: I present two new approaches to the study of information in foraging theory. First, rather than determine the cost a forager should pay to obtain information, I concentrate on the consequences of information use in an interacting population. I describe a density-dependent model which tracks genotypes with high and low information access through evolutionary time. Stable polymorphisms result. I suggest that the value of information is not monotonically increasing. Second, I present a scheme for partitioning the information used in the decision making process. Three types of information are recognized: internal information, or an individual's internal state; external information, or environmental factors; and relational information, or rules for predicting transformations of internal state. Interactions between the three types are examined in an extension of the basic model.