The Supertree Tool Kit
© Davis et al; licensee BioMed Central Ltd. 2010
Received: 24 November 2009
Accepted: 8 April 2010
Published: 8 April 2010
Large phylogenies are crucial for many areas of biological research. One method of creating such large phylogenies is the supertree method, but creating supertrees containing thousands of taxa, and hence providing a comprehensive phylogeny, requires hundred or even thousands of source input trees. Managing and processing these data in a systematic and error-free manner is challenging and will become even more so as supertrees contain ever increasing numbers of taxa. Protocols for processing input source phylogenies have been proposed to ensure data quality, but no robust software implementations of these protocols as yet exist.
The aim of the Supertree Tool Kit (STK) is to aid in the collection, storage and processing of input source trees for use in supertree analysis. It is therefore invaluable when creating supertrees containing thousands of taxa and hundreds of source trees. The STK is a Perl module with executable scripts to carry out various steps in the processing protocols. In order to aid processing we have added meta-data, via XML, to each tree which contains information such as the bibliographic source information for the tree and how the data were derived, for instance the character data used to carry out the original analysis. These data are essential parts of previously proposed protocols.
The STK is a bioinformatics tool designed to make it easier to process source phylogenies for inclusion in supertree analysis from hundreds or thousands of input source trees, whilst reducing potential errors and enabling easy sharing of such datasets. It has been successfully used to create the largest known supertree to date containing over 5000 taxa from over 700 source phylogenies.
A supertree is defined as an estimate of phylogeny assembled from smaller phylogenies. These partial phylogenies (or source trees) must have some taxa in common, but not necessarily all . Modern supertrees can contain hundreds or thousands of taxa and are constructed from hundreds of source phylogenies requiring the collection of large amounts of data [2–4]. These phylogenies are of great use in, for example, comparative biology , and macroevolutionary studies . Source phylogenies for supertree construction are typically stored in NEXUS files , which contain the phylogenetic relationships between the taxa included in the source study. Collecting, storing and processing this volume of data becomes an arduous and error-prone task as the number of NEXUS files increases. One cannot simply collect a few hundred source phylogenies and use these as published to create a supertree. Criticisms of supertrees have arisen for a variety of reasons, both practical and philosophical. Data quality is the main practical issue  and is the main consideration of the Supertree Tool Kit, as the results from any supertree analysis can only be as good as the input data . In order to minimise potential sources of bias on supertree construction a clear, rigorous, transparent method of processing and assessing the source phylogenies is required.
Data collection and entry: Collecting data from the literature and encoding printed trees as NEXUS-formatted tree files. Meta-data about the source phylogeny is stored in a corresponding XML file.
Standardisation of terminal taxa: Removal of synonyms, vernacular names and subspecies. Standardisation of taxonomic level.
Source tree independence: Remove redundancy within the dataset that would otherwise unfairly up-weight data. Here, non-independence is defined as two or more studies that use the same character data and have identical taxa or two or more studies that use the same character data and where one taxa set is a subset of the other. This is not a standard definition of independence and has no statistical meaning, but is the only practicable definition that can be applied to supertree studies. It is important to recognise that according to other definitions there may be some issues of data overlap remaining even if the above conditions are met.
Check adequate taxonomic overlap of source trees: Ensure that there is adequate taxonomic overlap between source phylogenies, in other words all source phylogenies must fulfill the basic requirement for supertree construction of each source (rooted) phylogeny has at least two taxa in common with one other (rooted) phylogeny 
There are no published software tools of this kind - the STK is unique in this respect. Previous work has been on ad-hoc scripts that automate a single part of suggested protocols, for example "synonoTree" , or "SuperMR" . However, these are one-offs, which do not use standard NEXUS parsers for Perl and are not integrated into a common framework. Of course, these two scripts alone cannot be used to implement the whole protocol as proposed by Davis  or Bininda-Emonds et al. and as such represent a partial implementation at best. Some tools that aid with the storage of NEXUS files do exist, such as TreeBASE  which stores a large range of phylogenies alongside the meta-data containing information on how the tree was originally constructed. However, this meta-information is not readily available for download.
The STK is written in Perl and consists of a Perl module and a number of individual scripts. The main requirements of the STK are Bio::NEXUS, a Perl API for handling NEXUS files  and Perl (version 5 or greater), with the addition of a few standard Perl modules. All scripts are run from the command line. The executables use the functionality of the Perl module and implement the protocol outlined above. The Perl module can be used as the basis for creating further executables.
The STK uses three data formats: NEXUS , XML and taxa substitution files. The minimum data input for the STK is a collection of NEXUS-formatted tree files . These contain the taxa and the phylogenetic information that is a minimum requirement for source data. However, these files miss some crucial information that is required to fully implement the data processing protocols outlined above; namely the bibliographic and analytical information for each source tree. In order to store these data, we use the second type of file: XML files, which are a meta-data storage medium. XML defines data using "tags" and "attributes". The STK XML format contains several such tags. The XML files implemented by the STK contain metadata about each source tree, such as bibliographic information, i.e. authors, journal, year etc., included taxa, and characters used and the algorithmic method used to construct the source tree. This format was chosen, rather than simply creating a document in Word or Excel as has been done in some previous supertree studies e.g. , as it is very easy to extract trees required for any specific analysis, i.e. morphological or molecular data only by parsing the XML. In addition, the combination of two files to store the data enables "data integrity" checks to be carried out throughout processing, which ensures that the source data and associated meta-data stay in step during processing. The XML files are also an essential part of some aspects of the data processing protocol. Checking data independence, for example, requires knowledge of what character data were used. The third type of file used by the STK is the taxa substitution file. This file defines which taxa are to be replaced. The substitution can be empty (a removal of that taxon), a single taxon or multiple taxa as a polytomy.
taxon_1 = taxon_2
taxon_3 = taxon_4, taxon_5, taxon_6
The above taxa substitution file replaces taxon_1 with taxon_2; taxon_3 with a polytomy of taxon_4, taxon_5 and taxon_6; and removes taxon_7.
The Perl module contains over 25 functions used by the executables included in the STK. These provide functionality such as reading and writing NEXUS files, reading and writing XML files, obtaining taxa lists, checking if a taxa is included in a file, etc. These functions are the basis of the executables which form the STK.
Executables in the STK. List of all executables contained in the STK along with a short description
Create a single file from multiple tree files.
Provides a consistency check on the current dataset.
Ensures minimal taxonomic overlap between source trees in the dataset.
Checks that a substitution file will not introduce taxa into a dataset. Also checks formatting of a file.
Create a MRP matrix file from a dataset.
Check the dataset for independence between source trees.
Prints a summary of a dataset, including taxa list and some basic statistics.
Converts tree files produced in TreeView  to standard NEXUS format.
Converts a dataset to species-level (as far as possible).
Enables substitutions or removal of taxa from a dataset or file.
Searches phylogenetic- and meta-data. Can also create a copy from the returned results.
Uses a modified NEXUS file to create all permutations of taxa positions for paraphyletic taxa.
Check Data provides a veracity check for the source data. The script performs three checks, depending on the files that are contained in the dataset; one check examines the NEXUS source phylogenies, the other two checks require the inclusion of XML files. The first check is to ensure that all source phylogenies contained in a dataset are valid NEXUS files as defined by Bio::NEXUS which contains approximately 80% of all known NEXUS commands . The second check ensures the validity of the XML files in the dataset and that they contain a minimal amount of information, e.g. bibliographic information, a taxa list, and the characters used in the study. Third, the XML and source phylogenies are checked to ensure they contain the same taxa.
The check is started with a simple command:
perl stk_check_data.pl --dir ../path/to/dataset
Any errors are displayed on the screen, which in this example is a duplicate taxon in the NEXUS file:
Duplicate taxon: Margarops_fuscus
The default options, where two taxa must overlap with graphical output (figure 1a):
perl stk_check_data.pl --dir ../path/to/dataset --graphic
To extend to more taxa (figure 1b):
perl stk_check_data.pl --nCluster = 4 --dir ../path/to/dataset -graphic
This script enables replacement or deletion of taxa. The replacement could be a single taxon or multiple taxa encoded as a polytomy. This replacement can be carried out on a directory or a single file. In addition, the executable can read in a substitution file and carry out multiple replacements or deletions simultaneously.
For example, to remove a taxon from the dataset:
perl stk_replace_taxa.pl --dir ../data --old Xiphocolaptes_promeropirhynchus
To replace a taxa, for example to correct common mis-spellings:
perl stk_replace_taxa.pl --dir ../data --old Gallus_sonnerati --new Gallus_sonneratii
To use a substitution file to carry out multiple replacement and deletions:
perl stk_replace_taxa.pl --dir ../data --taxa subs.txt
where the subs.txt _le is in the format described previously.
Search Data performs two functions: one is to identify source phylogenies that contain certain data, such as a particular taxon, use of a certain character, etc. Second, the script can create a copy of the data that match the search criteria. In other words, subsets of the dataset can be created easily; e.g. those containing only molecular data.
The following command can be used to create a version of the dataset that contains only those source phylogenies derived from the gene cytochrome b, and place that data in a directory called "new data":
perl stk_search_data.pl --dir ../path/to/data --charterm cytb --copy ../new_data
As part of creating robust software, it is important that the software is extensively tested . The STK contains two automated test suites: a unit test suite and a regression test suite. The unit tests exercises 100% (in terms code statements, branches, and conditionals) of the STK module, checking correct functionality, incorrect inputs are handled correctly and that each function is documented. There are currently over 250 separate tests carried out. The regression tests exercise the scripts, again checking for correct functionality and correct handling of incorrect inputs. Whilst these tests do not ensure bug-free code, they do increase confidence that STK does not contain major errors that would introduce errors into the dataset during processing. Given the number of trees contained in modern datasets, finding and correcting such introduced errors would not be a trivial task.
Although the STK has currently been used successfully in two projects [2, 3], there are many useful features that could be implemented. Proposed future features include the addition of a Graphical User Interface to improve the ease-of-use of the STK. We also intend to add revision control which will provide a transparent way of maintaining a full processing log and allow an 'undo' facility to the processing chain.
Availability and requirements
Project name: Supertree Tool Kit (STK)
Project home page: http://sourceforge.net/projects/stck/
Operating system(s): Platform independent. Tested on Ubuntu and Fedora Linux, Mac OS X, Windows XP.
Programming language: Perl
Other requirements: Perl 5 or higher, and the following Perl modules: XML::Simple, File::Find, File::Spec::Functions, File::Copy, Carp, Bio::NEXUS, Graph, and Graph::Writer::Dot
License: GNU GPL
Any restrictions to use by non-academics: No restrictions
This study was supported by NERC [grant number NER/S/A/2003/11241] to KED. The authors would like to thank Rod Page (University of Glasgow) for support during the project and Graeme Lloyd (Natural History Museum) and three anonymous reviewers for useful comments that improved the manuscript.
- Sanderson M, Purvis A, Henze C: Phylogenetic supertrees: assembling the trees of life. Trends in Ecology and Evolution. 1998, 13: 105-109. 10.1016/S0169-5347(97)01242-1.PubMedView ArticleGoogle Scholar
- Davis KE: Reweaving the Tapestry: A supertree of birds. PhD thesis. 2008, University of Glasgow, [http://theses.gla.ac.uk/178/]Google Scholar
- Lloyd GT, Davis KE, Pisani D, Tarver JE, Ruta M, Sakamoto M, Hone DWE, Jennings R, Benton MJ: Dinosaurs and the Cretaceous Terrestrial Revolution. Proceedings of the Royal Society B: Biological Sciences. 2008, 275 (1650): 2483-2490. 10.1098/rspb.2008.0715.PubMed CentralPubMedView ArticleGoogle Scholar
- Bininda-Emonds ORP, Cardillo M, Jones KE, MacPhee RDE, Beck RMD, Grenyer R, Price SA, Vos RA, Gittleman JL, Purvis A: The delayed rise of present-day mammals. Nature. 2007, 446: 507-512. 10.1038/nature05634.PubMedView ArticleGoogle Scholar
- Felsenstein J: Phylogenies and the Comparative Method. The American Naturalist. 1985, 125: 1-10.1086/284325.View ArticleGoogle Scholar
- Purvis A, Nee S, Harvey P: Macroevolutionary inferences from primate phylogeny. Proceedings of the Royal Society of London B. 1995, 260: 329-333. 10.1098/rspb.1995.0100.View ArticleGoogle Scholar
- Maddison DR, Swofford DL, Maddison WP: NEXUS: An Extensible File Format for Systematic Information. Systematic Biology. 1997, 46 (4): 590-621.PubMedView ArticleGoogle Scholar
- Gatesy J, Baker CRH, Hayashi C: Inconsistencies in arguments for the supertree approach: supermatrices versus supertrees of Crocodylia. Systematic Biology. 2004, 53: 342-355. 10.1080/10635150490423971.PubMedView ArticleGoogle Scholar
- Bininda-Emonds ORP, Jones KE, Price SA, Cardillo M, Grenyer R, Purvis A: Garbage in, garbage out: data issues in supertree construction. Phylogenetic supertrees: Combining information to reveal the tree of life., Volume 3 of Computational Biology. 2004, Bininda-Emonds ORP, Dordecht, The Netherlands: Kluwer Academic, 267-280.View ArticleGoogle Scholar
- Swofford DL: PAUP*. Phylogenetic Analysis Using Parsimony (*and other methods). 2002Google Scholar
- Goloboff PA, Farris JS, Nixon KC: TNT, a free program for phylogenetic analysis. Cladistics. 2008, 24 (5): 774-786. 10.1111/j.1096-0031.2008.00217.x.View ArticleGoogle Scholar
- Bininda-Emonds ORP, Beck RMD, Purvis A: Getting to the roots of matrix representation. Systematic Biology. 2005, 54: 668-672. 10.1080/10635150590947113.PubMedView ArticleGoogle Scholar
- Morell V: Evolutionary Biology: Web-Crawling Up the Tree of Life. Science. 1996, 273 (5275): 568-570. 10.1126/science.273.5275.568.View ArticleGoogle Scholar
- Hladish T, Gopalan V, Liang C, Qiu W, Yang P, Stoltzfus A: Bio::NEXUS: a Perl API for the NEXUS format for comparative biological data. BMC Bioinformatics. 2007, 8: 191-10.1186/1471-2105-8-191.PubMed CentralPubMedView ArticleGoogle Scholar
- Thomas GH, Wills MA, Székely T: A supertree approach to shorebird phylogeny. BMC Evol Biol. 2004, 4: 28-10.1016/S1055-7903(03)00222-7.PubMed CentralPubMedView ArticleGoogle Scholar
- STK Wiki. [http://sourceforge.net/apps/mediawiki/stck/index.php]
- Springer Berlin/Heidelberg, Ellson J, Gansner E, Koutsofios L, North S, Woodhull G: Graphviz| Open Source Graph Drawing Tools. Graph Drawing. 2002, Springer Berlin/Heidelberg, 594-597.Google Scholar
- John Wiley and Sons, Myers GJ, Sandler C, Badgett T, Thomas TM: The Art of Software Testing. 2004, John Wiley and SonsGoogle Scholar
- Felsenstein J: Phylogeny Programs. 2003, [http://evolution.genetics.washington.edu/phylip/software.html]Google Scholar
- Page RDM: TreeView: an application to display phylogenetic trees on personal computers. Computer Applications in the Biosciences. 1996, 12: 357-358.PubMedGoogle Scholar
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.