 Methodology article
 Open Access
 Published:
A new fast method for inferring multiple consensus trees using kmedoids
BMC Evolutionary Biology volume 18, Article number: 48 (2018)
Abstract
Background
Gene trees carry important information about specific evolutionary patterns which characterize the evolution of the corresponding gene families. However, a reliable species consensus tree cannot be inferred from a multiple sequence alignment of a single gene family or from the concatenation of alignments corresponding to gene families having different evolutionary histories. These evolutionary histories can be quite different due to horizontal transfer events or to ancient gene duplications which cause the emergence of paralogs within a genome. Many methods have been proposed to infer a single consensus tree from a collection of gene trees. Still, the application of these tree merging methods can lead to the loss of specific evolutionary patterns which characterize some gene families or some groups of gene families. Thus, the problem of inferring multiple consensus trees from a given set of gene trees becomes relevant.
Results
We describe a new fast method for inferring multiple consensus trees from a given set of phylogenetic trees (i.e. additive trees or Xtrees) defined on the same set of species (i.e. objects or taxa). The traditional consensus approach yields a single consensus tree. We use the popular kmedoids partitioning algorithm to divide a given set of trees into several clusters of trees. We propose novel versions of the wellknown Silhouette and CalińskiHarabasz cluster validity indices that are adapted for tree clustering with kmedoids. The efficiency of the new method was assessed using both synthetic and real data, such as a wellknown phylogenetic dataset consisting of 47 gene trees inferred for 14 archaeal organisms.
Conclusions
The method described here allows inference of multiple consensus trees from a given set of gene trees. It can be used to identify groups of gene trees having similar intragroup and different intergroup evolutionary histories. The main advantage of our method is that it is much faster than the existing tree clustering approaches, while providing similar or better clustering results in most cases. This makes it particularly well suited for the analysis of large genomic and phylogenetic datasets.
Background
Various methods for computing a consensus tree for a given set of phylogenetic trees have been proposed [1]. The most known types of consensus trees are the strict consensus tree, the majority consensus tree and the extended majority consensus tree [1, 2]. The strict consensus tree contains only the edges that are common to all input trees. The majority consensus tree contains the edges that are present in more than 50% of the input trees, although higher percentages may also be considered. According to the extended majority rule, the consensus tree includes all of the majority edges to which compatible residual edges are added gradually, starting with the most frequent ones. Extended majority consensus trees are the most frequently used consensus trees in evolutionary biology because they are usually much better resolved (i.e. have lower mean degree of internal nodes) than strict and majority consensus trees [2].
The output of most conventional consensus tree algorithms is a single consensus tree [1]. However, in many practical situations it is much more appropriate to infer several consensus trees. In biology, it is often risky to group phylogenetic trees corresponding to different sets of genes. Each gene has its own evolutionary history which can substantially differ from evolutionary histories of other genes. For example, some individual genes or gene clusters (e.g. operons) affected by specific horizontal gene transfer events will display different evolutionary patterns than the rest of genes under study [3–8]. The evolutionary history of such genes or gene clusters will be depicted by phylogenetic trees having different topologies from that of the species tree which represents the evolution of genes that did not undergo gene transfers. Furthermore, the homogeneity of a given set of genes can be also affected by ancient duplication events causing the emergence of paralogous alleles.
There are several computational tools for analyzing and visualizing sets of incompatible phylogenetic trees, including SplitsTree [9], Dendroscope [10] and DensiTree [11]. These programs allow for inferring different kinds of phylogenetic networks which can be viewed as alternatives to multiple consensus trees. Holland et al. [12] were among the first to discuss a consensus building approach using splits network. Holland et al. compared gene trees of yeast genomes and demonstrated that consensus networks can be useful to depict hidden contradictory signals existing in species phylogenies.
Thus, the question whether a unique consensus tree or multiple consensus trees best characterize a given set of phylogenies arises as an alternative to phylogenetic network reconstruction approaches. If the given phylogenies are topologically congruent, they should be combined into a single consensus tree. However, if these phylogenies encompass conflicting genetic signals, they should be organized into multiple consensus trees, each of which accounts for a specific evolutionary pattern [13–15]. Figure 1 shows four phylogenetic trees T_{1}, T_{2}, T_{3} and T_{4} with seven leaves. Here, the solution consisting of two majorityrule consensus trees, T_{12} and T_{34}, seems to be much more appropriate than the solution consisting of a single majority consensus tree, T_{1234}, i.e. a star tree here, given by the traditional majority consensus approach.
In this paper we describe a new algorithm for determining clusters of homogeneous trees which can be combined in order to infer multiple consensus trees. The idea of building multiple consensus trees was originally formulated by Maddison [16] who found that consensus trees of some subsets of a given set of trees may differ and that they are usually better resolved than the consensus tree of the whole set. Then, Stockham et al. [17] proposed two variants of a tree clustering algorithm based on kmeans, which were meant to infer a set of strict consensus trees (called characteristic trees) minimizing the information loss. However, these methods were very expensive in terms of the running time because the consensus trees had to be determined for each set of clusters in all intermediate partitioning solutions tested by kmeans. Bonnard et al. [13] described a method, called Multipolar Consensus, to display all the splits of a given set of phylogenetic trees having a support above a predefined threshold, using a minimum possible number of consensus trees. The authors indicated that biologically relevant secondary signals, which would be normally absent in a classical consensus tree, can be captured by the Multipolar Consensus method thus providing a convenient exploratory tool for phylogenetic analysis. This method allows one to display more secondary evolutionary signals than it is proposed by the extended majority rule consensus without making possible arbitrary choices which are usually made in this consensus method. In his recent paper, Guénoche [14] has presented a method for partitioning phylogenetic trees into one cluster (K=1, when given gene trees are homogeneous) or several clusters (K>1, when given gene trees are divergent). A generalized partition score, computed over a set of tree partitions, is calculated by the Guénoche method in order to determine the number of clusters, K, in which a given set of gene trees should be partitioned. Guénoche validated his method on both simulated data, i.e. random sets of trees organized in different topological groups, and real data, i.e. a set of non homogeneous gene trees of 30 E.coli strains assumed to be affected by horizontal gene transfers. The MCT (Multiple Consensus Trees) program developed by the author remains one of the rare pieces of software for inferring multiple consensus trees, available for the research community.
We will describe a new tree clustering method that relies on specific versions of the Silhouette (SH) [18] and CalińskiHarabasz (CH) [19] indices adapted for tree clustering with kmedoids. These cluster validity indices will be used to determine the best partitioning obtained over multiple random starts of kmedoids [20] when the number of clusters is fixed and then to select the optimal number of clusters for a given set of trees.
Methods
Kmedoids algorithm adapted for tree clustering
A phylogenetic tree is an unrooted leaflabeled tree in which each internal node, representing an ancestor of contemporary species, has at least two children and all leaves, representing contemporary species, have different labels [2, 21, 22]. Our algorithm takes as input a set of phylogenetic trees Π defined on the same set of leaves and returns as output one or several consensus trees. Each consensus tree represents a subset (i.e. group, class or cluster) of trees from Π. For each cluster identified, the algorithm returns a list of its elements (i.e. phylogenetic trees) and the corresponding consensus tree. The output is also accompanied by some statistics (e.g. the value of the selected cluster validity index). Our method uses a version of the popular kmedoids algorithm suitable for tree clustering. The kmedoids algorithm [20] is a clustering method which can be viewed as a robust version of the popular kmeans algorithm. The kmedoids algorithm divides N elements (i.e. phylogenetic trees in our case) into K clusters using the cluster centers (i.e. the medoids) which belong to the set of original elements (i.e. original trees from Π in our case). The medoid of a given cluster is chosen to minimize the overall distance to the other elements of this cluster. The content of each cluster is chosen to minimize the total intracluster distance. Generally, the most commonly used distances in the framework of kmedoids are the Euclidean distance, the Manhattan distance and the Minkowski distance.
Several measures have been proposed to estimate the distance between phylogenetic trees. The most popular of them are the Robinson and Foulds (RF) topological distance [23], the quartet distance [24], the SPR (Subtree Prune and Regraft) distance [25], the MAST (Maximum Agreement Subtree) distance [26] and the bipartition dissimilarity [3]. Unfortunately, the popular SPR distance, which is often used to identify horizontal gene transfer events, takes an exponential time to calculate. This is also the case of the MAST distance which cannot be calculated in polynomial time. The RF and the quartet distances are topological distances which are among the quickest to calculate. Indeed, both of them can be computed in \(\mathcal {O}(n^{2})\) when two Newick strings, representing two phylogenies with n leaves defined on the same set of species, are considered. Moreover, Barthélemy and McMorris [27] have shown that the majority consensus tree of a set of trees is a median tree of this set in the sense of the RF distance [27]. Thus, the RF topological distance seems to be an appropriate distance to be used within kmeans or kmedoids algorithms adapted for phylogenetic tree clustering. In our work, we define the median tree as a tree based on the RF distance. It is worth noting that one could also use an alternative type of median trees, those based on the SPR distance [28], to infer SPRdistancebased multiple consensus trees. For instance, Bruen and Bryant showed that the maximum parsimony tree can be viewed as a type of median consensus tree in the sense of the SPR distance.
The Robinson and Foulds distance [14, 23, 29, 30] between two trees is a wellknown distance used in computational biology to compare the topologies of two phylogenetic trees defined on the same set of species. The Robinson and Foulds distance is a topological distance. It does not take into account the lengths of the tree edges.
The time complexity of a typical implementation of the kmedoids algorithm is \( \mathcal {O}\left (K \times (N  K)^{2} \times i \times M \right)\), where K is the number of clusters, i is the number of iterations in kmedoids and M is the number of variables characterizing each of the N objects. One of the advantages of our new algorithm based on the RF distance is that it does not need to recompute the consensus trees for intermediate clusters of trees. Instead, it estimates the quality of each intermediate clustering using an approximate formula. This allows a much faster partitioning of a given set of phylogenetic trees into K clusters without losing the quality of the obtained consensus trees.
In the case of tree clustering using kmeans, the objective function to be minimized can be defined as follows:
where K is the number of clusters, N_{ k } is the number of trees in cluster k, RF is the Robinson and Foulds topological distance between two phylogenetic trees with n leaves, T_{ ki } is the tree i of cluster k and \(T^{maj}_{k}\) is the majority rule consensus tree of cluster k. Still, the computation of the majority rule consensus tree or of the extended majority rule consensus tree is timeconsuming. The time complexity of the method computing the majority or the extended majority rule consensus tree is \( \mathcal {O}\left (n^{2} + nN^{2}\right)\) [2], where N is the number of trees and n is the number of leaves in each tree. Jansson et al. [31] have recently proposed a number of deterministic algorithms for constructing the majority rule consensus tree and some of its variants. The authors presented the algorithms running in \(\mathcal {O}\left (nN \times log N \right)\) time  for a majority rule consensus tree, in \(\mathcal {O}(nN)\) time  for a loose consensus tree, and in \(\mathcal {O}\left (n^{2}N\right)\) time  for a greedy consensus tree. However, if the trees are defined by their Newick strings, as it is typically done in evolutionary biology [32], one will need a conversion program to transform each Newick string into the format required by the algorithms of Jansson et al.
Stockham et al. [17] proposed two variants of the popular kmeans algorithm to infer a set of strict consensus trees (called characteristic trees) that minimize the loss information. However, the approach of Stockham et al. seems to be very expensive in terms of the running time because in their approach the consensus trees are determined for each set of clusters in all intermediate partitioning solutions tested by kmeans. We present a new algorithm that does not need to recompute the consensus trees at each of its iterations. The time complexity of a straightforward tree partitioning algorithm, such as the algorithm of Stockham et al. [17] based on kmeans, which recomputes the consensus trees after each basic kmeans operation consisting of relocating an object (i.e. tree) from one cluster to another and then in reassessing the value of the objective function (Formula 1), is \( \mathcal {O}\left (K \times n \times \left (n + N^{2}\right)\times i\right)\).
We propose to use the following approximate formula, based on the properties of kmedoids:
where \(T^{m}_{k}\) is the medoid tree of cluster k. The medoid tree \(T^{m}_{k}\) of cluster k is the tree belonging to cluster k that minimizes the sum of RF distances between it and all other trees in k. By contrast with the kmeansbased approach, we do not need to compute in our algorithm cluster centroids or majority consensus trees of clusters. Using Formula 2, we reduce the time complexity of the method to \( \mathcal {O}\left (nN^{2} + K \times (N  K)^{2} \times i\right)\), where \( \mathcal {O}\left (nN^{2}\right)\) is the time complexity of precalculating the matrix of pairwise RF distances of size (N×N) between all trees in Π.
Silhouette cluster validity index adapted for tree clustering with kmedoids
The first cluster validity index we consider in this study is the Silhouette width (SH) [18]. This index assesses the average rate of similarity between the objects belonging to the same cluster (i.e. a cohesion function) versus the rate of similarity between the objects of different clusters (i.e. a separation function). The Silhouette width for cluster k is defined as follows:
where N_{ k } is the number of elements (i.e. trees) in cluster k, a(i) is the average distance between the element i and all other elements of k and b(i) is the smallest of all distances between the element i of cluster k and the elements in the other clusters (i.e. those different from k). The optimal number of clusters corresponds to the highest value of Silhouette.
The following equations for calculating a(i) and b(i) can be used when clustering trees. The formula for a(i) is as follows:
where T_{ ki } is the tree i of cluster k and T_{ kj } is the tree j of cluster k. The formula for b(i) is as follows:
where \(T_{k^{\prime }j}\) is the tree j of cluster k^{′} and \(N_{k^{\prime }}\) is the number of trees in cluster k^{′}.
Finally, the optimal number of clusters K corresponds to the maximum average Silhouette width, SH(K), defined as follows:
CalińskiHarabasz cluster validity index adapted for tree clustering with kmedoids
The second cluster validity index we consider here is the CalińskiHarabasz index (CH) [19]. This criterion is a ratio between the overall betweencluster distance and the overall withincluster distance, calculated by taking into account the number of degrees of freedom. The exact formula for the CH computation is as follows:
where SS_{ W } is the overall withincluster distance involving the elements of the same cluster, SS_{ B } is the overall betweencluster distance involving the elements of different clusters, K is the number of clusters and N is the number of elements. The optimal number of clusters corresponds to the maximum of CH.
The traditional formula for calculating the overall withincluster variance, SS_{ W }, is as follows:
where y is an element of cluster C_{ k }, m_{ k } is the centroid of cluster k and ∥y−m_{ k }∥^{2} is the Euclidean distance (L^{2} norm) between y and m_{ k }.
The traditional formula for calculating the overall betweencluster variance, SS_{ B }, is as follows:
where N_{ k } is the number of elements in cluster k, m is the overall mean of the sample data and ∥m_{ k }−m∥^{2} is the Euclidean distance between m_{ k } and m. Good clusterings have a large overall betweencluster distance (SS_{ B }) and a small overall withincluster distance (SS_{ W }).
Clearly, we cannot use the Euclidean distance when clustering trees [33]. The Robinson and Foulds topological distance (RF) has been used instead. Namely, the following formulas for the overall withincluster and betweencluster distances were used in our study:
where \(T^{m}_{k}\) is the medoid tree of cluster k, T_{ ki } is the tree i of cluster k and T^{m} is the medoid tree of the sample data.
Adjusted Rand index
The quality of clustering results was evaluated by using the Adjusted Rand Index (ARI) [34–36]. The values of ARI are located in the interval [1; 1]. When two partitions are exactly the same, the corresponding value of ARI is 1. This popular index is the corrected for chance version of the Rand index [37, 38]. ARI is often used in simulations to compare the known original partitions with those generated by methods under study.
Given a set of n objects and two partitions of these objects, namely X=X_{1},X_{2},…,X_{ r } with r clusters and Y=Y_{1},Y_{2},…,Y_{ s } with s clusters, the overlap between X and Y can be summarized using a contingency matrix [n_{ ij }], where each entry n_{ ij } denotes the number of objects in common between partitions X_{ i } and Y_{ j }.
The ARI index is calculated using Formula (12):
where n_{ ij }=X_{ i }∩Y_{ j }, \(a_{i} = \sum ^{s}_{j=1}X_{i} \cap Y_{j}\) and \(b_{j} = \sum ^{r}_{i=1}X_{i} \cap Y_{j}\), and X_{ i } and Y_{ j } are the sets of objects in clusters i and j, respectively.
Results
Simulation design
We tested our new algorithm for computing multiple consensus trees using the two following simulation protocols.
Our first simulation included two main steps. During the first step, we randomly generated a species phylogenetic tree (i.e. first consensus tree here) T_{1} with n leaves using the HybridSim [39] program. Then, using the same program, we generated K−1 other consensus trees, T_{2}, …, T_{ K } with n leaves, each of which differed from T_{1} by a specified number of hybridization events (the value of the hybridizationrate parameter in the HybridSim program varied from 1 to 4 in our simulation; it was drawn randomly using a uniform distribution). In our first simulation, the number of clusters, K, ranged from 2 to 10 (see Figs. 2, 3 and 4), while the number of tree leaves, n, was taking the values 8, 16, 32 and 64 (see Fig. 3).
The HybridSim program developed by Woodhams et al. [39] allows generation of phylogenies in the presence of hybridization and horizontal gene transfer events. This program can generate trees differing from each other by a specified number of coalescence/incomplete lineage sorting producing patterns of incongruence across gene trees. In our simulations with HybridSim, we varied the values of the hybridizationrate (as indicated above) and the coalescencerate (as indicated below) parameters. The rest of parameters used in our simulations were the default parameters of HybridSim.
During the second step of the first simulation, for each consensus phylogenetic tree T_{ i } (i = 1, …, K) representing cluster i, we generated a set of 100 trees belonging to cluster i using a specified value of the coalescence rate parameter in HybridSim. In our study, the value of this coalescence parameter, introducing noise into gene phylogenies, varied between 10 (low noise) and 1 (high noise). Thus, each element T of cluster i differed from the consensus tree T_{ i } of this cluster by a certain (fixed) coalescence degree. The simulation results presented in Figs. 2 and 3 correspond to the case in which the coalescence rate parameter in HybridSim was fixed to 5. Figure 4 illustrates how the methods’ results change with respect to the change in the coalescence parameter. The number of clusters, K, was assumed to be known in this simulation. The strategies based on both the squared and nonsquared RF distances (used in Formula 2) were evaluated.
In the second simulation, we compared our algorithm based on the Silhouette index and the nonsquared Robinson and Foulds distance (Formula 2) with the traditional approach based on the recalculation of majorityrule consensus trees, representing the cluster centroids, after each basic operation of kmeans (a variant of Formula 1 using the squared RF distance, as suggested by Stockham et al. [17]). This comparison was performed in terms of quality of clustering results returned by competing methods (Fig. 5a and b) and of running time (Fig. 5c and d). The number of tree leaves, n, in this second simulation was equal to: 8, 16, 32, 64 and 128. The number of clusters, K, in the second simulation was equal to 5 and the coalescence rate parameter in the HybridSim program was fixed to 5 in this simulation. Once again, 100 different datasets were generated for each parameter combination and the number of clusters was assumed to be known. Our simulations were carried out using a 64bit computer equipped with an Intel i54690T CPU (2.5 GHz) and 8 Gb of RAM.
The results of the first simulation are illustrated in Figs. 2, 3 and 4. The presented results are the averages taken over all combinations of our parameters (see the “Simulation study” section), except the featured one (i.e. the number of clusters in Fig. 2, the number of tree leaves in Fig. 3 and the coalescence rate in Fig. 4). The obtained results are discussed later on in the “Discussion” section.
Clustering trees of 47 ribosomal proteins of Archaea
We applied the new algorithm to analyze the evolution of 47 ribosomal proteins of 14 organisms of Archaea, including 11 species of Euryarchaeota and 3 species of Crenarchaeota. These data were originally studied by MatteTailliez et al. (see Fig. 1a in [4] or Fig. 6a in our paper). MatteTailliez et al. inferred a single species phylogenetic tree after the concatenation of the considered protein sequences (see Fig. 6a). However, the evolution of each of these proteins can be represented by its own phylogenetic tree. The cluster analysis of these trees can tell us how many different evolutionary scenarios characterize the evolution of these sequences (i.e. how many clusters of trees exist in the protein tree dataset). We first considered the complete set of 52 multiple sequence alignments of archaeal ribosomal proteins studied by MatteTailliez et al. We selected for our analysis 47 of these 52 alignments, i.e. those including the data for the same 14 archaeal organisms. The 5 remaining alignments were incomplete (i.e. they included 12 or 13 organisms only). Using the 47 complete alignments, we inferred 47 phylogenetic trees by means of the PHYML method [40] (these alignments and trees are available at: https://github.com/TahiriNadia/CKMedoidsTreeClustering/).
First, we carried out the version of our kmedoids tree clustering algorithm based on the SH index (Formulas 3 to 6) and the nonsquared RF distance in order to infer a partitioning of the obtained set of 47 trees. The maximum of SH was attained with five clusters (K=5) which correspond to five different horizontal gene transfer scenarios presented in Fig. 6 (panels b to f).
The first cluster contained 11 trees, the second 4 trees, the third 20 trees, the fourth 11 trees and the fifth 1 tree. We inferred the extended majority consensus trees, SH1, SH2, SH3, SH4 and SH5, for these five clusters of trees. Afterwards, using the gene transfer detection algorithm by Boc et al. [3], we identified the scenarios of horizontal gene transfer events which reconcile the species tree (Fig. 6a) and each of the obtained consensus trees, SH1 to SH5. In the end of the tree reconciliation process, consisting of SPR moves (corresponding to horizontal gene transfers) of clusters of the species tree, the transformed topology of the species tree becomes identical to that of the gene tree. The version of the algorithm available on the TRex web site [41] was used in our computations.
Second, we carried out the version of our kmedoids tree clustering algorithm based on the CH index (Formulas 7 to 11) and the nonsquared RF distance to classify the same set of 47 gene trees. The maximum of CH was attained with three clusters (K=3). Here, the first cluster contained 25 trees, the second 14 trees and the third 8 trees. We then inferred the extended majority consensus trees, CH1, CH2 and CH3, for these clusters of trees. Similarly to the case of SH, we identified the scenarios of horizontal gene transfer events that reconcile the species tree (Fig. 6a) and each of the consensus trees CH1, CH2 and CH3 (see Fig. 7, panels a to c).
Discussion
Simulation study
The curves depicted in Fig. 2 indicate that the clustering quality provided by our algorithm depends on the number of clusters, the cluster validity index (SH or CH) and the selected objective function (i.e. the nonsquared RF distance or the squared RF distance in Formula 2). Obviously, we were not able to address the case of homogeneous data (i.e. K = 1) in this study because the SH and CH cluster validity indices are not adapted for the case of one cluster only. The ARI results improve noticeably when the number of clusters, K, increases from 2 to 6 and stabilize starting from 6 clusters. Also, the strategy based on the SH cluster validity index and the nonsquared RF distance outperforms the three other competing strategies regardless of the number of clusters.
Figure 3 shows a slight increase in the ARI values as the number of tree leaves increases. Once again, the scores of ARI for the SH criterion are higher than those for the CH criterion and the methods based on the nonsquared RF distance are slightly more efficient than those based on the squared RF metric. One can also observe that the ARI scores become more stable when the number of clusters varies between 6 and 10 (Fig. 3b) compared to the case when it varies between 2 and 5 (Fig. 3a).
Figure 4 shows that the CH index is more affected by coalescence (i.e. noise) than SH when clustering trees using kmedoids. Once again, one can notice that both versions of our algorithm, based on SH and CH, yield better results when the nonsquared RF distance is used in Formula 2 instead of its squared counterpart. It is worth noting that Stockham et al. [17] used the squared RF distance in their algorithm. Given these results, our second simulation (see Fig. 5) was conducted with the algorithm based on the Silhouette index and the nonsquared Robinson and Foulds distance.
The results of the second simulation are shown in Fig. 5. The curves presented in Fig. 5 (a and b) indicate that the new algorithm based on Formulas 2 to 6 works better than the straightforward tree clustering approach by Stockham et al. [17] in terms of the clustering quality when the number of tree leaves varies from 8 to 32, but is slightly less efficient than the approach by Stockham et al. when the number of tree leaves varies from 64 to 128. However, our algorithm is by far the best method in terms of the running time for both simulation parameters considered: the number of tree leaves (Fig. 5c) and the number of trees (Fig. 5d). These results suggest that our new algorithm is well suited for the analysis of large phylogenetic datasets.
Analysis of clustering results obtained for 47 trees of ribosomal proteins of Archaea
Horizontal gene transfer scenarios found using the SH index account for five different histories which characterize the evolution of the 47 ribosomal proteins considered. Two transfers predicted for these data by Boc et al. (see Fig. 6 in [3]), which are in agreement with the results of MatteTailliez et al. [4] and Boc et al. 2013 [42], are present in these five scenarios. Precisely, the transfers  SH3−2 (or its equivalent transfer SH5−4) and SH5−1  have been predicted by Boc et al. 2010 (see Fig. 6 in [3]), the transfers  SH3−2 (or its equivalent transfer SH5−4) and SH3−1  have been predicted by Boc et al. 2013 (see Fig. 2b in [42]). Finally, the transfers  SH1−1 (or its equivalent transfers SH2−2 and SH4−1), SH5−1, SH3−2 (or its equivalent transfer SH5−4), SH2−1, SH4−3 and SH4−2  have been predicted by Boc et al. 2013 (see Fig. 3 in [42]) as partial horizontal gene transfers (i.e. transfers leading to the formation of chimeric genes composed of portions of two or more coding sequences; see [43]).
We also used the MCT program by Guénoche [14] (Multiple Consensus Trees) to analyze this Archaea dataset. The average linkage hierarchical algorithm and the Robinson and Foulds distance were the parameters which we selected in MCT. We compared our consensus trees of classes with the consensus trees found by the algorithm by Guénoche[14]. For example for K=5 (this was the optimal number of clusters found using our algorithm with the SH index), the MCT program returned consensus gene trees whose topologies led to the horizontal gene transfers SH2−1, SH2−3, SH4−2 and SH4−3 (see Fig. 6).
Horizontal gene transfer scenarios found using the CH index account for three different evolutionary histories of the 47 ribosomal proteins under examination. Here, the transfer  CH2−1  has been predicted by Boc et al. 2010 (see Fig. 6 in [3]), the transfer  CH2−2  has been predicted by Boc et al. 2013 (see Fig. 2b in [42]), and finally the transfers  CH1−1 (or its equivalent transfer CH3−1), CH1−2, CH1−3, CH2−1, CH3−2 and CH3−4  have been predicted by Boc et al. 2013 as partial horizontal gene transfer events (see Fig. 3 in [42]). Interestingly, all the transfers found in the horizontal gene transfer scenarios shown in Fig. 7 (ac) can be found in the gene transfer scenarios presented in Fig. 6 (bf).
Finally, we ran the MCT program with K=3 (this was the optimal number of clusters found using our algorithm with the CH index) and compared the obtained consensus trees with those found by our method. The consensus trees found by MCT in this case allowed for four horizontal gene transfers which were equivalent to the transfers CH1−2, CH1−3, CH3−2 and CH3−3 (see Fig. 7) found by our algorithm with the CH index.
Still using the horizontal gene transfer detection algorithm by Boc et al. [3], we found scenarios of gene transfer events reconciling the species tree (Fig. 7a) and the obtained consensus trees which play the role of gene trees in this context. The overall horizontal gene transfer results comparing the frequencies of the intragroup and intergroup gene transfers found by our algorithm using the SH and CH indices are reported Table 1. They suggest that gene transfers have been more frequent within the species of the same phylum than between the species of different phyla (i.e. Crenarchaeota and Euryarchaeota).
Conclusions
In this article we described a new algorithm for partitioning a set of phylogenetic trees into several clusters in order to infer multiple consensus trees. We presented new formulas allowing for using the popular Silhouette and CalińskiHarabasz cluster validity indices as well as the Robinson and Foulds topological distance in the framework of tree clustering based on the popular kmedoids algorithm. The new algorithm can be used to address a number of important issues in evolutionary biology, such as the identification of genes having similar evolutionary histories, e.g. those that have undergone the same horizontal gene transfers or those that have been affected by the same ancient duplication events. The presented algorithm could be extended to the case where the input trees have different, but mutually overlapping, sets of leaves. In order to compute the Robinson and Foulds topological distance between such trees, we could first reduce them to the common set(s) of leaves. After this reduction, the Robinson and Foulds distance normalized by its maximum value, which is 2n−6 for two binary trees with n leaves, could be used in Formulas 1 and 2 in order to infer multiple consensus trees. Overall, good performances achieved by the new algorithm in terms of both clustering quality and running time makes it well suited for the analysis of large genomic and phylogenetic datasets. A C++ program, called KMTC (KMedoids Tree Clustering), implementing the discussed tree partitioning algorithm is freely available at: https://github.com/TahiriNadia/CKMedoidsTreeClustering/.
Abbreviations
 ARI:

Adjusted Rand index
 CH:

Caliń
 skiHarabasz cluster validity indice; KMTC:

KMedoids tree clustering
 MCT:

Multiple consensus trees program
 RF:

Robinson and Foulds topological distance
 SH:

Silhouette cluster validity indice
 SS_{B} :

Overall betweencluster distance
 SS_{W} :

Overall withincluster distance
 ToL:

Tree of life project
References
 1
Bryant D. DIMACS Series Discrete Math Theor Comput Sci. 2003; 61:163–84.
 2
Felenstein J. Inferring Phylogenies vol. 2. Sunderland: Sinauer Associates; 2004.
 3
Boc A, Philippe H, Makarenkov V. Inferring and validating horizontal gene transfer events using bipartition dissimilarity. System Biol. 2010; 59:195–211.
 4
MatteTailliez O, Brochier C, Forterre P, Philippe H. Archaeal phylogeny based on ribosomal proteins. Mol Biol Evol. 2002; 19:631–9.
 5
Badescu D, Tahiri N, Makarenkov V. A new fast method for detecting and validating horizontal gene transfer events using phylogenetic trees and aggregation functions. In Pattern Recognition in Computational Molecular Biology: Techniques and Approaches.Wiley Online Library; 2016, pp. 483–504.
 6
Than C, Jin G, Nakhleh L. Integrating sequence and topology for efficient and accurate detection of horizontal gene transfer. In: Proceedings of the Sixth RECOMB Comparative Genomics Satellite Workshop. Lecture Notes in Bioinformatics. Springer: 2008. p. 113–27.
 7
Than C, Ruths D, Innan H, Nakhleh L. Confounding factors in hgt detection: statistical error, coalescent effects, and multiple solutions. J Comput Biol. 2007; 14:517–35.
 8
Than C, Ruths D, Nakhleh L. Phylonet: a software package for analyzing and reconstructing reticulate evolutionary relationships. BMC Bioinformatics. 2008; 9:322.
 9
Huson DH, Bryant D. Application of phylogenetic networks in evolutionary studies. Mol Biol Evol. 2005; 23(2):254–67.
 10
Huson DH, Scornavacca C. Dendroscope 3: an interactive tool for rooted phylogenetic trees and networks. System Biol. 2012; 61(6):1061–7.
 11
Bouckaert RR. Densitree: making sense of sets of phylogenetic trees. Bioinformatics. 2010; 26(10):1372–3.
 12
Holland BR, Huber KT, Moulton V, Lockhart PJ. Using consensus networks to visualize contradictory evidence for species phylogeny. Mol Biol Evol. 2004; 21(7):1459–61.
 13
Bonnard C, Berry V, Lartillot N. Multipolar consensus for phylogenetic trees. Syst Biol. 2006; 55(5):837–43.
 14
Guénoche A. Multiple consensus trees: a method to separate divergent genes. BMC Bioinformatics. 2013; 14:46.
 15
Szöllősi GJ, Daubin V. Modeling gene family evolution and reconciling phylogenetic discord. Evol Genomics Stat Comput Methods. 2012; 2:29–51.
 16
Maddison D. R. The discovery and importance of multiple islands of mostparsimonious trees. Syst Biol. 1991; 40(3):315–28.
 17
Stockham C, Wang LS, Warnow T. Statistically based postprocessing of phylogenetic analysis by clustering. Bioinformatics. 2002; 18:285–93.
 18
Rousseeuw PJ. Silhouettes: a graphical aid to the interpretation and validation of cluster analysis. J Comput Appl Math. 1987; 20:53–65.
 19
Caliński T, Harabasz J. A dendrite method for cluster analysis. Commun Stat Theory Methods. 1974; 3:1–27.
 20
Kaufman L, Rousseeuw PJ. Finding Groups in Data: an Introduction to Cluster Analysis vol. 344. New York: John Wiley & Sons; 2009.
 21
Makarenkov V, Leclerc B. Circular orders of tree metrics, and their uses for the reconstruction and fitting of phylogenetic trees. In: Math Hierarchies Biol: 1996. p. 183–208.
 22
Leclerc B, Makarenkov V. On some relations between 2trees and tree metrics. Discrete Math. 1998; 192(13):223–49.
 23
Robinson DF, Foulds LR. Comparison of phylogenetic trees. Math Biosci. 1981; 53:131–47.
 24
Bryant D, Tsang J, Kearney P, Li M. Computing the quartet distance between evolutionary trees. In: Proceedings of the eleventh annual ACMSIAM symposium on Discrete algorithms (SODA ’00). Philadelphia: Society for Industrial and Applied Mathematics: 2000. p. 285–6.
 25
Hickey G, Dehne F, RauChaplin A, Blouin C. The computational complexity of the unrooted subtree prune and regraft distance. Technical report, Technical Report CS200606, Faculty of Computer Science, Dalhousie University. 2006.
 26
Amir A, Keselman D. Maximum agreement subtree in a set of evolutionary trees: Metrics and efficient algorithms. SIAM J Comput. 1997; 26(6):1656–69.
 27
Barthélemy JP, McMorris FR. The median procedure for ntrees. J Classif. 1986; 3(2):329–34.
 28
Bruen TC, Bryant D. Parsimony via consensus. Syst Biol. 2008; 57(2):251–6.
 29
Makarenkov V, Leclerc B. Comparison of additive trees using circular orders. J Comput Biol. 2000; 7:731–44.
 30
Dong J, FernándezBaca D, McMorris FR. Constructing majorityrule supertrees. Algorithms Mol Biol. 2010; 5:2.
 31
Jansson J, Shen C, Sung WK. Improved algorithms for constructing consensus trees. J ACM (JACM). 2016; 63(3):28.
 32
Felsenstein J. Numerical Taxonomy vol. 1. New York: Springer; 2013.
 33
Fichet B. Kmeans et Plongements Isométriques: la Distance de RobinsonFoulds Comme Exemple. In: Proceeding of Société Francophone de Classification 2017. Lyon: l’Ecole Polytechnique de l’Université Claude Bernard Lyon 1: 2017.
 34
Hubert L, Arabie P. Comparing partitions. J Classif. 1985; 2(1):193–218.
 35
Steinley D. Properties of the hubertarable adjusted rand index. Psychol Methods. 2004; 9:386.
 36
Steinley D, Brusco MJ, Hubert L. The variance of the adjusted rand index. Psychol Methods. 2016; 21:261.
 37
Rand WM. Objective criteria for the evaluation of clustering methods. J Am Stat Assoc. 1971; 66:846–50.
 38
Hoffman M, Steinley D, Brusco MJ. A note on using the adjusted rand index for link prediction in networks. Soc Netw. 2015; 42:72–9.
 39
Woodhams MD, Lockhart PJ, Holland BR. Simulating and summarizing sources of gene tree incongruence. Genome Biol Evol. 2016; 8(5):1299–315.
 40
Guindon S, Gascuel O. A simple, fast, and accurate algorithm to estimate large phylogenies by maximum likelihood. System Biol. 2003; 52:696–704.
 41
Boc A, Diallo AB, Makarenkov V. Trex: a web server for inferring, validating and visualizing phylogenetic trees and networks. Nucleic Acids Res. 2012; 40(W1):573–9.
 42
Boc A, Legendre P, Makarenkov V. An efficient algorithm for the detection and classification of horizontal gene transfer events and identification of mosaic genes. In: Algorithms Nat Life. Francfort: Springer: 2013. p. 253–60.
 43
Boc A, Makarenkov V. Towards an accurate identification of mosaic genes and partial horizontal gene transfers. Nucleic Acids Res. 2011; 39(21):144.
Acknowledgements
We thank Dr. Bernard Fichet, Dr. Peter G. Foster and two anonymous reviewers for their valuable comments on this manuscript.
Funding
This work was supported by Natural Sciences and Engineering Research Council of Canada and Fonds de Recherche sur la Nature et Technologies of Québec. The funds provided by these funding institutions have been used to pay the stipends of MW and NT, respectively.
Availability of data and materials
All the data presented in this article are available at: https://github.com/TahiriNadia/CKMedoidsTreeClustering. Precisely, the github folder alignment contains the complete set of 52 multiple sequence alignments of archaeal ribosomal proteins studied by MatteTailliez et al., 2002. Using the 47 complete alignments (5 of the 52 original alignments were incomplete), we inferred 47 phylogenetic trees by means of the PHYML method [40]. These trees, studied in our article, are available in the github folder trees.
Author information
Affiliations
Contributions
NT implemented the program, carried out the simulation study, and wrote the manuscript. MW supervised the study and wrote the manuscript. VM designed and supervised the study, and wrote the manuscript. All authors read and approved the final manuscript.
Corresponding author
Ethics declarations
Ethics approval and consent to participate
Not applicable.
Consent for publication
Not applicable.
Competing interests
The authors declare that they have no competing interests.
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver(http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.
About this article
Cite this article
Tahiri, N., Willems, M. & Makarenkov, V. A new fast method for inferring multiple consensus trees using kmedoids. BMC Evol Biol 18, 48 (2018). https://doi.org/10.1186/s1286201811638
Received:
Accepted:
Published:
Keywords
 Cluster validity index
 Consensus tree
 kmedoids
 Phylogenetic tree
 Robinson and Foulds topological distance