Skip to main content

Decontamination, pooling and dereplication of the 678 samples of the Marine Microbial Eukaryote Transcriptome Sequencing Project



Complex algae are photosynthetic organisms resulting from eukaryote-to-eukaryote endosymbiotic-like interactions. Yet the specific lineages and mechanisms are still under debate. That is why large scale phylogenomic studies are needed. Whereas available proteomes provide a limited diversity of complex algae, MMETSP (Marine Microbial Eukaryote Transcriptome Sequencing Project) transcriptomes represent a valuable resource for phylogenomic analyses, owing to their broad and rich taxonomic sampling, especially of photosynthetic species. Unfortunately, this sampling is unbalanced and sometimes highly redundant. Moreover, we observed contaminated sequences in some samples. In such a context, tree inference and readability are impaired. Consequently, the aim of the data processing reported here is to release a unique set of clean and non-redundant transcriptomes produced through an original protocol featuring decontamination, pooling and dereplication steps.

Data description

We submitted 678 MMETSP re-assembly samples to our parallel consolidation pipeline. Hence, we combined 423 samples into 110 consolidated transcriptomes, after the systematic removal of the most contaminated samples (186). This approach resulted in a total of 224 high-quality transcriptomes, easy to use and suitable to compute less contaminated, less redundant and more balanced phylogenies.


Plastid-bearing organisms are scattered across the eukaryotic tree. Among those, CASH lineages have plastids related to red algae, but the mechanisms by which they were acquired and the ancestors involved remain unclear [1,2,3]. To overcome the inconsistencies of purely endosymbiotic models [4], we propose kleptoplastidy [5] as an additional mechanism for explaining plastid spread among CASH lineages. In line with the shopping bag model [6], our hypothesis posits multiple transient interactions with preys of diverse origins but also proposes a rationale for the selective force driving the progressive accumulation of plastid-targeted genes. In such a scenario, also recently proposed by Bodyl [7], the phylogenetic diversity of plastid-targeted genes would be higher than predicted with endosymbiotic models, where genes originate mostly from a single source [8]. Obviously, testing this hypothesis requires a scrupulous phylogenetic study and at the largest scale possible. In addition, the inherent nature of those genes, which are transferred from one lineage to another, makes them hardly distinguishable from actual contaminations, prompting the use of data as clean as possible to avoid false positives. To overcome the limited diversity of complex algal proteomes and reduce the high redundancy of the richly sampled MMETSP transcriptomes [9, 10], we designed a consolidation pipeline. However, we chose to remove the most contaminated samples instead of trying to decontaminate them. This somewhat radical method has the advantage of allowing a more reliable interpretation of downstream phylogenetic analyses at the expense of a moderate loss of taxonomic breadth and richness. We used two methods to estimate contamination levels, one targeting cross-contaminations [11] (between MMETSP samples, using raw reads) and the other targeting more regular contaminations [12, 13] (from any eukaryotic source, using ribosomal markers). Finally, we decided to release the resulting transcriptomes in line with the FAIR data principles [14].

Data description

MMETSP transcriptomic samples [9] cover a wide range of primary and complex algae and were recently re-assembled [10]. Despite showing better annotation overall, we observe high redundancy and contaminations, which complicates the study of plastid spread across eukaryotic lineages. To improve this dataset, we developed a pipeline to eliminate taxonomic redundancy while maximizing data purity and completeness. In detail, out of the 678 samples in MMETSP re-assemblies, 16 were discarded from the start (14 with less than 5000 sequences, 1 with a corrupted FASTQ file and another one because the organism was unknown). The remaining 662 were screened for contaminations with Forty-Two [12, 13] using 78 ribosomal protein markers, and 89 samples were further discarded because they were too contaminated (Data file 1, Data set 1), leaving 573 samples. To minimize taxonomic redundancy, we aimed to combine closely related samples. However, 124 samples represented unique genera and were not combined. As phylogenetic diversity can be very different across protist genera, we determined whether multiple samples within a given genus should be all combined or if some should only be combined at the species/strain level. To this end, we used CroCo [11] and combined the samples that shared a “cross-contamination” value ≥ 10% (interpreted here as close relatedness [11]) (Data file 2). Otherwise, they were left uncombined, even if from the same genus. This dual strategy yielded 110 combined samples (out of 423 candidate samples) and 26 uncombined samples (additional singletons), thereby aggregating 313 redundant samples (Data file 1, Data file 3). From a taxonomic point of view, this combination had the effect of reducing the number of samples by more than 50% for the majority of main phyla (Data file 4), resulting in a total of 260 transcriptomes (combined and singletons, Data set 2). Furthermore, the remaining most contaminated transcriptomes were removed using two strategies, (i) by targeting cross-contaminations with Sobek, a new parallel implementation of CroCo [11] (Data file 5), (ii) after removing intra-sample redundancy with CD-HIT-EST [15, 16] (sequence identity threshold of 95%), by targeting regular contaminations with Forty-Two (Data set 3) [12, 13]. Both detection methods combined pinpointed 36 transcriptomes, corresponding to 97 original samples (Data file 6, Data file 7, Data file 1). Finally, sample completeness was assessed with BUSCO [17, 18] (Data file 8). The resulting data set of 224 transcriptomes (Data set 2) spans a wide range of organisms, especially among photosynthetic species (172/224), with a majority of complex algae (145/224) (Data set 4). Its usefulness is illustrated with the GAPDH phylogeny (Data set 5). Briefly, two different trees were built after enriching the same starting set of sequences from high-quality proteomes [19], one using all 570 samples from plastid-bearing organisms and the other using 172 transcriptomes resulting from our pipeline. The comparison of these two trees shows that the enrichment performed with the data set described here is less contaminated, less redundant and more balanced from a taxonomic point of view, thereby allowing more robust evolutionary interpretations.


  • The way some samples were combined at the genus level might lead to a loss of resolution at the species/strain level within a given genus.

  • Even though combined samples were dereplicated, sequence redundancy remains substantial, especially among dinoflagellates, which are known for bearing multiple copies of their genes.

  • Similarly, even if we provide a set of cleaned transcriptomes, contaminations remain. First, in some cases, such as ciliates, it is a “feature” of the phylum that all its members are highly contaminated. Therefore, we used a phylum-based outlier approach to determine whether a sample was too contaminated, because setting a global threshold for all phyla at once was impracticable. Second, in other cases, contamination by foreign sequences is a “necessary evil” for the reason that we plan to study transferred genes in a plastid acquisition context, and those would be undetectable in a completely “uncontaminated” transcriptome.

Availability of data and materials

The MMETSP re-assemblies analysed during this study are available in the Zenodo repository (,, [9, 10]). All the remaining data generated or analysed during this study are publicly available in the figshare repository (,,,,,,,,,,,, Please see Table 1 and references [20,21,22,23,24,25,26,27,28,29,30,31,32] for details and links to the data.

Table 1 Overview of data files/data sets



Cryptophytes, Alveolates, Stramenopiles, Haptophytes


Marine Microbial Eukaryote Transcriptome Sequencing Project


  1. Zimorski V, et al. Endosymbiotic theory for organelle origins. Curr Opin Microbiol. 2014;22:38–48.

    Article  CAS  PubMed  Google Scholar 

  2. Ponce-Toledo RI, et al. Horizontal and endosymbiotic gene transfer in early plastid evolution. New Phytol. 2019;224(2):618–24.

    Article  PubMed  PubMed Central  Google Scholar 

  3. Sibbald SJ, Archibald JM. Genomic insights into plastid evolution. Genome Biol Evol. 2020;12:978–90.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  4. Keeling PJ. The number, speed, and impact of plastid endosymbioses in eukaryotic evolution. Annu Rev Plant Biol. 2013;64:583–607.

    Article  CAS  PubMed  Google Scholar 

  5. Nowack EC, Melkonian M. Endosymbiotic associations within protists. Philos Trans R Soc Lond B Biol Sci. 2010;365(1541):699–712.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  6. Larkum AW, et al. Shopping for plastids. Trends Plant Sci. 2007;12(5):189–95.

    Article  CAS  PubMed  Google Scholar 

  7. Bodyl A. Did some red alga-derived plastids evolve via kleptoplastidy? A hypothesis. Biol Rev Camb Philos Soc. 2018;93(1):201–22.

    Article  PubMed  Google Scholar 

  8. Archibald JM. Genomic perspectives on the birth and spread of plastids. Proc Natl Acad Sci U S A. 2015;112(33):10147–53.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  9. Keeling PJ, et al. The Marine Microbial Eukaryote Transcriptome Sequencing Project (MMETSP): illuminating the functional diversity of eukaryotic life in the oceans through transcriptome sequencing. PLoS Biol. 2014;12(6):e1001889.

    Article  PubMed  PubMed Central  Google Scholar 

  10. Johnson LK, et al. Re-assembly, quality evaluation, and annotation of 678 microbial eukaryotic reference transcriptomes. Gigascience. 2019.

    Article  PubMed  PubMed Central  Google Scholar 

  11. Simion P, et al. A software tool “CroCo” detects pervasive cross-species contamination in next generation sequencing data. BMC Biol. 2018;16(1):28.

    Article  PubMed  PubMed Central  Google Scholar 

  12. Simion P, et al. A large and consistent phylogenomic dataset supports sponges as the sister group to all other animals. Curr Biol. 2017;27(7):958–67.

    Article  CAS  PubMed  Google Scholar 

  13. Irisarri I, et al. Phylotranscriptomic consolidation of the jawed vertebrate timetree. Nat Ecol Evol. 2017;1(9):1370–8.

    Article  PubMed  PubMed Central  Google Scholar 

  14. Wilkinson MD, Dumontier M, Aalbersberg IjJ, Appleton G, Axton M, Baak A, et al. Comment: The FAIR Guiding Principles for scientific data management and stewardship. Sci Data. 2016;3:1–9.

  15. Li W, et al. Clustering of highly homologous sequences to reduce the size of large protein databases. Bioinformatics. 2001;17(3):282–3.

    Article  CAS  PubMed  Google Scholar 

  16. Li W, Godzik A. Cd-hit: a fast program for clustering and comparing large sets of protein or nucleotide sequences. Bioinformatics. 2006;22(13):1658–9.

    Article  CAS  PubMed  Google Scholar 

  17. Simao FA, et al. BUSCO: assessing genome assembly and annotation completeness with single-copy orthologs. Bioinformatics. 2015;31(19):3210–2.

    Article  CAS  PubMed  Google Scholar 

  18. Waterhouse RM, et al. BUSCO applications from quality assessments to gene prediction and phylogenomics. Mol Biol Evol. 2018;35(3):543–8.

    Article  CAS  PubMed  Google Scholar 

  19. Van Vlierberghe M, Philippe H, Baurain D. Broadly sampled orthologous groups of eukaryotic proteins for the phylogenetic study of plastid-bearing lineages. BMC Res Notes. 2021;14:21–4.

    Article  Google Scholar 

  20. Van Vlierberghe M, Di Franco A, Philippe H, Baurain D. Data file 1—Methods. 2021. Figshare.

  21. Van Vlierberghe M, Di Franco A, Philippe H, Baurain D. Data set 1—Forty-Two reports and configuration files (662 individual samples). 2021. Figshare.

  22. Van Vlierberghe M, Di Franco A, Philippe H, Baurain D. Data file 2—Consolidation table. 2021. Figshare.

  23. Van Vlierberghe M, Di Franco A, Philippe H, Baurain D. Data file 3—Sample consolidation report. 2021. Figshare.

  24. Van Vlierberghe M, Di Franco A, Philippe H, Baurain D. Data file 4—Redundancy drop analysis. 2021. Figshare.

  25. Van Vlierberghe M, Di Franco A, Philippe H, Baurain D. Data set 2—Transcriptomes. 2021. Figshare.

  26. Van Vlierberghe M, Di Franco A, Philippe H, Baurain D. Data file 5—Sobek analysis summary. 2021. Figshare.

  27. Van Vlierberghe M, Di Franco A, Philippe H, Baurain D. Data set 3—Forty-Two reports and configuration files (260 transcriptomes). 2021. Figshare.

  28. Van Vlierberghe M, Di Franco A, Philippe H, Baurain D. Data file 6—Consolidated sample purity (cross-contaminations). 2021. Figshare.

  29. Van Vlierberghe M, Di Franco A, Philippe H, Baurain D. Data file 7—Consolidated sample purity (contaminations). 2021. Figshare.

  30. Van Vlierberghe M, Di Franco A, Philippe H, Baurain D. Data file 8—Completeness analysis. 2021. Figshare.

  31. Van Vlierberghe M, Di Franco A, Philippe H, Baurain D. Data set 4—Taxonomic samplings. 2021. Figshare.

  32. Van Vlierberghe M, Di Franco A, Philippe H, Baurain D. Data set 5—GAPDH phylogenies. 2021. Figshare.

Download references


Not applicable.


Mick Van Vlierberghe was a FRIA fellow of the F.R.S.-FNRS (National Fund for Scientific Research of Belgium). Computational resources were provided through two Grants to Denis Baurain (University of Liège “Crédit de démarrage 2012” SFRD-12/04; FRS-FNRS “Crédit de recherche 2014” CDR J.0080.15).

Author information

Authors and Affiliations



MVV and DB designed the experiments, MVV performed all the computational analyses and drew the figures, MVV and DB wrote the manuscript. ADF and HP prototyped contamination analyses based on ribosomal markers and HP further substantively revised the work. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Denis Baurain.

Ethics declarations

Ethics approval and consent to participate

Not applicable.

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit The Creative Commons Public Domain Dedication waiver ( applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Van Vlierberghe, M., Di Franco, A., Philippe, H. et al. Decontamination, pooling and dereplication of the 678 samples of the Marine Microbial Eukaryote Transcriptome Sequencing Project. BMC Res Notes 14, 306 (2021).

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: