Microbiome Preprocessing Machine Learning Pipeline

Yoel Jasner, Anna Belogolovski, Meirav Ben-Itzhak, Omry Koren, Yoram Louzoun

Research output: Contribution to journalArticlepeer-review

14 Scopus citations


Background: 16S sequencing results are often used for Machine Learning (ML) tasks. 16S gene sequences are represented as feature counts, which are associated with taxonomic representation. Raw feature counts may not be the optimal representation for ML. Methods: We checked multiple preprocessing steps and tested the optimal combination for 16S sequencing-based classification tasks. We computed the contribution of each step to the accuracy as measured by the Area Under Curve (AUC) of the classification. Results: We show that the log of the feature counts is much more informative than the relative counts. We further show that merging features associated with the same taxonomy at a given level, through a dimension reduction step for each group of bacteria improves the AUC. Finally, we show that z-scoring has a very limited effect on the results. Conclusions: The prepossessing of microbiome 16S data is crucial for optimal microbiome based Machine Learning. These preprocessing steps are integrated into the MIPMLP - Microbiome Preprocessing Machine Learning Pipeline, which is available as a stand-alone version at: https://github.com/louzounlab/microbiome/tree/master/Preprocess or as a service at http://mip-mlp.math.biu.ac.il/Home Both contain the code, and standard test sets.

Original languageEnglish
Article number677870
JournalFrontiers in Immunology
StatePublished - 18 Jun 2021

Bibliographical note

Publisher Copyright:
© Copyright © 2021 Jasner, Belogolovski, Ben-Itzhak, Koren and Louzoun.


OK and YL acknowledge the Food IoT grant and the Bar Ilan DSI grant. We further thank Dr Roni Shoval for the Mucositis data used here.

FundersFunder number
Bar Ilan DSI


    • 16S
    • ASV
    • OTU
    • feature selection
    • machine learning
    • pipeline


    Dive into the research topics of 'Microbiome Preprocessing Machine Learning Pipeline'. Together they form a unique fingerprint.

    Cite this