Machine learning analysis of microbial flow cytometry data from nanoparticles, antibiotics and carbon sources perturbed anaerobic microbiomes
Journal of Biological Engineeringvolume 12, Article number: 19 (2018)
Flow cytometry, with its high throughput nature, combined with the ability to measure an increasing number of cell parameters at once can surpass the throughput of prevalent genomic and metagenomic approaches in the study of microbiomes. Novel computational approaches to analyze flow cytometry data will result in greater insights and actionability as compared to traditional tools used in the analysis of microbiomes. This paper is a demonstration of the fruitfulness of machine learning in analyzing microbial flow cytometry data generated in anaerobic microbiome perturbation experiments.
Autoencoders were found to be powerful in detecting anomalies in flow cytometry data from nanoparticles and carbon sources perturbed anaerobic microbiomes but was marginal in predicting perturbations due to antibiotics. A comparison between different algorithms based on predictive capabilities suggested that gradient boosting (GB) and deep learning, i.e. feed forward artificial neural network with three hidden layers (DL) were marginally better under tested conditions at predicting overall community structure while distributed random forests (DRF) worked better for predicting the most important putative microbial group(s) in the anaerobic digesters viz. methanogens, and it can be optimized with better parameter tuning. Predictive classification patterns with DL (feed forward artificial neural network with three hidden layers) were found to be comparable to previously demonstrated multivariate analysis. The potential applications of this approach have been demonstrated for monitoring the syntrophic resilience of the anaerobic microbiomes perturbed by synthetic nanoparticles as well as antibiotics.
Machine learning can benefit the microbial flow cytometry research community by providing rapid screening and characterization tools to discover patterns in the dynamic response of microbiomes to several stimuli.
The science of microbial ecology is on the verge of revolution  partly due to the decreasing costs of next generation sequencing (NGS)  and the increasing popularity of flow cytometry microbial characterization [3, 4]. The current processing pipeline for NGS requires ~ 14 h compared to ~ 2 h for flow cytometry. At this time, flow cytometry is significantly more high throughput for resolving rapid dynamic changes in the structure and function of the microbial communities over time, which is particularly crucial for studying health and wellness in dynamic biosystems . To keep up with the information throughput, there is a need to develop tools that measure microbiome features beyond genomic or functional diversity . During the past 50 years, flow cytometry has been proven as an established tool for single cell analysis [7, 8]. Currently, there are over 100 companies in the flow cytometry business worldwide constituting more than $3 billion . Since its genesis in 1965  and increased popularity since the 1970s , the basic design of flow cytometers has remained almost unchanged, which emphasizes its technological robustness and is an ideal tool for building actionable solutions for microbiome research community.
Previously, we demonstrated the utility of flow cytometry in classifying microbial consortia based on morphological and metabolic characteristics complementing existing genomic technologies in rapid characterization of microbiome dynamics . With advances in cytometry, the number of parameters that can be measured simultaneously from single particles has increased multifold; most notable of these advances are the addition of more powerful lasers . Over the last decade, 18-parameter measurements  have given way to 30-parameter flow cytometers , with 100-parameter flow cytometry on the horizon . High-throughput data acquisition, minimum sample preparation, and more parameters per cell, are now producing massive, high-dimensional datasets. Classical approaches to community ecology studies will need to be augmented with novel computational techniques to enable the analysis of these huge multidimensional datasets .
Similar to our previous demonstration , there are number of papers demonstrating the effectiveness of flow cytometry in the characterization of microbial community changes [18,19,20,21,22]. However, there are very few papers illustrating the possibility of the use of machine learning models to classify microbial samples studied by flow cytometry. A good overview of microbial flow cytometry fingerprinting literature, which deals with the extraction of variables based on flow cytometry data has been presented previously . Similar methods have been proposed  and used  as data mining methods, from which resulting variables can be incorporated in machine learning models. Machine learning approaches have been attempted previously at the single-cell level for microbial flow cytometry data [26,27,28]. While most of these demonstrations were based on either staining microbial population of interest [29, 30] or attempting to analyze entire scatter pattern , it was evident from our prior demonstration  that with label-free flow cytometry parameters, it was possible to monitor and rapidly characterize the dynamics of complex anaerobic microbiomes associated with perturbations in its environmental factors.
Hence, here we demonstrate the use of open-source machine learning tools to analyze flow cytometry data generated in the anaerobic microbiome perturbation experiments exploiting the three-dimensional flow cytometry signals namely cell size (FSC or forward scatter), cell granularity/morphology (SSC or side scatter) and autofluorescence (corresponding to the same excitation/emission wavelength as in AmCyan standard dye). We also demonstrated for the first time, the use of unsupervised autoencoders for microbial flow cytometry data. Applications of the machine learning analysis of microbial flow cytometry data in potentially improving the performance of biodigesters, and to characterize the syntrophic resilience  of the microbial community structure when exposed to nanoparticles and antibiotics has also been demonstrated. Perhaps in the future such tools would enable futuristic endeavors such as waste treatment in long-term human spaceflight missions [32,33,34] or to transform human waste into food .
Autoencoders as a powerful tool for anomaly detection in microbiomes perturbed with controlled carbon sources
Figure 1 shows the results from the h2o.ai’s unsupervised and non-linear autoencoder deep learning model. Communities perturbed with the controlled addition of GLUC and CELL looked different than the normal community and that with the controlled addition of other carbon sources. Interestingly, day 2 corresponded to peak biogas production for CELL at 272 mL while other days were in the range of 25–40 mL as shown in the Additional file 1: Figure S2. If this is compared with the clubbed predictions (Additional file 1: Figure S3), putative hydrolyzers (HYDRO) (i.e. CELL) were misclassified as putative acetogens (ACETO) which were same as CELL - PROP clubbing observed previously  and in the biogas plots (Additional file 1: Figure S2). Putative acidogens (ACIDO) (i.e. GLUC) and ACETO (i.e. PROP and BUTY) were also predicted well. These syntrophic acetogenic communities are believed to be very important in maintaining stable and robust anaerobic operation [36, 37].
Putative functional group-level comparison with different machine learning models
Table 1 lists prediction accuracies for the different models in the h2o.ai’s supervised learning data science algorithms suite. All models were evaluated on the test set (25% of the dataset). The performance of the models has been reported under tested conditions as described in ‘Methods’ section (hyperparameter values in Additional file 1: Section A2), and it can be optimized with better parameter tuning. Gradient boosting (GB) performed slightly better overall than deep learning (DL) (feed forward artificial neural network with three hidden layers) with 71.26% and 70.55% prediction accuracies respectively under tested conditions. Both Naïve Bayes (NB) and distributed random forests (DRF) had lower overall prediction accuracies on test sets (60.44% and 53.55% respectively) under tested conditions. From the area under the curve (AUC) plots shown in Fig. 2 and reported values in Table 2, DL (feed forward artificial neural network with three hidden layers) consistently outperformed all the other methods evaluated under tested conditions and marginally better than GB for the most important classes in anaerobic bioreactors (ACETO and METHA) [38,39,40], indicating that a single feed forward artificial neural network with three hidden layers model could be tuned for this task. The results were in concordance with similar supervised model comparison studies where feedforward neural nets have been concluded to perform best among various algorithms [41, 42].
The limitations of the DL (feed forward artificial neural network with three hidden layers) in predicting methanogens (Table 1) were also evident in the clubbed prediction as shown in the Additional file 1: Figure S2 where putative methanogens (METHA) contradicted the expectations. Additionally, to ensure that we are not overfitting our models, we also trained them with 5-fold cross validation (results in Additional file 1: Table S4). The accuracy scores from this exercise followed similar trends, indicating that our models were rather stable and not overfitted.
Predictive capabilities with deep learning (feed forward artificial neural network with three hidden layers)
Since DL is increasingly popular because of its facility in handling large amount of data , and since one of the objectives of this paper is to illustrate the possibility of classifying large flow cytometry data sets in the field of anaerobic microbiology using machine learning for routine on-site microbiomes analysis, we examined its performance in classifying ‘sample vs predicted’ carbon sources. Figure 3 shows the results of the supervised DL model (feed forward artificial neural network with three hidden layers). In accordance with the results from classical multivariate analysis listed in our previous publication which showed that glucose (GLUC) looked very different from the rest , the classification probability for GLUC was best amongst tested carbon sources, followed by propionate (PROP) followed by sludge (SLUD). The variable importance output from h20.ai’s Flow platform reported in Additional file 1: Figure S7 shows that forward scatter (FSC) variables (<V1000) stood out to be the most relevant in DL model (feed forward artificial neural network with three hidden layers). As demonstrated in the multivariate analysis on microbial flow cytometry data in our previous publication , GLUC showed a distinct pattern in reaching a stable extremum in the colony structure, which was a point corresponding to minimum change. Additionally, both the peak and non-peak GLUC samples clustered separately in the multidimensional spacing (MDS) plot published previously , which was in accordance with the results presented here from the DL model (feed forward artificial neural network with three hidden layers). Further, blank samples (NONE), acetate (ACET) and sludge (SLUD) clustered separately in flow cytometry MDS plot  which resembled to NONE, ACET and SLUD misclassification evident in Fig. 3.
In the additional experimental set, when the cytometric fingerprints from individual carbon sources namely glucose (GLUC), cellulose (CELL), propionate (PROP), butyrate (BUTY), acetate (ACET) were trained with cytometric fingerprints from all carbon sources combined (WFED) and that from the starved community (STVD) samples. The expectation was that well-fed (WFED) community would display some degree of misclassification towards one of the five carbon sources. However, to our surprise, WFED community looked totally different than the rest and was more like STVD than individual carbon sources (confusion matrix in Additional file 1: Table S3, associated plot in Additional file 1: Figure S10). Furthermore, to evaluate the specificity of the models, a completely new carbon source in the form of newsprint waste (NEWS) was evaluated. Data from NEWS samples were trained with the other individual carbon sources data. Considering the primary composition of newspaper waste to be cellulosic fibers, the expectation was that it would display some similarity with CELL. Once again to our surprise, NEWS community looked totally different than rest of the carbon sources. These results point towards the uniqueness of flow cytometry signatures from complex carbon sources perturbed microbiomes in anaerobic digesters.
Applications in elucidating functionally redundant microbiomes
To test the practical utility of the best performing DL model (feed forward artificial neural network with three hidden layers) beyond carbon sources, model implementation exercises were carried out with a separate set of perturbations namely a) nanoparticles and b) antibiotics. Interestingly even though the community looked quite different from one another, none showed any toxic impact on anaerobic digestion process observed in terms of biogas production, methane composition, Total Chemical Oxygen Demand (TCOD)/ Soluble Chemical Oxygen Demand (SCOD) reduction and Volatile Fatty Acids (VFA) accumulation (data not presented due to non-significance) with respect to both positive and negative controls for the nanoparticles and antibiotic (tetracycline) tested.
The deep learning (feed forward artificial neural network with three hidden layers) analysis of flow cytometry data of nanoparticles perturbed community is shown in the Fig. 4. As evident, each nanoparticle-perturbed community looked different from one another and hence got predicted very well. TIH and TIL which were titanium (IV) oxide nanoparticles (TINPs) in high and low concentrations respectively have shown a little deviation and got misclassified as ferrous nanoparticles (FENPs) community in a few instances. The positive control (PCH) and negative control (NCH) got classified with less prediction scores when trained with nanoparticles than carbon sources. The community shifts in the context of community morphology were severe under nanoparticles compared to carbon sources.
Unsupervised autoencoders were also found to be marginally useful in predicting structural changes in the antibiotic-perturbed community. As shown in Fig. 5, literature  reported toxic level for tetracycline (TC2) and higher dosage (TC3) on day 50 got misclassified than the rest. Furthermore, TC2 might have started displaying maximum perturbation effects right from d 5 as evident from the misclassification instance for TC2D05 in Fig. 5. Both biogas (Additional file 1: Figure S8) and MDS (Additional file 1: Figure S9) plot on tetracycline perturbed samples displayed differences in community from day 0 and day 50. In the unsupervised autoencoder analysis, the community perturbed with higher concentration of TINPs on both the time points and higher concentration of carbon nanotubes (CNTs) on earlier time point looks different than the normal community (Additional file 1: Figure S4).
The machine learning approaches to the microbial flow cytometry dataset are still in infancy but the results presented here from the analysis of 1,500,000 microbes corresponding to each perturbation incidence (nanoparticles, antibiotics and carbon sources) demonstrate that it has much greater potential compared to the tradition microbial ecology statistical analysis like MDS as demonstrated in our previous publication  or similar Principal Component Analysis (PCA). Furthermore, our demonstration with five-fold cross validation assures the stability of various machine learning models against potential biases. With the advancement in the high-throughput nature of flow cytometry, combined with the increasing capacity to measure more cell parameters at once, massive and high-dimensional datasets on a routine daily basis would be generated in future and would add to the predictive power of the machine learning based approach .
Even though dimensionality reduction was not an objective, autoencoders were found to be powerful in learning a lower dimensional representation of the data. We do not suggest it replace dimensionality reduction analysis, nor do we intend it as a preprocessing step for DL models. Our work using autoencoders suggests that tools like the autoencoders can identify perturbations and hence may be valuable in stochastic optimization of the classical process design in the field of bioprocess engineering. While the current paradigm of process design is based on throughput rate, process yield and product purity , with the novel combination of cytometric fingerprinting and machine learning like the demonstrated autoencoders, process engineers may be able to optimize the digesters in real time, bypassing conventional lab-pilot-operations route .
The motivation behind the model comparison exercise was to see if one algorithm was better at predicting putative microbial group phenotypes than other. The efficiency in terms of speed and resources for model optimization, training and validation would be altogether different track of inquiry and it was not used for comparison in the proposed approach. AUC measured the probability that given two random points, one that is positive and other negative for the class of interest, the classifier scored the positive point higher than the negative one . Considering the size and complexity of microbial flow cytometry data in anaerobic perturbations experiments, AUC acted as a yardstick for comparing the performance of the machine learning models used in the present study. Discrepancies in the trends between Tables 1 and 2 can be attributed to the fact that accuracies were computed at the set threshold values, while AUCs were computed by adding all the accuracies computed for all the possible threshold values. The ROCs in Fig. 2 could be perceived as an average (expected value) of those accuracies computed for all threshold values.
Under tested conditions, DRF worked better for putative methanogens, however the performance can be optimized with better parameter tuning. DRF generated a forest of classification (or regression) trees, rather than a single classification (or regression) tree. Each of these trees was a weak learner built on a subset of rows and columns . More trees would have reduced the variance . Both classification and regression took the average prediction over all their trees to make a final prediction, whether predicting for a class or numeric value . Physiologically it may be too short of a time to get distinguishing phenotypic signatures for DL algorithm at the single cell level for methanogens [21, 50]. The stability of bioreactors is dependent on controlling acid build up and acid removal . With slightly better AUC values for METHA and ACETO, DL seemed to satisfactorily perform under tested conditions in detecting perturbations in anaerobic bio-digesters. As demonstrated in Additional file 1: Figure S7, FSC variables (depicting size and morphology of individual cells) were the most important variables and DL appeared to perform better under tested conditions at classifying cells based on its size and morphological feature . The tunability of a single DL model for multiple putative groups makes it computationally convenient for routine on-site microbiomes analysis.
The substrate composition determines the microbial community composition and organization [52, 53]. Indeed, it not only defines reactor conditions , but also provides the introduction of new species that are present in the substrate matrix, as, for instance, is the case for manure and waste activated sludge . We were surprised that the samples fed with all five carbon sources at once did not get classified as one of the carbon sources. There might be a physiological explanation for different than normal behavior as reported by previous studies focused on studying structure-function relationships of anaerobic microbiomes [56,57,58,59]. Smithllela, Syntrophobacter, and Pelotomaculum might have the ability to break down CELL faster than classical hydrolyzers like Clostridium or have greater doubling time . PROP species predominantly fall in the genera Smithllela, Syntrophobacter, and Pelotomaculum [61, 62] while BUTY species in the genera Syntrophus and Syntrophomonas . There have been reported phenotypic/physiological similarities between species of these two genera that may explain this trend [64, 65].
The composition of newspaper is reported as cellulose (glucose polymer), wood fiber (with 65.8% glucose, 19.8% xylose, 12.5% galactose and 1.3% mannose) . The newspaper waste (NEWS) was a different type of carbon source compared to the earlier experiments with lab grade carbon sources. We were surprised that NEWS did not get misclassified as either CELL or GLUC but was distinctly predictable. It is possible that distinct groups of hydrolyzers and acidogens might be involved in initial degradation of newsprints than those feeding on pure cellulose or glucose [66, 67]. The accurate classification of various group of putative hydrolyzers and acidogens might become valuable in the routine monitoring of the anaerobic digesters in near future .
Even though the present results and the current associated literature  suggests no quantifiable toxicity of some nanoparticles on anaerobic digestion, the effect of NP-solvents was sometimes more significant than that of the NPs themselves - a point that may be of special interest for future nanotoxicological studies. The absence of observable toxicity from the exposure to tetracycline in terms of physico-chemical performance of the anaerobic culture was surprising. Both the nanotoxicity and antibiotics perturbation experiments were designed considering the current environmentally relevant concentrations . With nanoparticles finding wider application in industrial products, such as antibacterial coatings, catalysts, biomedicine, skin creams and toothpastes, the magnitude of environmentally relevant concentrations may change in the future. Similarly, antibiotics can create perturbations and change the dynamics of the complex anaerobic microbial community. The present exercise demonstrates that flow cytometry can be used to monitor shifts away from normal microbial patterns. Our results suggest that even though the physiochemical parameters are not detectably different, changes in the community structure may be indicative of a community that may eventually break down.
Autoencoders were found to be powerful in detecting anomalies in flow cytometry data from nanoparticle- and carbon source-perturbed anaerobic microbiomes but marginally so for antibiotic-perturbed communities. Anaerobic microbiomes displayed functional redundancy under nanotoxicity and antibiotic perturbations. Predictive classification patterns with supervised feed forward artificial neural network with three hidden layers were found to be robust. Model comparison exercise based on predictive capabilities concluded that under tested conditions, gradient boosting (GB) and deep learning (DL) (feed forward artificial neural network with three hidden layers) were marginally better at predicting overall community structure while distributed random forests (DRF) worked better at predicting methanogens, and it can be optimized with better parameter tuning. Flow cytometry data generated in various anaerobic microbiome perturbation experiments could be analyzed by various machine learning approaches for actionable insights.
The source of anaerobic culture, controlled perturbations and flow cytometric analysis were same as described in previously . In summary, each of 100 ml of the triplicate mesophilic anaerobic microbiome batch assays were perturbed with different carbon sources separately (part of the dataset published previously ) and combined (new experiments). In addition, separate controlled perturbations were carried out in each of 100 ml of the triplicate mesophilic anaerobic microbiome batch assays with different nanoparticles, tetracycline antibiotics and newsprint waste.
Individual carbon sources with 2000 mg/L chemical oxygen demand (COD) of glucose (GLUC), cellulose (CELL), propionate (PROP), butyrate (BUTY), acetate (ACET) separately as well as five of them combined (WFED) were added to individual batch assays. The chemical properties of the sludge (SLUD) used in this research are summarized in Additional file 1: Table S1. The peak day samples corresponded to the maximum biogas production observed (Additional file 1: Figure S2). Samples with no additional carbon sources were represented as NONE or starved (STVD). The experimental design has been shown in the Additional file 1: Figure S1. The data with individual carbon sources has been published previously . The data with the combined five carbon sources as well as nanoparticles, tetracycline antibiotics and newsprint waste were from the separate unpublished experiments.
Conceptual division of putative microbial group(s)
For the clubbed flow frame analysis, the sample names were clubbed as per the conceptual division of putative microbial groups in anaerobic digestion process. The four groups were: (1) Putative hydrolyzes represented by “HYDRO” which were samples fed with cellulose (CELL) (2) Putative acidogens represented by “ACIDO” which were samples fed with glucose (GLUC) (3) Putative syntrophic acetogens represented by “ACETO” which were clubbed samples fed with propionate (PROP) and butyrate (BUTY) individually (4) Putative methanogens represented by “METHA” which were clubbed samples fed with acetate (ACET), sludge (SLUD) individually as well as those fed with no carbon source (BLAN and NONE). The reason behind clubbing ACET, SLUD, BLAN and NONE into METHA putative group was because all these samples were supposedly methanogenic samples with acetate utilizing methanogens were the predominant group in the waste water treatment plant anaerobic digesters .
The feedstock used for the lab tests for the proposed campus anaerobic digester was newsprint from day-old Daily Illini Newspaper obtained from the waste sorting facility. Newsprint samples were either ground to powder, shredded to strips in an office paper shredder or whole pieces hand cut to size for required weight in each experiment. The goal was to predict the newspaper cytometric fingerprints (abbreviated as NEWS) off the carbon sources dataset generated with the proposed flow cytometry methodology.
For the nanotoxicity experiments, the sludge samples (SLUD) were mixed with various nanoparticles in low (L) 1 mg/g-TS (total solids) and high (H) 10 mg/g-TS concentrations. Plain sludge with anaerobic inoculum from active anaerobic digesters but no nanoparticles added was set up as a positive control (PCH) and anaerobic inoculum from the active anaerobic digesters without sludge or nanoparticles was set up as a negative control (NCL). The alleged toxic impact of nanoparticles on anaerobic digestion process was quantified by monitoring the biogas production daily along with gas composition, TCOD/ SCOD reduction and VFA production on biweekly basis. Drawing the samples for flow cytometric analysis every week helped build the cytometric fingerprints of the perturbed community, which forms the basis for subsequent machine learning analysis. TINPs are titanium (IV) oxide, anatase nanopowder, < 25 nm particle size, 99.7% trace metals basis, specific surface area 45–55 m2/g obtained from Sigma Aldrich (Catalog # 1317-70-0). FENPs are iron nanopowder, 25 nm average particle size, 99.5% trace metals basis from Sigma Aldrich (Catalog # 7439-89-6). CNTs are multi-walled carbon nanotube which are reported thin and short, < 5% metal oxide powder also from Sigma Aldrich (Catalog # 308068–56-6).
For the antibiotics perturbation experiments, the sludge samples (SLUD) were mixed with tetracycline (Empirical Formula - Hill Notation: C22H24N2O8·xH2O, Molecular Weight: 444.43 anhydrous basis) obtained from Sigma Aldrich (CAS Number: 60–54-8). Tetracycline was reported to be profound inhibitors of anaerobic digestion, inhibiting methane production by up to 50% with a concentration of 40 mg/L . Hence, to generate varying datasets for machine learning analysis of microbial samples, tetracycline with 20 mg/L (TC1), 40 mg/L (TC2) and 80 mg/L (TC3) concentrations were used along with positive (TC4) and negative (TC5) controls as described in the previous section.
Flow cytometry analysis
Samples of the anaerobic microbial communities were collected from each serum bottle via a syringe with a 18 gauge needle (every 24 h following a biogas measurement for carbon sources). Initial sample (NONE_0) was the same for all the assays, which was the fresh inoculum. 750 μL of sample from each serum bottle was strained prior to flow cytometry using BD Falcon 12 × 75 mm Tube with Cell Strainer Cap having a 35 μm nylon mesh (Catalog No. 352235). The strained samples were suspended in Phosphate-buffered saline (PBS)-1X. Analyses were performed immediately on a Bio-sciences LSR II Flow Cytometry Analyzer. The excitation laser was tuned for 405-nm. Autofluorescence was measured as light passing a 450/50 photomultiplying tubes (PMT) and band pass filter with no long pass dichroic mirror. Signals were amplified with a 4-decade log amplifier and collected at a rate of approximately 1000 events per second. The fixed gating template as shown in the Additional file 1: Figure S6 (a) was used based on the control beads run (Additional file 1: Figure S6 (b)). Background events corresponding to dead/junk cells along with high FSC events (putative doublets) were excluded from the analysis (Additional file 1: Figure S6 (c)). Total 100,000 events collected for each sample were stored in corresponding Flow Cytometry Standard (fcs) files.
Training and test dataset creation
For the machine learning based analysis, the fcs files obtained from a BD Bioscience LSR II Flow Cytometry Analyzer were imported. Each file comprised of 100,000 events representing 100,000 cells. The fcs file contained values for multiple parameters for each cell. But for our analysis we only chose “FSC-A”, “SSC-A” and “AmCyan-A” because in our previous publication , FSC or forward scatter, SSC or side scatter representing cell size, granularity/morphology respectively and autofluorescence (corresponding to the same excitation/emission wavelength as in AmCyan standard dye) were found to have maximum information. So, from each fcs file we get a matrix of 100,000 events with 3 columns (“FSC-A”, “SSC-A” and “AmCyan-A”) each.
Classifying single cells (also known as ‘events’) was out of purview of present study. Rather, we were interested in classifying distributions of events to understand microbial community dynamics specific to each perturbation. Our data was normally distributed in the measured flow cytometry values, hence we decided to combine 1000 events into a data point or a vector of 3000 values (1000 events comprising of 3 values corresponding to “FSC-A”, “SSC-A” and “AmCyan-A”) because the Wald Type confidence interval  with 3% error required a sample size of 1000. Additionally, the distribution of “FSC-A”, “SSC-A” and “AmCyan-A” values for all methanogens groups in the test set (described below) as well as the distribution of the same values in one randomly chosen vector of 1000 events has been presented in Additional file 1: Section A.3. Upon visual inspection, it is evident that the vector of 1000 events was able to capture the complexity and discriminative information of single cell variability in the population. There have been various workflows proposed for the data processing, feature extraction and data analysis of cytometric fingerprints applying Dalmatian Plot, CHIC, CyBar, or FlowFP , however majority of these were tested on the 2-dimenstional cytometric fingerprints, staining with one or more dyes. Previously, we have demonstrated correlation between prevalent community fingerprinting techniques like automated ribosomal intergenic spacer analysis (ARISA) and label-free, raw 3-dimensional cytometric fingerprints based on “FSC-A”, “SSC-A” and “AmCyan-A” . The focus of this paper is to demonstrate the fruitfulness of machine learning algorithms in analyzing such label-free, raw 3-dimensional cytometric fingerprints. The presented framework could also potentially be applied to other approaches like Dalmatian Plot, CHIC, CyBar, or FlowFP from the flow cytometry fingerprinting literature to extract distribution-level features and/or with distribution level statistics such as the mean, standard deviation, percentile values etc.
Since there were 100,000 events in each fcs file, we got 100 such vectors. As described, we conducted each experiments in triplicate ranged over five time points, we had 1,500,000 (300,000 × 5) events for each perturbation incidence (carbon sources, nanoparticles, antibiotics) thereby generating a rich dataset with 1500 vectors representing each label. This dataset was then split into 75% training (1125 vectors) and 25% test (375 vectors) sets for each label. We decided to create a larger training split compared to testing since it is customary practice in machine learning community . Additionally, we performed grid search (hyperparameters are reported in Additional file 1: Section A2) with nested cross-validation (four-folds outer and three-folds inner) on the training set (75% of dataset) to tune the hyperparameters . The outer-fold creates non-overlapping datasets to evaluate the results of the inner-fold grid search cross validation. The best hyperparameters were selected based on the accuracy scores and standard deviation on the non-overlapping datasets in the outer-fold. The best hyperparameters from nested cross-validation were evaluated on the test set (25% of dataset).
An h2o.ai server was set-up as per instructions  (http://www.h2o.ai/) and the data was uploaded in individual comma-separated values (CSV) files. The fcs files and associated code are available at: https://github.com/adhoble/CFML-Perturb. The fcs files were also submitted to the Flow Repository (https://flowrepository.org/). (Repository ID: FR-FCM-ZYK4).
Explanation of machine learning models
An autoencoder learns a lower dimensional representation of the data by trying to learn an approximation of the identity function . It is a feed-forward neural network where the hidden layer(s) compress(es) the input data and the output layer attempts to reconstitute the input data from the compressed encoding. This compressed encoding is the representation of the input data. This method can be used for anomaly detection such as email spams or financial frauds using the reconstruction mean squared error (MSE) on new data . The MSE is defined by L (x, x’) = || x -x’||2 where x is the input vector (true value) and x’ is the vector reconstructed by the autoencoder (estimated/predicted value). Higher the MSE value, more anomalous a sample in relation to the pattern found in a whole dataset and the threshold MSE would vary with the particular perturbation experiment under consideration.
In our implementation of autoencoders, the h2o.ai function ‘deeplearning’ was used with ‘autoencoder’ option turned on and one hidden layer of 2000 nodes.
Deep learning (feed forward artificial neural network with three hidden layers) (DL)
A feed forward artificial neural network model or a deep neural network model is an arrangement of layers of neurons (inspired by biological neurons in human brain) with weighted connections such that there are no loops . These neurons have activation thresholds which, if exceeded by a linear combination of the weight associated with incoming connections and data passed to them, are fired. During training, this model learns the weights of the connections to approximate any general target function.
In our implementation of deep learning (feed forward artificial neural network with three hidden layers), the default rectifier with dropout was selected for activation. The network contained input dropout ratio of 0.1, hidden dropout ratios of 0.2, 0.2, 0.1 and a default hidden layer sizes 2000,1000,500 were used. Number of epochs (i.e. number of times to iterate the dataset) were selected to 10. To add stability and improve generalization, either L1 or L2 regularization was used with the value of 1e-5 each.
Distributed random forests (DRF)
Random forests are type of ensemble machine learning methods commonly used for classification and regression. They extend decision trees by training many trees on random subsets of training data sampled with replacement . Additionally, during the training of each tree, each split in the tree is generated from a random subset of the features. After training, test data predictions are generated by averaging the predictions from all the trees trained. These two extensions decrease the variance in the model to reduce the problem with overfitting in decision trees at the expense of slight increase in the bias .
In our implementation of distributed random forests, for each classification task, the h2o.ai function ‘randomForest’ was used with 200 trees, maximum depth of 20 levels and respective training and validation data for the task. The other parameters were set to their default values.
Gradient boosting (GB)
Gradient boosting machine is an ensemble method based on the idea that multiple weak learners can perform better than a single strong learner . In the case of gradient boosting machines, the weak learners are short regression trees. At each iteration, a new tree is added that minimizes the loss function while keeping the other trees frozen. Additionally, at each iteration the loss function is modified such that training data points that were previously misclassified are weighted strongly. These methods are generally used as algorithms to rank a list such as in web search. This method is less susceptible to overfitting and does not suffer from the curse of dimensionality, however it is sensitive to noisy data and outliers .
In our implementation of gradient boosting, for each classification task, the h2o.ai function ‘gbm’ was used with 200 trees and maximum depth of 5 levels as per recommended range of 4 to 8 levels  wherein results were found insensitive to values chosen in this range.
Naïve Bayes (NB)
Naïve Bayes is a supervised classification method that constructs conditional probability distributions, p (Ck | X1,….,Xn), for each category Ck, where X1,….,Xn are the features used in training . When new data is presented to the model, each category with the highest probability is assigned to the data point corresponding to unique features. It is a common baseline method for tasks such as text categorization, for identifying spams as well as in automatic medical diagnostics. This method makes a naïve assumption of independence of the features which may or may not be accurate given the nature of the data or process being modelled. However, these assumptions help it avoid the curse of dimensionality wherein an exponentially increasing amount of data is required with increasing features. In fact, the joint conditional probability distribution of the features can be calculated from the individual conditional feature distributions  .
In our implementation of Naïve Bayes, for each classification task, the h2o.ai function ‘naiveBayes’ was used with the default parameters and respective training and validation data for the task.
To examine which of the measured flow cytometry features were most important in the deep learning (feed forward artificial neural network with three hidden layers) analysis, the variable importance option was turned and visualized in h2o.ai’s Flow platform. Variable importance is notoriously difficult to compute for deep learning (feed forward artificial neural network with three hidden layers). The implemented method by Gedeon  considers the weights connecting the input features to the first two hidden layers. Our analysis was based on three flow cytometry features namely “FSC-A”, “SSC-A” and “AmCyan-A” corresponding to V1-V1000, V1001–2000 and V2001–3000 variables respectively in h2o Flow.
Receiver operating characteristic (ROC) curves
Area under the curve (AUC) analysis was performed for the clubbed data set on its test set split to test for robustness of the models. Since the models were multi class classification models, AUC values and receiver operating characteristic (ROC) curves were calculated by dividing the four-class prediction problem into four one-vs-all binary classification problems using the pROC package in R .
Area Under the Curve
Blank sample (no carbon source)
Chemical Oxygen Demand
Deep Learning (feed forward artificial neural network with three hidden layers)
Distributed Random Forests
Flow Cytometry Standard
Mean Square Error
Next Generation Sequencing
No carbon source added
Principal Component Analysis
Receiver Operating Characteristic
Soluble Chemical Oxygen Demand
Starved (samples with no carbon source)
Total Chemical Oxygen Demand
Titanium(IV) oxide Nanoparticles
Volatile Fatty Acids
Well fed (all carbon sources combined)
Paliy O, Shankar V. Application of multivariate statistical techniques in microbial ecology. Mol Ecol. 2016;25:1032–57. Available from: http://doi.wiley.com/10.1111/mec.13536. [cited 5 Feb 2018]
Diodato D, Ghezzi D, Tiranti V. The mitochondrial aminoacyl tRNA synthetases: genes and syndromes. Int J Cell Biol. 2014:1135–45. Nature Publishing Group. Available from: http://www.nature.com/articles/nbt1486. [cited 1 June 2018]
Müller S, Harms H, Bley T. Origin and analysis of microbial population heterogeneity in bioprocesses. Curr Opin Biotechnol. 2010;21:100–13. Available from: http://www.sciencedirect.com/science/article/pii/S0958166910000030. [cited 21 Sep 2015]
Van Nevel S, Koetzsch S, Proctor CR, Besmer MD, Prest EI, Vrouwenvelder JS, et al. Flow cytometric bacterial cell counts challenge conventional heterotrophic plate counts for routine microbiological drinking water monitoring. Water Res. 2017;113:191–206. Pergamon. Available from: https://www.sciencedirect.com/science/article/pii/S0043135417300726. [cited 22 May 2018]
Khanal SK, Giri B, Nitayavardhana S, Gadhamshetty V. Anaerobic bioreactors/digesters. Curr Dev Biotechnol Bioeng. 2017:261–79. Elsevier. Available from: http://linkinghub.elsevier.com/retrieve/pii/B9780444636652000102. [cited 5 Feb 2018]
Lopes da Silva T, Baptista C, Reis A, Passarinho PC. Using flow cytometry to evaluate the stress physiological response of the yeast Saccharomyces carlsbergensis ATCC 6269 to the presence of 5-Hydroxymethylfurfural during ethanol fermentations. Appl Biochem Biotechnol. 2017;181:1096–107. Springer US. Available from: http://link.springer.com/10.1007/s12010-016-2271-9. [cited 5 Feb 2018]
Gary MA. Flow cytometry what you see matters: enhanced clinical detection using image-based flow cytometry. Methods. 2017;112:1–8. Available from: http://www.sciencedirect.com/science/article/pii/S1046202316302961. [cited 9 May 2017]
Lambrecht J, Cichocki N, Hübschmann T, Koch C, Harms H, Müller S. Flow cytometric quantification, sorting and sequencing of methanogenic archaea based on F420 autofluorescence. Microb Cell Factories. 2017;16:180. BioMed Central. Available from: http://microbialcellfactories.biomedcentral.com/articles/10.1186/s12934-017-0793-7. [cited 19 Jan 2018]
Robinson JP, Roederer M. Flow cytometry strikes gold. Science (80- ). 2015;350:739–40.
Fulwyler MJ. Electronic separation of biological cells by volume. Science (80- ). 1965;150:910–1.
Gray JW, Carrano AV, Steinmetz LL, Van Dilla MA, Moore DH, Mayall BH, et al. Chromosome measurement and sorting by flow systems. Proc Natl Acad Sci U S A. 1975;72:1231–4. National Academy of Sciences. Available from: http://www.ncbi.nlm.nih.gov/pubmed/1055399. [cited 5 Oct 2016]
Dhoble AS. A novel flow cytometry based methodology for rapid, highthroughput characterization of microbiome dynamics in anaerobic systems. 2016 Available from: https://www.ideals.illinois.edu/handle/2142/95579. [cited 30 Jul 2018].
Saeys Y, Van Gassen S, Lambrecht BN. Computational flow cytometry: helping to make sense of high-dimensional immunology data. Nat Rev Immunol. 2016;16:449–62. Nature Research. Available from: http://www.nature.com/doifinder/10.1038/nri.2016.56. [cited 3 Oct 2016 ]
Perfetto SP, Chattopadhyay PK, Roederer M. Innovation: seventeen-colour flow cytometry: unravelling the immune system. Nat Rev Immunol. 2004;4:648–55. Nature Publishing Group. Available from: http://www.nature.com/doifinder/10.1038/nri1416. [cited 5 Oct 2016]
Chattopadhyay PK, Roederer M. Cytometry: Today’s technology and tomorrow’s horizons. Methods. 2012;57:251–8.
Szabo M, Svensson Akusjärvi S, Saxena A, Liu J, Chandrasekar G, Kitambi SS. Cell and small animal models for phenotypic drug discovery. Drug Des Devel Ther. 2017;11:1957–67. Dove Press. Available from: http://www.ncbi.nlm.nih.gov/pubmed/28721015. [cited 6 Feb 2018]
Dhoble AS, Bekal S, Dolatowski W, Yanz C, Lambert KN, Bhalerao KD. A novel high-throughput multi-parameter flow cytometry based method for monitoring and rapid characterization of microbiome dynamics in anaerobic systems. Bioresour Technol. 2016;220:566–71. Elsevier. Available from: https://www.sciencedirect.com/science/article/pii/S0960852416312044. ; [cited 7 Mar 2018]
Hammes F, Berney M, Wang Y, Vital M, Köster O, Egli T. Flow-cytometric total bacterial cell counts as a descriptive microbiological parameter for drinking water treatment processes. Water Res. 2008;42:269–77. Pergamon. Available from: https://www.sciencedirect.com/science/article/pii/S0043135407004691. [cited 1 June 2018]
Koch C, Günther S, Desta AF, Hübschmann T, Müller S. Cytometric fingerprinting for analyzing microbial intracommunity structure variation and identifying subcommunity function. Nat Protoc. 2013;8:190–202. Nature Publishing Group, a division of Macmillan Publishers Limited. All Rights Reserved. Available from: https://doi.org/10.1038/nprot.2012.149. [cited 5 Nov 2015].
Bridier A, Hammes F, Canette A, Bouchez T, Briandet R. Fluorescence-based tools for single-cell approaches in food microbiology. Int J Food Microbiol [Internet]. Elsevier. 2015;213:2–16. Available from: https://www.sciencedirect.com/science/article/pii/S0168160515300568. [cited 2018 Sep 4].
Kinet R, Dzaomuho P, Baert J, Taminiau B, Daube G, Nezer C, et al. Flow cytometry community fingerprinting and amplicon sequencing for the assessment of landfill leachate cellulolytic bioaugmentation. Bioresour Technol. 2016;214:450–9. Available from: http://www.sciencedirect.com/science/article/pii/S0960852416306277. [cited 2 May 2016]
Ehsani E, Hernandez-Sanabria E, Kerckhof FM, Props R, Vilchez-Vargas R, Vital M, et al. Initial evenness determines diversity and cell density dynamics in synthetic microbial ecosystems. Sci Rep. 2018;8:340. Nature Publishing Group. Available from: http://www.nature.com/articles/s41598-017-18668-1. [cited 1 Jun 2018]
Koch C, Harnisch F, Schröder U, Müller S. Cytometric fingerprints: evaluation of new tools for analyzing microbial community dynamics. Front Microbiol. 2014;5:273. Available from: http://www.pubmedcentral.nih.gov/articlerender.fcgi?artid=4044693&tool=pmcentrez&rendertype=abstract. [cited 5 Nov 2015]
Rogers WT, Moser AR, Holyst HA, Bantly A, Mohler ER, Scangas G, et al. Cytometric fingerprinting: quantitative characterization of multivariate distributions. Cytom Part A. 2008;73A:430–41. Wiley-Blackwell. Available from: http://doi.wiley.com/10.1002/cyto.a.20545. [cited 22 May 2018]
De Roy K, Clement L, Thas O, Wang Y, Boon N. Flow cytometry for fast microbial community fingerprinting. Water Res. 2012;46:907–19. Pergamon. Available from: https://www.sciencedirect.com/science/article/pii/S0043135411007688. [cited 22 May 2018]
Rajwa B, Venkatapathi M, Ragheb K, Banada PP, Hirleman ED, Lary T, et al. Automated classification of bacterial particles in flow by multiangle scatter measurement and support vector machine classifier. Cytom Part A. 2008;73A:369–79. Wiley-Blackwell. Available from: http://doi.wiley.com/10.1002/cyto.a.20515. [cited 22 May 2018]
Rubbens P, Props R, Boon N, Waegeman W. Flow cytometric single-cell identification of populations in synthetic bacterial communities. Larsen PE, editor. PLoS One. 2017;12:e0169754. Public Library of Science. Available from: http://dx.plos.org/10.1371/journal.pone.0169754. [cited 22 May 2018]
Hennig H, Rees P, Blasi T, Kamentsky L, Hung J, Dao D, et al. An open-source solution for advanced imaging flow cytometry data analysis using machine learning. Methods. 2017;112:201–10. Academic Press. Available from: https://www.sciencedirect.com/science/article/pii/S1046202316302912. [cited 5 Feb 2018]
Van Nevel S, Buysschaert B, De Roy K, De Gusseme B, Clement L, Boon N. Flow cytometry for immediate follow-up of drinking water networks after maintenance. Water Res. 2017;111:66–73. Pergamon. Available from: https://www.sciencedirect.com/science/article/pii/S0043135416309848. [cited 1 June 2018]
Buysschaert B, Kerckhof FM, Vandamme P, De Baets B, Boon N. Flow cytometric fingerprinting for microbial strain discrimination and physiological characterization. Cytom Part A. 2018;93:201–12. Wiley-Blackwell. Available from: http://doi.wiley.com/10.1002/cyto.a.23302. [cited 1 June 2018]
Gonzalez-Gil L, Mauricio-Iglesias M, Serrano D, Lema JM, Carballa M. Role of methanogenesis on the biotransformation of organic micropollutants during anaerobic digestion. Sci Total Environ. 2018;622–623:459–66. Elsevier. Available from: https://www.sciencedirect.com/science/article/pii/S004896971733423X. [cited 5 Feb 2018]
Dhoble AS, Pullammanappallil PC. Design and operation of an anaerobic digester for waste management and fuel generation during long term lunar mission. Adv Sp Res. 2014;54:1502–12. Available from: http://www.sciencedirect.com/science/article/pii/S0273117714004098. [cited 1 June 2016]
Pullammanappallil P, Dhoble A. Biochemical methane potential of wastes generated during long term lunar mission. Barcelona: 40th Int Conf Environ Syst ICES 2010; 2010. Available from: https://arc.aiaa.org/doi/pdf/10.2514/6.2010-6203. [cited 5 Feb 2018]
Dhoble A. High solids anaerobic digestion for the long term exploratory Nasa lunar space missions. 2009. Available from: http://ufdc.ufl.edu/UFE0041041/00001. [cited 26 Sept 2016].
Steinberg LM, Kronyak RE, House CH. Coupling of anaerobic waste treatment to produce protein- and lipid-rich bacterial biomass. Life Sci Sp Res. 2017;15:32–42. Elsevier. Available from: https://www.sciencedirect.com/science/article/pii/S221455241730041X. [cited 5 Feb 2018]
Kundu K, Sharma S, Sreekrishnan TR. Influence of process parameters on anaerobic digestion microbiome in Bioenergy production: towards an improved understanding. BioEnergy Res. 2017;10:288–303. Springer US. Available from: http://link.springer.com/10.1007/s12155-016-9789-0. [cited 5 Feb 2018]
de Souza Santana RS, Pretti AA, Moreno JG, Dacanal GC, Tommaso G, Ribeiro R. Effect of biomass configuration on the behavior of pilot-scale anaerobic batch reactors treating dairy wastewater. Int Biodeter Biodegr. 2016;106:80–7. Elsevier. Available from: https://www.sciencedirect.com/science/article/pii/S0964830515301050. [cited 5 Feb 2018]
Ahmed W, Rodríguez J. Modelling sulfate reduction in anaerobic digestion: complexity evaluation and parameter calibration. Water Res. 2018;130:255–62. Pergamon. Available from: https://www.sciencedirect.com/science/article/pii/S0043135417309922. [cited 5 Feb 2018]
Dennehy C, Lawlor PG, McCabe MS, Cormican P, Sheahan J, Jiang Y, et al. Anaerobic co-digestion of pig manure and food waste; effects on digestate biosafety, dewaterability, and microbial community dynamics. Waste Manag. 2018;71:532–41. Pergamon. Available from: https://www.sciencedirect.com/science/article/pii/S0956053X17307948. [cited 5 Feb 2018]
Wolfson SJ, Porter AW, Campbell JK, Young LY. Naproxen is transformed via Acetogenesis and syntrophic acetate oxidation by a methanogenic wastewater consortium. Microb Ecol. 2018:1–10. Springer US. Available from: http://link.springer.com/10.1007/s00248-017-1136-2. [cited 5 Feb 2018]
Ansari HR, Zarei MJ, Sabbaghi S, Keshavarz P. A new comprehensive model for relative viscosity of various nanofluids using feed-forward back-propagation MLP neural networks. Int Commun Heat Mass Transf. 2018;91:158–64. Pergamon. Available from: https://www.sciencedirect.com/science/article/pii/S0735193317303299. [cited 5 Feb 2018]
Caruana R, Niculescu-Mizil A. An empirical comparison of supervised learning algorithms. Proc 23th Int Conf Mach Learn. 2006:161–8. Available from: http://doi.acm.org/10.1145/1143844.1143865
Koch M. Artificial intelligence is becoming natural. Cell. 2018;173:531–3. Cell Press. Available from: https://www.sciencedirect.com/science/article/pii/S0092867418304604. [cited 31 Jul 2018]
Sanz JL, Rodríguez N, Amils R. The action of antibiotics on the anaerobic digestion process. Appl Microbiol Biotechnol. 1996;46:587–92. Available from: http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.591.898&rep=rep1&type=pdf
Miettinen K, Hakanen J. Why use interactive multi-objective optimization in chemical process design? 2017. p. 157–97. Available from: http://www.worldscientific.com/doi/abs/10.1142/9789813148239_0006. [cited 29 Jan 2018]
Singh S, Bakshi BR. Chemical engineering and biogeochemical cycles. Sustain Des Synth Anal Chem Eng Process. 2016:275–94. Elsevier. Available from: http://linkinghub.elsevier.com/retrieve/pii/B9780128020326000128. [cited 7 Feb 2018]
Ling CX, Huang J, Zhang H. AUC: a better measure than accuracy in comparing learning algorithms. Berlin, Heidelberg: Springer; 2003. p. 329–41. Available from: http://link.springer.com/10.1007/3-540-44886-1_25. [cited 8 Feb 2018]
Geurts P, Ernst D, Wehenkel L. Extremely randomized trees. Mach Learn. 2006;63:3–42. Kluwer Academic Publishers. Available from: http://link.springer.com/10.1007/s10994-006-6226-1. [cited 17 Oct 2016]
Abd A, Hadi A. Performance analysis of big data intrusion detection system over random Forest algorithm. Int J Appl Eng Res ISSN. 2018;13:973–4562. Available from: http://www.ripublication.com. [cited 7 Feb 2018]
Koch C, Fetzer I, Harms H, Müller S. CHIC-an automated approach for the detection of dynamic variations in complex microbial communities. Cytometry A. 2013;83:561–7. Available from: http://www.ncbi.nlm.nih.gov/pubmed/23568809. [cited 5 Nov 2015]
Connelly S, Shin SG, Dillon RJ, Ijaz UZ, Quince C, Sloan WT, et al. Bioreactor scalability: laboratory-scale bioreactor design influences performance, ecology, and community physiology in expanded granular sludge bed bioreactors. Front Microbiol. 2017;8:664. Frontiers. Available from: http://journal.frontiersin.org/article/10.3389/fmicb.2017.00664/full. [cited 5 Feb 2018]
Batista AP, López EP, Dias C, Lopes da Silva T, Marques IP. Wastes valorization from Rhodosporidium toruloides NCYC 921 production and biorefinery by anaerobic digestion. Bioresour Technol. 2017;226:108–17. Elsevier. Available from: https://www.sciencedirect.com/science/article/pii/S0960852416316340. [cited 5 Feb 2018]
Pazmiño-Hernandez M, Moreira CM, Pullammanappallil P. Feasibility assessment of waste banana peduncle as feedstock for biofuel production. Biofuels. 2017:1–12. Taylor & Francis. Available from: https://www.tandfonline.com/doi/full/10.1080/17597269.2017.1323321. [cited 5 Feb 2018]
Doriya K, Kumar DS. Optimization of solid substrate mixture and process parameters for the production of L-asparaginase and scale-up using tray bioreactor. Biocatal Agric Biotechnol. 2018;13:244–50. Elsevier. Available from: https://www.sciencedirect.com/science/article/pii/S1878818117305790. [cited 5 Feb 2018]
Satpathy P, Steinigeweg S, Cypionka H, Engelen B. Different substrates and starter inocula govern microbial community structures in biogas reactors. Environ Technol (United Kingdom) [Internet]. Taylor & Francis; 2016;37:1441–50. Available from: http://www.tandfonline.com/doi/full/10.1080/09593330.2015.1118559. [cited 2018 Sep 4].
Aydin S, Ince B, Ince O. Application of real-time PCR to determination of combined effect of antibiotics on Bacteria, methanogenic archaea, archaea in anaerobic sequencing batch reactors. Water Res. 2015;76:88–98.
Blasco L, Kahala M, Tampio E, Ervasti S, Paavola T, Rintala J, et al. Dynamics of microbial communities in untreated and autoclaved food waste anaerobic digesters. Anaerobe. 2014;29:3–9.
Ito T, Yoshiguchi K, Ariesyady HD, Okabe S. Identification and quantification of key microbial trophic groups of methanogenic glucose degradation in an anaerobic digester sludge. Bioresour Technol. 2012;123:599–607.
Venkiteshwaran K, Bocher B, Maki J, Zitomer D. Relating anaerobic digestion microbial community and process function. Microbiol Insights. 2015;8:37–44. Libertas Academica. Available from: http://www.ncbi.nlm.nih.gov/pubmed/27127410. [cited 30 Jun 2016]
Walter A, Probst M, Hinterberger S, Müller H, Insam H. Biotic and abiotic dynamics of a high solid-state anaerobic digestion box-type container system. Waste Manag. 2016;49:26–35.
Ariesyady HD, Ito T, Yoshiguchi K, Okabe S. Phylogenetic and functional diversity of propionate-oxidizing bacteria in an anaerobic digester sludge. Appl Microbiol Biotechnol. 2007;75:673–83. Springer-Verlag. Available from: http://link.springer.com/10.1007/s00253-007-0842-y. [cited 30 June 2016]
Ariesyady HD, Ito T, Okabe S. Functional bacterial and archaeal community structures of major trophic groups in a full-scale anaerobic sludge digester. Water Res. 2007;41:1554–68.
Ahring BK, Westermann P. Kinetics of butyrate, acetate, and hydrogen metabolism in a thermophilic, anaerobic, butyrate-degrading triculture. Appl Environ Microbiol. 1987;53:434–9. Available from: http://www.pubmedcentral.nih.gov/articlerender.fcgi?artid=203678&tool=pmcentrez&rendertype=abstract. [cited 5 Feb 2016]
Khanal SK. Overview of anaerobic biotechnology. Anaerobic biotechnology for bioenergy production. Oxford: Wiley-Blackwell. p. 1–27. Available from: http://doi.wiley.com/10.1002/9780813804545.ch1. [cited 21 Oct 2016]
Narihiro T, Sekiguchi Y. Oligonucleotide primers, probes and molecular methods for the environmental monitoring of methanogenic archaea. Microb Biotechnol. 2011;4:585–602. Blackwell Publishing Ltd. Available from: http://doi.wiley.com/10.1111/j.1751-7915.2010.00239.x. [cited 7 Jul 2016]
Biedermann M, Grob K. Is recycled newspaper suitable for food contact materials? Technical grade mineral oils from printing inks. Eur Food Res Technol. 2010;230:785–96. Springer-Verlag. Available from: http://link.springer.com/10.1007/s00217-010-1223-9. [cited 24 Oct 2016]
Manyi-Loh CE, Mamphweli SN, Meyer EL, Okoh AI, Makaka G, Simon M. Microbial anaerobic digestion (bio-digesters) as an approach to the decontamination of animal wastes in pollution control and the generation of renewable energy. Int J Environ Res Public Health. 2013;10:4390–417. Multidisciplinary Digital Publishing Institute (MDPI). Available from: http://www.ncbi.nlm.nih.gov/pubmed/24048207. [cited 26 Sep 2016]
Gonzalez-Estrella J, Asato CM, Jerke AC, Stone JJ, Gilcrease PC. Effect of structural carbohydrates and lignin content on the anaerobic digestion of paper and paper board materials by anaerobic granular sludge. Biotechnol Bioeng. 2017;114:951–60. Available from: http://doi.wiley.com/10.1002/bit.26228. [cited 7 Feb 2018]
Ganzoury MA, Allam NK. Impact of nanotechnology on biogas production: a mini-review. Renew Sust Energ Rev. 2015;50:1392–404. Available from: http://www.sciencedirect.com/science/article/pii/S1364032115005559. [cited 27 June 2015]
Tommaso G, Domingues MR, Ribeiro R, MBA V, Zaiat M, Foresti E. Anaerobic degradation of protein: simplified kinetic modelling and microbial dynamics. Water Air Soil Pollut. 2013;224:1554. Springer Netherlands. Available from: http://link.springer.com/10.1007/s11270-013-1554-9. [cited 5 Feb 2018]
Crow E, Crow E. Confidence intervals for a proportion. Biometrika. 1956;43:423–35. Oxford University PressBiometrika Trust. Available from: https://www.jstor.org/stable/2332920?origin=crossref. [cited 27 Jul 2018]
James G, Witten D, Hastie T, Tibshirani R. An introduction to statistical learning. Perform Eval. 2013; Available from: http://books.google.com/books?id=9tv0taI8l6YC. [cited 24 May 2018]
Kohavi R. A study of cross validation and bootstrap for accuracy estimation and model selection. Proc Int Jt Conf Neural Net. 1995:1137–43. Available from: http://citeseerx.ist.psu.edu/viewdoc/summary?doi=10.1.1.48.529. [cited 30 May 2018]
H2O.ai [Internet]. Available from: http://www.h2o.ai/. [Accessed 30 May 2018].
Aygun RC, Yavuz AG. Network anomaly detection with stochastically improved autoencoder based models. Proc - 4th IEEE Int Conf cyber Secur cloud Comput CSCloud 2017 3rd IEEE Int Conf scalable smart cloud, SSC 2017: IEEE; 2017. p. 193–8. Available from: http://ieeexplore.ieee.org/document/7987197/. [cited 30 May 2018]
Arno Candel; Viraj Parmar. Deep learning with H2O. 2015.
Breiman L. Random forests. Mach Learn. 2001;45:5–32. Available from: https://link.springer.com/content/pdf/10.1023%2FA%3A1010933404324.pdf. [cited 31 May 2018]
Friedman JH. Greedy function approximation: a gradient boosting machine. Ann Stat. 2001;29:1189–232. Available from: https://projecteuclid.org/download/pdf_1/euclid.aos/1013203451. [cited 30 May 2018]
Valiant LG. A theory of the learnable. Commun ACM. 1984;27:1134–42. ACM. Available from: http://portal.acm.org/citation.cfm?doid=1968.1972. [cited 30 May 2018]
Hastie T, Tibshirani R, Friedman J. The elements of statistical learning: Springer Ser. Stat; 2009. Available from: http://statweb.stanford.edu/~tibs/book/preface.ps. [cited 30 May 2018]
Brewka G. Artificial intelligence—a modern approach by Stuart Russell and Peter Norvig, prentice hall. Series in artificial intelligence, Englewood cliffs, NJ. Knowl Eng Rev. 1996;11:78. Malaysia; Pearson Education Limited. Available from: http://thuvien.thanglong.edu.vn:8081/dspace/handle/DHTL_123456789/4010. [cited 31 May 2018]
Gedeon TD. Data Mining of Inputs: Analysing magnitude and functional measures. Int J Neural Syst. 1997;08:209–18. Available from: http://www.ncbi.nlm.nih.gov/pubmed/9327276. [cited 1 June 2018]
Robin X, Turck N, Hainard A, Tiberti N, Lisacek F, Sanchez J-C, et al. pROC: an open-source package for R and S+ to analyze and compare ROC curves. BMC Bioinformatics. 2011;12:77. BioMed Central. Available from: http://bmcbioinformatics.biomedcentral.com/articles/10.1186/1471-2105-12-77. [cited 8 Feb 2018]
The authors would like to thank the Roy J. Carver Biotechnology Center (CBC)‘s Flow Cytometry Facility at the University of Illinois, Urbana-Champaign (UIUC) for their services, equipment and resources to carry out this work. The authors are also grateful to Dr. Barbara Pilas, Dr. Kris N. Lambert, Dr., Girish Chowdhary, Dr. Michael J Miller, Mr. Michael J. Stablein and other team members for their valuable insights and contributions in carrying out the proposed work.
The project was partly supported by a grant from iSEE (Institute for Sustainability, Energy, and Environment) on recommendations of Student Sustainability Committee at UIUC as well as NSF-USDA Early Concept Grants for Exploratory Research (EAGER) (017–67007-25945).
Availability of data and materials
The raw data (.fcs files) and associated code (R Studio Script) is available at: https://github.com/adhoble/CFML-Perturb
The fcs files are also available at Flow Repository (https://flowrepository.org/) with Repository ID: FR-FCM-ZYK4.
Ethics approval and consent to participate
Consent for publication
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Experimental design, flow cytometry controls, hyperparameters and additional material. (DOCX 984 kb)