Statistics vs Machine Learning




Statistics vs Machine Learning

Bzdok et al (2018) used simulated gene expression and RNA-seq counts to illustrates the difference between how classical statistics and machine learning rank the relevance of gene epxression to a phenotype, that is to discover a correlation structure. Their point is that both approaches yield similar results, but the machine learning approach is more scaleable because it makes no assumptions about the process that generates gene expression levels.

The authors suggest that scalability comes at the expense of model interpretability. As Thiagarajan et al. (2020) demonstrate related notebook there are ways to visualize the latent space the model constructs. One can relate that model structure to biological knowledge. Here is an early example of principal components analysis to identify different pathways for sensitivity or resistance to apoptosis.

With a latent space analysis, or some way to introspect the model, the main difference to me between classical statistics and machine learning is one of scale. Classical statistics work well on groups that are to small to even train a neural network on.

To Read