h2o

Join PyDSLA for a talk by Erin LeDell Intro to Machine Learning with H2O and Python Get your tickets HERE Summary: This workshop will provide an overview of how to use H2O, the scalable open source machine learning library, from Python. The core algorithms of H2O are implemented in Java, however, fully-featured APIs are available in R, Python, Scala, and also through a web interface. The focus of this hands-on workshop will be the “h2o” Python module.

I currently have the need for machine learning tools that can deal with observations of the order of 10 millions in the context of binary classification. That kind of data is a few GBs in size and it fits comfortably nowadays in the RAM of a decent single machine. It is a trivial task for linear models, as there are plenty of open source tools that can train a logistic regression with this amount of data on a single machine in a few seconds, even while using only 1 processor core (many of these tools are single-threaded). Linear models are also the gold standard of large-scale machine learning that can run on clusters, processing very large distributed datasets.