Taking detour from Spark.
Map-reduce linear regression (1-var) with mpi4py.
Unsurprisingly, blazing fast. so fast i wonder what was i doing for the last few months..
Somehow I cannot find well-documented scikit-learn mpi extensions.. No way they have not yet implemented mpi-like parallel functionalities..
No comments:
Post a Comment