From Mucha: There are a few other perhaps related packages I know of, or at least have heard about, that you might find similarly interesting. The perhaps most powerful---from what I hear --- is the one put together by "interactive supercomputing". I haven't looked in a while, but they used to have free trial beta-user/whatever package options available for people in Python and maybe in R (MATLAB went paid). There are also some easy-to-program parallel options in MATLAB (MatlabMPI, MULTICORE, the Distributed Computing Toolbox; with different capabilities). I think there is at least one such package for R? At least for "trivially parallel" tasks, I've had luck, with only minor penalty---bigger penalties than if I took the time to code it correctly with true MPI calls, presumably; but good enough to get something running fast.
I'd be happy to continue any conversation about making algorithms more efficient!
Cloud storage 20gig = a problem?
Azure - uses by ArcGIS.