Parallelism with R

Owned by Jason Yalim
Last updated: Mar 29, 2024 by Rebecca Belshe
1 min read

The detectCores method from the parallel R library will not work as intended for jobs that request anything less than a full node.

For instance, R scripts that look like this:

library(parallel) cluster = makeCluster(detectCores())

Should be replaced with

library(parallel) cluster = makeCluster(strtoi(system("nproc",intern=TRUE)))

 

Arizona State University