Parallelism with R

Owned by Rebecca Belshe
Dec 27, 2023
1 min read

This page is a work in progress, but please note that the detectCores method from the parallel library will not work as intended for jobs that request anything less than a full node.

For instance, R scripts that look like this:

library(parallel) cluster = makeCluster(detectCores())

Should be replaced with

library(parallel) cluster = makeCluster(strtoi(system("nproc",intern=TRUE)))

Â