/
Parallelism with R

Parallelism with R

Owned by Jason Yalim
Last updated: Mar 29, 2024 by Rebecca Belshe
1 min read

The detectCores method from the parallel R library will not work as intended for jobs that request anything less than a full node.

For instance, R scripts that look like this:

library(parallel) cluster = makeCluster(detectCores())

Should be replaced with

library(parallel) cluster = makeCluster(strtoi(system("nproc",intern=TRUE)))

 

Related content

R Module list of packages
R Module list of packages
Research Computing
Read with this
Parallelism with R
Parallelism with R
KE Secure Cloud
More like this
Submitting an R SBATCH Job Script
Submitting an R SBATCH Job Script
KE Secure Cloud
More like this
Requesting Resources on Aloe
Requesting Resources on Aloe
KE Secure Cloud
More like this
Creating an Interactive RStudio Session
Creating an Interactive RStudio Session
KE Secure Cloud
More like this

Arizona State University