Tarballing (Archiving Data)
The amount of time to schedule is problem dependent. The sbatch
flag -t 300
specifying 300 minutes of scheduled time was pedagogically supplied and is problem dependent. Your own job may need significantly less time, or potentially more.
Without compression (good for binary data)
sbatch -t 300 --wrap="tar cvf mytarball.tar paths/ to/ be/ tarred/"
The above command will submit a command to a compute node in the serial
partition that requests 1 core for 5 hours (300 minutes). The command will create the uncompressed archive mytarball.tar
that contains the contents of the paths specified.
With compression (good for ASCII data)
sbatch -t 300 --wrap="tar czvf mytarball.tgz paths/ to/ be/ tarred/"
The above command will submit a command to a compute node in the serial
partition that requests 1 core for 5 hours (300 minutes). The command will create the gzipped compressed archive mytarball.tgz
that contains the contents of the paths specified.