Biowulf: Difference between revisions

From 太極
Jump to navigation Jump to search
Line 16: Line 16:
= Multiple files - swarm =
= Multiple files - swarm =
* [https://hpc.nih.gov/apps/swarm.html swarm]
* [https://hpc.nih.gov/apps/swarm.html swarm]
* [https://hpc.nih.gov/apps/modules.html Environment modules] Note '''sbatch''' command does not support ''--module'' option.
* [https://hpc.nih.gov/apps/modules.html Environment modules] Note '''sbatch''' command does not support ''--module'' option. In sbatch case, the ''module'' command has to be put in the script file.
<syntaxhighlight lang='bash'>
<syntaxhighlight lang='bash'>
swarm -t 3 -g 20 -f run_seqtools_vc.sh --module samtools,picard,bwa --verbose 1 --devel
swarm -t 3 -g 20 -f run_seqtools_vc.sh --module samtools,picard,bwa --verbose 1 --devel

Revision as of 20:12, 15 May 2016

Quota

checkquota

freen

Single file - sbatch

Don't use swarm for a single file

sbatch --cpus-per-task=2 --mem=4g MYSCRIPT

Multiple files - swarm

  • swarm
  • Environment modules Note sbatch command does not support --module option. In sbatch case, the module command has to be put in the script file.
swarm -t 3 -g 20 -f run_seqtools_vc.sh --module samtools,picard,bwa --verbose 1 --devel
# 3 commands run in 3 subjobs, each command requiring 10 gb and 3 threads, allocating 6 cores and 12 cpus
swarm -t 3 -g 20 -f run_seqtools_vc.sh --module samtools,picard,bwa --verbose 1

# To change the default walltime, use --time=24:00:00

swarm -t 8 -g 24 --module tophat,samtools,htseq -f run_master.sh
cat sw3n17156.o

Monitor/Delete jobs

sjobs
scancel -u XXXXX
scancel NNNNN
scancel --state=PENDING
scancel --state=RUNNING
squeue -u XXXX

Interactive debugging

sinteractive --mem=8g -c 4