Difference between revisions of "Using the queue system on skd-cyclone"

From gfi
Jump to: navigation, search
(Short tutorial)
(Description of each element)
Line 49: Line 49:
  
 
# parameters explained in short
 
# parameters explained in short
 +
 +
*'''work_dir''': output files will be created in this directory.
 +
Example: <code>--work_dir=/tmp/</code>
 +
*'''queue''': which queue the output should be processed on.
 +
Example: <code>--queue=priority</code>
  
 
== Best practices, Q&A ==
 
== Best practices, Q&A ==

Revision as of 17:25, 1 November 2016

General information

  1. Purpose
  2. Advantages
  3. Disadvantages
  4. Rules and procedures

Short tutorial

1. create a basic wrapper script for your job

  # SLURM wrapper script
  # start this job with sbatch NAME_OF_THIS_FILE directly on the machine

  #SBATCH --job-name=my_slurm_job
  #SBATCH --workdir=/scratch/$USER
  #SBATCH --partition=default
  #SBATCH --output=results.%j.txt
  #SBATCH --error=errors.%j.out
  #SBATCH --mail-type=END
  #SBATCH --time=12:00:00
  #SBATCH --mem-per-cpu=100

  <apply any required path settings>
  <change to your working directory>
  <command to start your job>

  # done
  

2. submit the script

sbatch ./my_queue_job.sh

3. receive an email when the job is finished

From: slurm@klientdrift.uib.no
To: <username>@uib.no
Subject: SLURM Job_id=34 Name=WaterSip3.0 Ended, Run time 00:01:00

Converting a script to a queue script

  1. add elements to the header

Description of each element

  1. parameters explained in short
  • work_dir: output files will be created in this directory.

Example: --work_dir=/tmp/

  • queue: which queue the output should be processed on.

Example: --queue=priority

Best practices, Q&A

Further information

  1. Contacts
  2. Links