Using the queue system on skd-cyclone: Difference between revisions

From gfi
Line 51: Line 51:


*'''work_dir''': output files will be created in this directory.  
*'''work_dir''': output files will be created in this directory.  
Example: <code>--work_dir=/tmp/</code>
Example: <code> --workdir=/scratch/$USER</code>
*'''queue''': which queue the output should be processed on.
*'''queue''': which queue the output should be processed on.
Example: <code>--queue=priority</code>
Example: <code>--partition=default</code>
*'''job-name''':
Example: <code>--job-name=my_slurm_job</code>
*'''output''':
Example: <code>--output=results.%j.txt</code>
*'''error''':
Example: <code>--error=errors.%j.out</code>
*'''mail-type''':
Example: <code>--mail-type=END</code>
*'''time''':
Example: <code>--time=12:00:00</code>
*'''mem-per-cpu''':
Example: <code>--mem-per-cpu=100</code>


== Best practices, Q&A ==
== Best practices, Q&A ==

Revision as of 15:27, 1 November 2016

General information

  1. Purpose
  2. Advantages
  3. Disadvantages
  4. Rules and procedures

Short tutorial

1. create a basic wrapper script for your job

  # SLURM wrapper script
  # start this job with sbatch NAME_OF_THIS_FILE directly on the machine

  #SBATCH --job-name=my_slurm_job
  #SBATCH --workdir=/scratch/$USER
  #SBATCH --partition=default
  #SBATCH --output=results.%j.txt
  #SBATCH --error=errors.%j.out
  #SBATCH --mail-type=END
  #SBATCH --time=12:00:00
  #SBATCH --mem-per-cpu=100

  <apply any required path settings>
  <change to your working directory>
  <command to start your job>

  # done
  

2. submit the script

sbatch ./my_queue_job.sh

3. receive an email when the job is finished

From: slurm@klientdrift.uib.no
To: <username>@uib.no
Subject: SLURM Job_id=34 Name=WaterSip3.0 Ended, Run time 00:01:00

Converting a script to a queue script

  1. add elements to the header

Description of each element

  1. parameters explained in short
  • work_dir: output files will be created in this directory.

Example: --workdir=/scratch/$USER

  • queue: which queue the output should be processed on.

Example: --partition=default

  • job-name:

Example: --job-name=my_slurm_job

  • output:

Example: --output=results.%j.txt

  • error:

Example: --error=errors.%j.out

  • mail-type:

Example: --mail-type=END

  • time:

Example: --time=12:00:00

  • mem-per-cpu:

Example: --mem-per-cpu=100

Best practices, Q&A

Further information

  1. Contacts
  2. Links