UTD Sysbio Configuration

All nf-core pipelines have been successfully configured for use on the Sysbio HPC cluster at the The Univeristy of Texas at Dallas.

To use, run the pipeline with -profile utd_sysbio. This will download and launch the utd_sysbio.config which has been pre-configured with a setup suitable for the Sysbio HPC cluster. Using this profile, a docker image containing all of the required software will be downloaded, and converted to a Singularity image before execution of the pipeline.

Before running the pipeline you will need to load Singularity using the environment module system on Sysbio. You can do this by issuing the commands below:

## Singularity environment modules
module purge
module load singularity

NB: You will need an account to use the HPC cluster on Sysbio in order to run the pipeline. If in doubt contact OIT. NB: Nextflow will need to submit the jobs via SLURM to the HPC cluster and as such the commands above will have to be executed on one of the login nodes. If in doubt contact OIT.

Config file

See config file on GitHub

utd_sysbio.config
//Profile config names for nf-core/configs
params {
    config_profile_description = 'University of Texas at Dallas HPC cluster profile provided by nf-core/configs'
    config_profile_contact = 'Edmund Miller(@edmundmiller)'
    config_profile_url = 'http://docs.oithpc.utdallas.edu/'
    singularity_cache_dir = '/scratch/applied-genomics/singularity'
}
 
env {
    TMPDIR = '/home/$USER/scratch/tmp'
}
 
singularity {
    enabled = true
    envWhitelist='SINGULARITY_BINDPATH'
    autoMounts = true
    cacheDir = params.singularity_cache_dir
}
 
process {
    beforeScript = 'module load singularity/3.4.1'
    executor = 'slurm'
    queue = { task.memory >= 30.GB && task.cpu <= 16 ? 'normal': 'smallmem' }
}
 
// Preform work directory cleanup after a successful run
cleanup = true
 
params {
    // TODO Need to initialize this
    // igenomes_base = '/scratch/applied-genomics/references/iGenomes/references/'
    max_memory = 90.GB
    max_cpus = 16
    max_time = 96.h
}