University of Tuebingen APG group Configuration

All nf-core pipelines have been successfully configured for use on the APG group’s clusters at the University of Tuebingen.

To use, run the pipeline with -profile tubingen_apg. This will download and launch the tubingen_apg.config which has been pre-configured with a setup suitable for the APG cluster. The number of parallel jobs that run is currently limited to 8.

This configuration will automatically choose the correct SLURM queue (short, medium, long) depending on the time and memory required by each process.

When using this profile, a docker image containing all of the required software will be downloaded and converted to a singularity container before execution of the pipeline. The image will be stored in the cache directory:

/opt/container_tmp/apptainer/nextflow

NB: Nextflow will need to submit the jobs via SLURM to the clusters and as such the commands above will have to be executed on one of the head nodes. If in doubt contact IT.

Additional Profiles

We currently also offer profiles for deactivating the cleanup of intermediate files.

debug

This simple profile just turns off automatic clean up of intermediate files. This can be useful for debugging. Specify e.g. with -profile tubingen_apg,debug.

Config file

See config file on GitHub

tubingen_apg.config
//Profile config names for nf-core/configs
params {
    config_profile_description = 'Generic profile for APG group of University of Tuebingen provided by nf-core/configs.'
    config_profile_contact = 'Thiseas C. Lamnidis (@TCLamnidis), Stephen Clayton (@sc13-bioinf)'
    config_profile_url = 'https://uni-tuebingen.de/fakultaeten/mathematisch-naturwissenschaftliche-fakultaet/fachbereiche/geowissenschaften/arbeitsgruppen/urgeschichte-naturwissenschaftliche-archaeologie/ina/archaeo-and-palaeogenetik/'
    max_memory = 4.TB
    max_cpus = 256
}
 
// Perform work directory cleanup after a successful run
cleanup = true
 
process {
    executor = 'slurm'
    queue = { task.time <= 2.h ? 'short' : task.time <= 48.h ? 'medium': 'long' }
    maxRetries = 2
}
 
executor {
    queueSize = 28 // Run up to 28 jobs in parallel per run, to avoid flooding the cluster.
}
 
singularity {
    enabled = true
    autoMounts = true
    cacheDir = "/opt/container_tmp/apptainer/nextflow"
}
 
profiles {
    // Profile to deactivate automatic cleanup of work directory after a successful run. Overwrites cleanup option.
    debug {
        cleanup = false
    }
}