This document describes the output produced by the pipeline. Most of the plots are taken from the MultiQC report, which summarises results at the end of the pipeline.
The pipeline is built using Nextflow and processes data using the following steps:
- FastQC - read quality control
- TrimGalore - adapter trimming
- BWA-MEM - alignment
- Picard - mark PCR duplicates
- QualiMap2 - quality control metrics
- GATK - Genome Analysis Toolkit
- BAM recalibration - recalibrate BAM file
- BAM realignment - realing BAM file around indels
- HaplotypeCaller - call variants in GVCF mode
- GenotypeGVCFs - genotype generate GVCFs
- SelectVariants - select variants
- SNP recalibration - recalibrate SNPs using Omni, 1000G and dbSNP databases
- Indel recalibration - recalibrate INDELS using the Mills golden dataset
- CombineVariants - combine recalibrated files
- VariantAnnotator - annotate variants
- VariantEval - evaluate variants
- SnpEff - annotate variants
- MultiQC - aggregate report, describing results of the whole pipeline
FastQC gives general quality metrics about your reads. It provides information about the quality score distribution across your reads, the per base sequence content (%T/A/G/C). You get information about adapter contamination and other overrepresented sequences.
For further reading and documentation see the FastQC help.
NB: The FastQC plots displayed in the MultiQC report shows untrimmed reads. They may contain adapter sequence and potentially regions with low quality. To see how your reads look after trimming, look at the FastQC reports in the
- FastQC report, containing quality metrics for your untrimmed raw fastq files
- zip file containing the FastQC report, tab-delimited data file and plot images
The nfcore/ExoSeq BP 2.0 pipeline uses TrimGalore for removal of adapter contamination and trimming of low quality regions. TrimGalore uses Cutadapt for adapter trimming and runs FastQC after it finishes.
MultiQC reports the percentage of bases removed by TrimGalore in the General Statistics table, along with a line plot showing where reads were trimmed.
Contains FastQ files with quality and adapter trimmed reads for each sample, along with a log file describing the trimming.
- Trimmed FastQ data, reads 1 and 2.
- NB: Only saved if
--saveTrimmedhas been specified.
- Trimming report (describes which parameters that were used)
- FastQC report for trimmed reads
Single-end data will have slightly different file names and only one FastQ file per sample.
BWA-MEM is an alignment algorithm for aligning sequence reads or long query sequences against a large reference genome, e.g. human. It automatically chooses between local and end-to-end alignments, supports paired-end reads. The algorithm is applicable to a wide range of sequence lengths from 70bp to a few megabases. BWA-MEM is robust to sequencing errors and shows better performance than several state-of-art read aligners to date.
Picard MarkDuplicates locates and tags duplicate reads in a BAM or SAM file, where duplicate reads are defined as originating from a single fragment of DNA. Duplicates can arise during sample preparation e.g. library construction using PCR.
The MarkDuplicates tool works by comparing sequences in the 5 prime positions of both reads and read-pairs in a SAM/BAM file. After duplicate reads are collected, the tool differentiates the primary and duplicate reads using an algorithm that ranks reads by the sums of their base-quality scores (default method). For more information visit the picard docs.
Qualimap 2 represents a next step in the QC analysis of HTS data. Along with comprehensive single-sample analysis of alignment data, it includes new modes that allow simultaneous processing and comparison of multiple samples.
The GATK BaseRecalibrator detects systematic errors in base quality scores. More information can be found here: HATK BaseRecalibrator
The GATK HaplotypeCaller calls germline SNPs, insertions and deletions via local re-assembly of haplotypes.
The GATK SelectVariants selects a subset of variants from a larger callset.
The GATK VariantRecalibrator builds a recalibration model only for SNPs (emitting indels untouched in the output VCF) to score variant quality for filtering purposes.
The GATK VariantRecalibrator builds a recalibration model only for indels (emitting SNPs untouched in the output VCF) to score variant quality for filtering purposes.
The GATK CombineVariants combines variant records from different sources.
The GATK VariantAnnotator annotates variant calls with context information.
The GATK VariantEval general-purpose tool for variant evaluation (% in dbSNP, genotype concordance, Ti/Tv ratios, and a lot more).
SnpEff is a variant annotation and effect prediction tool. It annotates and predicts the effects of genetic variants (such as amino acid changes).
MultiQC is a visualisation tool that generates a single HTML report summarising all samples in your project. Most of the pipeline QC results are visualised in the report and further statistics are available in within the report data directory.
- MultiQC report - a standalone HTML file that can be viewed in your web browser
- Directory containing parsed statistics from the different tools used in the pipeline
For more information about how to use MultiQC reports, see http://multiqc.info