millironx/nf-configs
1
0
Fork 0
mirror of https://github.com/MillironX/nf-configs.git synced 2024-11-22 00:26:03 +00:00
Code Issues Releases Packages Activity
nf-configs/docs/sage.md
Bruno Grande 2898736cbe Add Sage Bionetworks nf-core configuration
2022-06-08 14:16:52 -07:00

1.7 KiB
Raw Blame History

nf-core/configs: Sage Bionetworks Configuration

To use this custom configuration, run the pipeline with -profile sage. This will download and launch the sage.config, which contains a number of optimizations relevant to Sage employees running workflows on AWS (e.g. using Nextflow Tower). These include:

  • Updating the default value for igenomes_base to s3://sage-igenomes
  • Increasing the default time limits because we run pipelines on AWS
  • Enabling retries by default when exit codes relate to insufficient memory
  • Allow pending jobs to finish if the number of retries are exhausted
  • Slowing the increase in the number of allocated CPU cores on retries

Additional information about iGenomes

The following iGenomes prefixes have been copied from s3://ngi-igenomes/ (eu-west-1) to s3://sage-igenomes (us-east-1). See this script for more information. The sage-igenomes S3 bucket has been configured to openly available, but files cannot be downloaded out of us-east-1 to avoid egress charges. You can check the conf/igenomes.config file in each nf-core pipeline to figure out the mapping between genome IDs (i.e. for --genome) and iGenomes prefixes (example).

  • Human Genome Builds
    • Homo_sapiens/Ensembl/GRCh37
    • Homo_sapiens/GATK/GRCh37
    • Homo_sapiens/UCSC/hg19
    • Homo_sapiens/GATK/GRCh38
    • Homo_sapiens/NCBI/GRCh38
    • Homo_sapiens/UCSC/hg38
  • Mouse Genome Builds
    • Mus_musculus/Ensembl/GRCm38
    • Mus_musculus/UCSC/mm10