* Changed tbi as optional output. HC cannot index a VCF from large chromosomes.
* Apply suggestions from code review
* Update modules/gatk4/haplotypecaller/main.nf
Co-authored-by: Maxime U. Garcia <maxime.garcia@scilifelab.se>
* style: Add prettier config files
* build: Add prettier vscode extension
* ci: Replace markdownlint and yamllint with prettier
* style: Run prettier
* style: Use indent of 2 for markdown as well
https://github.com/nf-core/tools/pull/1470#issuecomment-1071028358
* style: Fix indent
* style: Let editorconfig take over tab widths
* style: yaml => yml
* ci: Run prettier once
Co-authored-by: Phil Ewels <phil.ewels@scilifelab.se>
Co-authored-by: Phil Ewels <phil.ewels@scilifelab.se>
* add gatk4/combinegvcfs module
* update gatk4/combinegvcfs
* loop to create a string adding -V to each vcf file
* add contains for variable md5
* rm whitespace
* meta in output
* fix indentations
* fix indentations
* move tmpdir to args and update conda version
Co-authored-by: Peri <rrx8@cdc.gov>
Co-authored-by: Maxime U. Garcia <max.u.garcia@gmail.com>
* include intervals_index
In order to run the GATK `GenotypeGVCFs` tool with an interval file (such as a .bed file) you need to have the corresponding index file. Otherwise you get the following error message
```
A USER ERROR has occurred: An index is required but was not found for file genome.bed.gz: work/6c/541fce2dc670597f62a571c72288c6/genome.bed.gz. Support for unindexed block-compressed files has been temporarily disabled. Try running IndexFeatureFile on the input.
```
including the index file fixes this problem
* Update meta.yml
* Update versions
* update checksums + remove variables as input for applyvqsr
* sneak in removal of values and provide them via modules.config
* update another checksum
* more checksums
* move vairable to config
* remove controlfreec, wrong branch
* add line break
* Match target bed to input files
* Intervals in getpileupsumamries
* more interval updates
* change targets in strelka
* remove leftover channel
* fix checksums
* add new test vcfs
* add new test vcfs
* Update modules/freebayes/main.nf
Co-authored-by: Maxime U. Garcia <maxime.garcia@scilifelab.se>
* initial commit to setup branch
* workflow finished
* Update nextflow.config
* tumour to tumor, getpileup passed as nomral and tumor
* paired_somatic renamed to tumor_normal_somatic
* Apply suggestions from code review
Co-authored-by: Maxime U. Garcia <maxime.garcia@scilifelab.se>
* Update subworkflows/nf-core/gatk_tumor_normal_somatic_variant_calling/main.nf
Co-authored-by: Maxime U. Garcia <maxime.garcia@scilifelab.se>
* updated index names in meta.yml
* changed index file names in main script and test
* Apply suggestions from code review
Co-authored-by: Maxime U. Garcia <maxime.garcia@scilifelab.se>
* Apply suggestions from code review
* fixed bug from changes
* Apply suggestions from code review
* modified yml to allow new subworkflow testing
* Update test.yml
* Update test.yml
* updated to follow the new mergebam syntax, also made unaligned input sample specific
Co-authored-by: GCJMackenzie <gavin.mackenzie@nibsc.org>
Co-authored-by: Maxime U. Garcia <maxime.garcia@scilifelab.se>
* Change intervals to be part of sample specific input
* Fix some tests
* Update checksum
* Update intervals
* Update intervals
* Try out gavins idea for adding the file
* update test line
* update test line
* update test line
* revert contains line
* committing to pull updated nf-core files
* saving changes to checout other branch
* committing progress so far, difficulty with test data
* uploading to be used as draft PR
* fix linting error in meta.yml
* attempt to group reference inputs together
* updated input format for resources
* meta.yml updated with new resource names
* added output channel for recal index
* module only takes single vcf file input now
* committing to checkout
* update to new syntax, remove indel test for now
* updated to use memory options and new test data
* Update modules/gatk4/variantrecalibrator/main.nf
Co-authored-by: FriederikeHanssen <Friederike.hanssen@qbic.uni-tuebingen.de>
* Update main.nf
* Update modules/gatk4/variantrecalibrator/main.nf
Co-authored-by: FriederikeHanssen <Friederike.hanssen@qbic.uni-tuebingen.de>
* remove duplicate test keys from test_data.config
Co-authored-by: GCJMackenzie <gavin.mackenzie@nibsc.org>
Co-authored-by: FriederikeHanssen <Friederike.hanssen@qbic.uni-tuebingen.de>
* initial commit to setup branch
* workflow finished
* Update nextflow.config
* tumour to tumor, getpileup passed as nomral and tumor
* paired_somatic renamed to tumor_normal_somatic
* Apply suggestions from code review
Co-authored-by: Maxime U. Garcia <maxime.garcia@scilifelab.se>
* Update subworkflows/nf-core/gatk_tumor_normal_somatic_variant_calling/main.nf
Co-authored-by: Maxime U. Garcia <maxime.garcia@scilifelab.se>
* updated index names in meta.yml
* changed index file names in main script and test
* Apply suggestions from code review
Co-authored-by: Maxime U. Garcia <maxime.garcia@scilifelab.se>
* Apply suggestions from code review
* fixed bug from changes
* Apply suggestions from code review
* modified yml to allow new subworkflow testing
* Update test.yml
* Update test.yml
* add applyvqsr
* added memory options, new test data used
* Update main.nf
* Update main.nf
Co-authored-by: GCJMackenzie <gavin.mackenzie@nibsc.org>
Co-authored-by: Maxime U. Garcia <maxime.garcia@scilifelab.se>
* initial commit to setup branch
* workflow finished
* Update nextflow.config
* tumour to tumor, getpileup passed as nomral and tumor
* paired_somatic renamed to tumor_normal_somatic
* Apply suggestions from code review
Co-authored-by: Maxime U. Garcia <maxime.garcia@scilifelab.se>
* Update subworkflows/nf-core/gatk_tumor_normal_somatic_variant_calling/main.nf
Co-authored-by: Maxime U. Garcia <maxime.garcia@scilifelab.se>
* updated index names in meta.yml
* changed index file names in main script and test
* Apply suggestions from code review
Co-authored-by: Maxime U. Garcia <maxime.garcia@scilifelab.se>
* Apply suggestions from code review
* fixed bug from changes
* Apply suggestions from code review
* modified yml to allow new subworkflow testing
* Update test.yml
* Update test.yml
* added output channel for tbi files, tweaked method of adding blank inputs for gendb tests
* Update main.nf
* Update main.nf
Co-authored-by: GCJMackenzie <gavin.mackenzie@nibsc.org>
Co-authored-by: Maxime U. Garcia <maxime.garcia@scilifelab.se>
* Add comment line for consistency
* Remove all functions.nf
* Remove include functions.nf and publishDir options
* Replace options.args3 with task.ext.args3 - 3 modules
* Replace options.args3 with task.ext.args3 - 17 modules
* Replace {task.cpus} with task.cpus
* Replace off on off off off off off off off on off on off on off off off on off off off on on off off off on on off off off off off off off on off off off off on off on on off off off on on on on off off off on off on on off on on off off on on on off on on off on off off off off on off off off on off off on off on off off off on on off on off on off off on off off off on off off off on off off off off on off off off on on on off on on off off on off on on on off on on off on on on off off off off off on on off off on off off off off off on off off on on off on on off on off off off on off off off off on on off on off off on off off on off on off off off off off off off off on on off on off off off.args with
* Add def args = task.ext.args line to all modules in script section
* Replace options.args with args and args_list
* Initialise args2 and args3 properly
* Replace container syntax
* Revert container changes for cellranger/mkref
* Replace getProcessName in all modules
* Replace getSoftwareName in all modules
* Unify modules using VERSION variable
* Replae options.suffix with task.ext.suffix
* Remove NF version restriction for CI
* Bump NF version in README
* Replace task.process.tokenize logic with task.process
* Minor tweaks to unify syntax in tests main.nf
* Add a separate nextflow.config for each module
* Transfer remaining module options to nextflow.config
* Remove addParams from tests main.nf
* Remove TODO statements
* Use -c to import module specific config
* Bump NF version to 21.10.3
* Fix tests for artic/minion
* Fix broken publishDir syntax
* Standardise and fix obvious failing module tests
* Remove kronatools to krona
* Comment out tags in subworkflow test.yml
* Fix failing module tests
* Add consistent indentation to nextflow.config
* Comment out subworklow definitions
* Fix kallistobustools/ref
* Fix rmarkdownnotebook
* Fix jupyternotebook
* Quote task.process
* Add plink2/vcf to pytest_modules.yml
* Remove NF_CORE_MODULES_TEST from pytest CI
* Fix more tests
* Move bacteroides_fragilis to prokaryotes folder
* Fix cooler merge tests
* Fix kallistobustools/count tests
* Fix kallistobustools/ref tests
* Update test_10x_1_fastq_gz file for kallistobustools/count tests
* Fix bcftools/query tests
* Fix delly/call tests
* Fix cooler/zoomify tests
* Fix csvtk/split tests
* Fix gatk4/intervallisttools tests
* Fix gatk4/variantfiltration
* Fix pydamage/filter tests
* Fix test data for unicycler
* Fix gstama/collapse module
* Fix leehom tests
* Fix metaphlan3 tests
* Fix pairtools/select tests
* Update nextflow.config
* Update nextflow.config
* feat: update syntax
* Fix arriba tests
* Fix more failing tests
* Update test syntax
* Remove comments from tests nextflow.config
* Apply suggestions from code review
* Fix kallistobustools/count module
* Update dumpsoftwareversions module
* Update custom/dumpsoftwareversions
* Add args2 to untar module
* Update leftover modules
* Remove last remaining addParams
* Change syntax from task.ext.suffix to tast.ext.prefix
* Change nextflow.config in all tests to use ext.prefix instead of ext.suffix
Co-authored-by: JoseEspinosa <kadomu@gmail.com>
Co-authored-by: Gregor Sturm <mail@gregor-sturm.de>
Co-authored-by: MaxUlysse <max.u.garcia@gmail.com>
* Add comment line for consistency
* Remove all functions.nf
* Remove include functions.nf and publishDir options
* Replace options.args3 with task.ext.args3 - 3 modules
* Replace options.args3 with task.ext.args3 - 17 modules
* Replace {task.cpus} with task.cpus
* Replace off on off off off off off off off on off on off on off off off on off off off on on off off off on on off off off off off off off on off off off off on off on on off off off on on on on off off off on off on on off on on off off on on on off on on off on off off off off on off off off on off off on off on off off off on on off on off on off off on off off off on off off off on off off off off on off off off on on on off on on off off on off on on on off on on off on on on off off off off off on on off off on off off off off off on off off on on off on on off on off off off on off off off off on on off on off off on off off on off on off off off off off off off off on on off on off off off.args with
* Add def args = task.ext.args line to all modules in script section
* Replace options.args with args and args_list
* Initialise args2 and args3 properly
* Replace container syntax
* Revert container changes for cellranger/mkref
* Replace getProcessName in all modules
* Replace getSoftwareName in all modules
* Unify modules using VERSION variable
* Replae options.suffix with task.ext.suffix
* Remove NF version restriction for CI
* Bump NF version in README
* Replace task.process.tokenize logic with task.process
* Minor tweaks to unify syntax in tests main.nf
* Add a separate nextflow.config for each module
* Transfer remaining module options to nextflow.config
* Remove addParams from tests main.nf
* Remove TODO statements
* Use -c to import module specific config
* Bump NF version to 21.10.3
* Fix tests for artic/minion
* Fix broken publishDir syntax
* Standardise and fix obvious failing module tests
* Remove kronatools to krona
* Comment out tags in subworkflow test.yml
* Fix failing module tests
* Add consistent indentation to nextflow.config
* Comment out subworklow definitions
* Fix kallistobustools/ref
* Fix rmarkdownnotebook
* Fix jupyternotebook
* Quote task.process
* Add plink2/vcf to pytest_modules.yml
* Remove NF_CORE_MODULES_TEST from pytest CI
* Fix more tests
* Move bacteroides_fragilis to prokaryotes folder
* Fix cooler merge tests
* Fix kallistobustools/count tests
* Fix kallistobustools/ref tests
* Update test_10x_1_fastq_gz file for kallistobustools/count tests
* Fix bcftools/query tests
* Fix delly/call tests
* Fix cooler/zoomify tests
* Fix csvtk/split tests
* Fix gatk4/intervallisttools tests
* Fix gatk4/variantfiltration
* Fix pydamage/filter tests
* Fix test data for unicycler
* Fix gstama/collapse module
* Fix leehom tests
* Fix metaphlan3 tests
* Fix pairtools/select tests
* Update nextflow.config
* Update nextflow.config
* feat: update syntax
* Fix arriba tests
* Fix more failing tests
* Update test syntax
* Remove comments from tests nextflow.config
* Apply suggestions from code review
* Fix kallistobustools/count module
* Update dumpsoftwareversions module
* Update custom/dumpsoftwareversions
* Add args2 to untar module
* Update leftover modules
* Remove last remaining addParams
Co-authored-by: JoseEspinosa <kadomu@gmail.com>
Co-authored-by: Gregor Sturm <mail@gregor-sturm.de>
Co-authored-by: MaxUlysse <max.u.garcia@gmail.com>
* Added vcf_index to vcf tuple; output to vcf.gz format.
* Fix: extra new line in meta.yml.
* addressed review feedback
* fix: editorconfig error
* fix: gatk memory flag
* fix: editorconfig error
* fix: Indentation
fix: Indentation
* Fix: lint editorconfig error
Removed one extra space
Co-authored-by: Robert A. Petit III <robbie.petit@gmail.com>
* fasta_fai_dict tuple is now split into separate input channels
* fix: lint errors
* fix: pytest errors
* Update modules/gatk4/splitncigarreads/meta.yml
* Update modules/gatk4/splitncigarreads/main.nf
Co-authored-by: Maxime U. Garcia <maxime.garcia@scilifelab.se>
* New modules added: issues #200 and #310
* Update main.nf
* Update meta.yml
* Update tests/modules/gatk4/genotypegvcfs/main.nf
* Apply suggestions from code review
* Update main.nf
* Updating tests for GenomicsDB input and adding the path for this test resource to test_data.config
* Some minor changes on one of the test files I forgot to include
Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>
Co-authored-by: GCJMackenzie <43276267+GCJMackenzie@users.noreply.github.com>
* feat: update gatk4 from 4.2.0.0 to 4.2.3.0
* update md5checksum
* commit all files
* actually checksum was good, but I suspect something fishy with the tests
* saving changes to checkout
* saving to sort out other branch
* removed yml tracking of files that cant be tracked due to directory name changing between runs
* test data added, ready for pr
* fix eol linting error
* Update modules/gatk4/genomicsdbimport/main.nf
Co-authored-by: Francesco L <53608000+lescai@users.noreply.github.com>
* merging with master
* update push to show progress
* tests now working untar able to pass data to genomicsdbimport
* commit to checkout
* tests updated, module reworked to simplify and emit updated gendb
* Apply suggestions from code review
Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>
* update meta.yml
Priority of input options changed, updated to reflect this
* Update test.yml
name prefix changed in main script, test.yml updated to reflect this
* fix tests due to review changes
* bug fixes, multicalling samples and gendb emissions now fixed
* Update pytest_modules.yml
* Update meta.yml
Co-authored-by: GCJMackenzie <gavin.mackenzie@nibsc.org>
Co-authored-by: Francesco L <53608000+lescai@users.noreply.github.com>
Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>
Co-authored-by: Gregor Sturm <mail@gregor-sturm.de>
* saving changes to checkout
* saving to sort out other branch
* removed yml tracking of files that cant be tracked due to directory name changing between runs
* test data added, ready for pr
* fix eol linting error
* Update modules/gatk4/genomicsdbimport/main.nf
Co-authored-by: Francesco L <53608000+lescai@users.noreply.github.com>
* merging with master
* update push to show progress
* tests now working untar able to pass data to genomicsdbimport
* commit to checkout
* tests updated, module reworked to simplify and emit updated gendb
* Apply suggestions from code review
Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>
* update meta.yml
Priority of input options changed, updated to reflect this
* Update test.yml
name prefix changed in main script, test.yml updated to reflect this
* fix tests due to review changes
Co-authored-by: GCJMackenzie <gavin.mackenzie@nibsc.org>
Co-authored-by: Francesco L <53608000+lescai@users.noreply.github.com>
Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>
* Make samtools/merge cram compliant
* samtools/stats cram compliance
* update yml file
* samtools/view to deal with crams
* Update tests to make sure cram works
* also fix tmp dir and min mem in one go
* basequalityrecal test for cram + min mem + tmpdir
* update haplotypecaller for sarek
* update haplotype yml
* update markdup to allow multiple bams, take out params to be passed with options.args
* remove TODO statement
* Remove variable md5sum
* add emtpy input to stats module in subworkflows
* subworkflows seem to work now on my side
* Apply code review
Co-authored-by: Maxime U. Garcia <maxime.garcia@scilifelab.se>
* replace bam with input to be more inclusive
* rename everywhere
* rename input
* remove variable checksum
Co-authored-by: Maxime U. Garcia <maxime.garcia@scilifelab.se>
* new mitochondria mode added, tests updated to allow for temp fix for test data
* add cram test
* bam/bam_idx renamed to input and input_index
Co-authored-by: GCJMackenzie <gavin.mackenzie@nibsc.org>
* files created for createsompon, script written, meta written, still needs tests
* updated to 2.0.0 method input, however this requires a genomicsDB input now
* script finished, meta yaml updated. Tests working locally, test yaml made, needs genomicsdb example on nf-core to run repository tests
* versions updated, issue with test data not able to download directory
* updated tests to include repo-side data
* Apply suggestions from code review
* Update modules/gatk4/createsomaticpanelofnormals/main.nf
Co-authored-by: GCJMackenzie <gavin.mackenzie@nibsc.org>
Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>
