* fix: remove left-over unnecessary code
* Adds support for meta lists for unzip and untar
* Fix test inputs
* Update all modules to support extraction of decompressed file from untar/unzip new meta + file tuple
* Update all modules to support extraction of decompressed file from untar/unzip new meta + file tuple
* Fix MALTEXTRACT/AMPS
* Fix further modules
* Fix cellranger
* Apply suggestions from code review
Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>
* style: Add prettier config files
* build: Add prettier vscode extension
* ci: Replace markdownlint and yamllint with prettier
* style: Run prettier
* style: Use indent of 2 for markdown as well
https://github.com/nf-core/tools/pull/1470#issuecomment-1071028358
* style: Fix indent
* style: Let editorconfig take over tab widths
* style: yaml => yml
* ci: Run prettier once
Co-authored-by: Phil Ewels <phil.ewels@scilifelab.se>
Co-authored-by: Phil Ewels <phil.ewels@scilifelab.se>
* add gatk4/combinegvcfs module
* update gatk4/combinegvcfs
* loop to create a string adding -V to each vcf file
* add contains for variable md5
* rm whitespace
* meta in output
* fix indentations
* fix indentations
* move tmpdir to args and update conda version
Co-authored-by: Peri <rrx8@cdc.gov>
Co-authored-by: Maxime U. Garcia <max.u.garcia@gmail.com>
* Update versions
* update checksums + remove variables as input for applyvqsr
* sneak in removal of values and provide them via modules.config
* update another checksum
* more checksums
* move vairable to config
* remove controlfreec, wrong branch
* add line break
* Match target bed to input files
* Intervals in getpileupsumamries
* more interval updates
* change targets in strelka
* remove leftover channel
* fix checksums
* add new test vcfs
* add new test vcfs
* Update modules/freebayes/main.nf
Co-authored-by: Maxime U. Garcia <maxime.garcia@scilifelab.se>
* initial commit to setup branch
* workflow finished
* Update nextflow.config
* tumour to tumor, getpileup passed as nomral and tumor
* paired_somatic renamed to tumor_normal_somatic
* Apply suggestions from code review
Co-authored-by: Maxime U. Garcia <maxime.garcia@scilifelab.se>
* Update subworkflows/nf-core/gatk_tumor_normal_somatic_variant_calling/main.nf
Co-authored-by: Maxime U. Garcia <maxime.garcia@scilifelab.se>
* updated index names in meta.yml
* changed index file names in main script and test
* Apply suggestions from code review
Co-authored-by: Maxime U. Garcia <maxime.garcia@scilifelab.se>
* Apply suggestions from code review
* fixed bug from changes
* Apply suggestions from code review
* modified yml to allow new subworkflow testing
* Update test.yml
* Update test.yml
* updated to follow the new mergebam syntax, also made unaligned input sample specific
Co-authored-by: GCJMackenzie <gavin.mackenzie@nibsc.org>
Co-authored-by: Maxime U. Garcia <maxime.garcia@scilifelab.se>
* Change intervals to be part of sample specific input
* Fix some tests
* Update checksum
* Update intervals
* Update intervals
* Try out gavins idea for adding the file
* update test line
* update test line
* update test line
* revert contains line
* committing to pull updated nf-core files
* saving changes to checout other branch
* committing progress so far, difficulty with test data
* uploading to be used as draft PR
* fix linting error in meta.yml
* attempt to group reference inputs together
* updated input format for resources
* meta.yml updated with new resource names
* added output channel for recal index
* module only takes single vcf file input now
* committing to checkout
* update to new syntax, remove indel test for now
* updated to use memory options and new test data
* Update modules/gatk4/variantrecalibrator/main.nf
Co-authored-by: FriederikeHanssen <Friederike.hanssen@qbic.uni-tuebingen.de>
* Update main.nf
* Update modules/gatk4/variantrecalibrator/main.nf
Co-authored-by: FriederikeHanssen <Friederike.hanssen@qbic.uni-tuebingen.de>
* remove duplicate test keys from test_data.config
Co-authored-by: GCJMackenzie <gavin.mackenzie@nibsc.org>
Co-authored-by: FriederikeHanssen <Friederike.hanssen@qbic.uni-tuebingen.de>
* initial commit to setup branch
* workflow finished
* Update nextflow.config
* tumour to tumor, getpileup passed as nomral and tumor
* paired_somatic renamed to tumor_normal_somatic
* Apply suggestions from code review
Co-authored-by: Maxime U. Garcia <maxime.garcia@scilifelab.se>
* Update subworkflows/nf-core/gatk_tumor_normal_somatic_variant_calling/main.nf
Co-authored-by: Maxime U. Garcia <maxime.garcia@scilifelab.se>
* updated index names in meta.yml
* changed index file names in main script and test
* Apply suggestions from code review
Co-authored-by: Maxime U. Garcia <maxime.garcia@scilifelab.se>
* Apply suggestions from code review
* fixed bug from changes
* Apply suggestions from code review
* modified yml to allow new subworkflow testing
* Update test.yml
* Update test.yml
* add applyvqsr
* added memory options, new test data used
* Update main.nf
* Update main.nf
Co-authored-by: GCJMackenzie <gavin.mackenzie@nibsc.org>
Co-authored-by: Maxime U. Garcia <maxime.garcia@scilifelab.se>
* initial commit to setup branch
* workflow finished
* Update nextflow.config
* tumour to tumor, getpileup passed as nomral and tumor
* paired_somatic renamed to tumor_normal_somatic
* Apply suggestions from code review
Co-authored-by: Maxime U. Garcia <maxime.garcia@scilifelab.se>
* Update subworkflows/nf-core/gatk_tumor_normal_somatic_variant_calling/main.nf
Co-authored-by: Maxime U. Garcia <maxime.garcia@scilifelab.se>
* updated index names in meta.yml
* changed index file names in main script and test
* Apply suggestions from code review
Co-authored-by: Maxime U. Garcia <maxime.garcia@scilifelab.se>
* Apply suggestions from code review
* fixed bug from changes
* Apply suggestions from code review
* modified yml to allow new subworkflow testing
* Update test.yml
* Update test.yml
* added output channel for tbi files, tweaked method of adding blank inputs for gendb tests
* Update main.nf
* Update main.nf
Co-authored-by: GCJMackenzie <gavin.mackenzie@nibsc.org>
Co-authored-by: Maxime U. Garcia <maxime.garcia@scilifelab.se>
* Add comment line for consistency
* Remove all functions.nf
* Remove include functions.nf and publishDir options
* Replace options.args3 with task.ext.args3 - 3 modules
* Replace options.args3 with task.ext.args3 - 17 modules
* Replace {task.cpus} with task.cpus
* Replace off on off off off off off off off on off on off on off off off on off off off on on off off off on on off off off off off off off on off off off off on off on on off off off on on on on off off off on off on on off on on off off on on on off on on off on off off off off on off off off on off off on off on off off off on on off on off on off off on off off off on off off off on off off off off on off off off on on on off on on off off on off on on on off on on off on on on off off off off off on on off off on off off off off off on off off on on off on on off on off off off on off off off off on on off on off off on off off on off on off off off off off off off off on on off on off off off.args with
* Add def args = task.ext.args line to all modules in script section
* Replace options.args with args and args_list
* Initialise args2 and args3 properly
* Replace container syntax
* Revert container changes for cellranger/mkref
* Replace getProcessName in all modules
* Replace getSoftwareName in all modules
* Unify modules using VERSION variable
* Replae options.suffix with task.ext.suffix
* Remove NF version restriction for CI
* Bump NF version in README
* Replace task.process.tokenize logic with task.process
* Minor tweaks to unify syntax in tests main.nf
* Add a separate nextflow.config for each module
* Transfer remaining module options to nextflow.config
* Remove addParams from tests main.nf
* Remove TODO statements
* Use -c to import module specific config
* Bump NF version to 21.10.3
* Fix tests for artic/minion
* Fix broken publishDir syntax
* Standardise and fix obvious failing module tests
* Remove kronatools to krona
* Comment out tags in subworkflow test.yml
* Fix failing module tests
* Add consistent indentation to nextflow.config
* Comment out subworklow definitions
* Fix kallistobustools/ref
* Fix rmarkdownnotebook
* Fix jupyternotebook
* Quote task.process
* Add plink2/vcf to pytest_modules.yml
* Remove NF_CORE_MODULES_TEST from pytest CI
* Fix more tests
* Move bacteroides_fragilis to prokaryotes folder
* Fix cooler merge tests
* Fix kallistobustools/count tests
* Fix kallistobustools/ref tests
* Update test_10x_1_fastq_gz file for kallistobustools/count tests
* Fix bcftools/query tests
* Fix delly/call tests
* Fix cooler/zoomify tests
* Fix csvtk/split tests
* Fix gatk4/intervallisttools tests
* Fix gatk4/variantfiltration
* Fix pydamage/filter tests
* Fix test data for unicycler
* Fix gstama/collapse module
* Fix leehom tests
* Fix metaphlan3 tests
* Fix pairtools/select tests
* Update nextflow.config
* Update nextflow.config
* feat: update syntax
* Fix arriba tests
* Fix more failing tests
* Update test syntax
* Remove comments from tests nextflow.config
* Apply suggestions from code review
* Fix kallistobustools/count module
* Update dumpsoftwareversions module
* Update custom/dumpsoftwareversions
* Add args2 to untar module
* Update leftover modules
* Remove last remaining addParams
* Change syntax from task.ext.suffix to tast.ext.prefix
* Change nextflow.config in all tests to use ext.prefix instead of ext.suffix
Co-authored-by: JoseEspinosa <kadomu@gmail.com>
Co-authored-by: Gregor Sturm <mail@gregor-sturm.de>
Co-authored-by: MaxUlysse <max.u.garcia@gmail.com>
* Add comment line for consistency
* Remove all functions.nf
* Remove include functions.nf and publishDir options
* Replace options.args3 with task.ext.args3 - 3 modules
* Replace options.args3 with task.ext.args3 - 17 modules
* Replace {task.cpus} with task.cpus
* Replace off on off off off off off off off on off on off on off off off on off off off on on off off off on on off off off off off off off on off off off off on off on on off off off on on on on off off off on off on on off on on off off on on on off on on off on off off off off on off off off on off off on off on off off off on on off on off on off off on off off off on off off off on off off off off on off off off on on on off on on off off on off on on on off on on off on on on off off off off off on on off off on off off off off off on off off on on off on on off on off off off on off off off off on on off on off off on off off on off on off off off off off off off off on on off on off off off.args with
* Add def args = task.ext.args line to all modules in script section
* Replace options.args with args and args_list
* Initialise args2 and args3 properly
* Replace container syntax
* Revert container changes for cellranger/mkref
* Replace getProcessName in all modules
* Replace getSoftwareName in all modules
* Unify modules using VERSION variable
* Replae options.suffix with task.ext.suffix
* Remove NF version restriction for CI
* Bump NF version in README
* Replace task.process.tokenize logic with task.process
* Minor tweaks to unify syntax in tests main.nf
* Add a separate nextflow.config for each module
* Transfer remaining module options to nextflow.config
* Remove addParams from tests main.nf
* Remove TODO statements
* Use -c to import module specific config
* Bump NF version to 21.10.3
* Fix tests for artic/minion
* Fix broken publishDir syntax
* Standardise and fix obvious failing module tests
* Remove kronatools to krona
* Comment out tags in subworkflow test.yml
* Fix failing module tests
* Add consistent indentation to nextflow.config
* Comment out subworklow definitions
* Fix kallistobustools/ref
* Fix rmarkdownnotebook
* Fix jupyternotebook
* Quote task.process
* Add plink2/vcf to pytest_modules.yml
* Remove NF_CORE_MODULES_TEST from pytest CI
* Fix more tests
* Move bacteroides_fragilis to prokaryotes folder
* Fix cooler merge tests
* Fix kallistobustools/count tests
* Fix kallistobustools/ref tests
* Update test_10x_1_fastq_gz file for kallistobustools/count tests
* Fix bcftools/query tests
* Fix delly/call tests
* Fix cooler/zoomify tests
* Fix csvtk/split tests
* Fix gatk4/intervallisttools tests
* Fix gatk4/variantfiltration
* Fix pydamage/filter tests
* Fix test data for unicycler
* Fix gstama/collapse module
* Fix leehom tests
* Fix metaphlan3 tests
* Fix pairtools/select tests
* Update nextflow.config
* Update nextflow.config
* feat: update syntax
* Fix arriba tests
* Fix more failing tests
* Update test syntax
* Remove comments from tests nextflow.config
* Apply suggestions from code review
* Fix kallistobustools/count module
* Update dumpsoftwareversions module
* Update custom/dumpsoftwareversions
* Add args2 to untar module
* Update leftover modules
* Remove last remaining addParams
Co-authored-by: JoseEspinosa <kadomu@gmail.com>
Co-authored-by: Gregor Sturm <mail@gregor-sturm.de>
Co-authored-by: MaxUlysse <max.u.garcia@gmail.com>
* Added vcf_index to vcf tuple; output to vcf.gz format.
* Fix: extra new line in meta.yml.
* addressed review feedback
* fix: editorconfig error
* fix: gatk memory flag
* fix: editorconfig error
* fix: Indentation
fix: Indentation
* Fix: lint editorconfig error
Removed one extra space
Co-authored-by: Robert A. Petit III <robbie.petit@gmail.com>
* fasta_fai_dict tuple is now split into separate input channels
* fix: lint errors
* fix: pytest errors
* Update modules/gatk4/splitncigarreads/meta.yml
* Update modules/gatk4/splitncigarreads/main.nf
Co-authored-by: Maxime U. Garcia <maxime.garcia@scilifelab.se>
* New modules added: issues #200 and #310
* Update main.nf
* Update meta.yml
* Update tests/modules/gatk4/genotypegvcfs/main.nf
* Apply suggestions from code review
* Update main.nf
* Updating tests for GenomicsDB input and adding the path for this test resource to test_data.config
* Some minor changes on one of the test files I forgot to include
Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>
Co-authored-by: GCJMackenzie <43276267+GCJMackenzie@users.noreply.github.com>
* feat: update gatk4 from 4.2.0.0 to 4.2.3.0
* update md5checksum
* commit all files
* actually checksum was good, but I suspect something fishy with the tests
* saving changes to checkout
* saving to sort out other branch
* removed yml tracking of files that cant be tracked due to directory name changing between runs
* test data added, ready for pr
* fix eol linting error
* Update modules/gatk4/genomicsdbimport/main.nf
Co-authored-by: Francesco L <53608000+lescai@users.noreply.github.com>
* merging with master
* update push to show progress
* tests now working untar able to pass data to genomicsdbimport
* commit to checkout
* tests updated, module reworked to simplify and emit updated gendb
* Apply suggestions from code review
Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>
* update meta.yml
Priority of input options changed, updated to reflect this
* Update test.yml
name prefix changed in main script, test.yml updated to reflect this
* fix tests due to review changes
* bug fixes, multicalling samples and gendb emissions now fixed
* Update pytest_modules.yml
* Update meta.yml
Co-authored-by: GCJMackenzie <gavin.mackenzie@nibsc.org>
Co-authored-by: Francesco L <53608000+lescai@users.noreply.github.com>
Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>
Co-authored-by: Gregor Sturm <mail@gregor-sturm.de>
* files created for createsompon, script written, meta written, still needs tests
* updated to 2.0.0 method input, however this requires a genomicsDB input now
* script finished, meta yaml updated. Tests working locally, test yaml made, needs genomicsdb example on nf-core to run repository tests
* versions updated, issue with test data not able to download directory
* updated tests to include repo-side data
* Apply suggestions from code review
* Update modules/gatk4/createsomaticpanelofnormals/main.nf
* temp commit to allow checkout
* updated createsompon tests to use tarred gendb
* resolve conflict
* Update tests/modules/gatk4/createsomaticpanelofnormals/main.nf
Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>
Co-authored-by: GCJMackenzie <gavin.mackenzie@nibsc.org>
Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>
* saving changes to checkout
* saving to sort out other branch
* removed yml tracking of files that cant be tracked due to directory name changing between runs
* test data added, ready for pr
* fix eol linting error
* Update modules/gatk4/genomicsdbimport/main.nf
Co-authored-by: Francesco L <53608000+lescai@users.noreply.github.com>
* merging with master
* update push to show progress
* tests now working untar able to pass data to genomicsdbimport
* commit to checkout
* tests updated, module reworked to simplify and emit updated gendb
* Apply suggestions from code review
Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>
* update meta.yml
Priority of input options changed, updated to reflect this
* Update test.yml
name prefix changed in main script, test.yml updated to reflect this
* fix tests due to review changes
Co-authored-by: GCJMackenzie <gavin.mackenzie@nibsc.org>
Co-authored-by: Francesco L <53608000+lescai@users.noreply.github.com>
Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>
* Make samtools/merge cram compliant
* samtools/stats cram compliance
* update yml file
* samtools/view to deal with crams
* Update tests to make sure cram works
* also fix tmp dir and min mem in one go
* basequalityrecal test for cram + min mem + tmpdir
* update haplotypecaller for sarek
* update haplotype yml
* update markdup to allow multiple bams, take out params to be passed with options.args
* remove TODO statement
* Remove variable md5sum
* add emtpy input to stats module in subworkflows
* subworkflows seem to work now on my side
* Apply code review
Co-authored-by: Maxime U. Garcia <maxime.garcia@scilifelab.se>
* replace bam with input to be more inclusive
* rename everywhere
* rename input
* remove variable checksum
Co-authored-by: Maxime U. Garcia <maxime.garcia@scilifelab.se>
* new mitochondria mode added, tests updated to allow for temp fix for test data
* add cram test
* bam/bam_idx renamed to input and input_index
Co-authored-by: GCJMackenzie <gavin.mackenzie@nibsc.org>
* files created for createsompon, script written, meta written, still needs tests
* updated to 2.0.0 method input, however this requires a genomicsDB input now
* script finished, meta yaml updated. Tests working locally, test yaml made, needs genomicsdb example on nf-core to run repository tests
* versions updated, issue with test data not able to download directory
* updated tests to include repo-side data
* Apply suggestions from code review
* Update modules/gatk4/createsomaticpanelofnormals/main.nf
Co-authored-by: GCJMackenzie <gavin.mackenzie@nibsc.org>
Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>
* files for learnreadorientationmodel initialised for first commit
* finished scripts and yml files. test working locally but needs an f1r2 test data on nf-core before it can be submitted
* updated test data location
* versions file updated, test data added
* updated versions file, edited test file
* small formatting update to main.nf
* Update main.nf
* Update test_data.config
* updated tests main.nf
* Update test_data.config
* Apply suggestions from code review
* Update modules/gatk4/learnreadorientationmodel/main.nf
* Update modules/gatk4/learnreadorientationmodel/meta.yml
* fixed tests failing
Co-authored-by: GCJMackenzie <gavin.mackenzie@nibsc.org>
Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>
* initiated files for calculate contamination
* pushing local repo to remote
* created script, filled in meta yml, created tests and test yml. local checks passing, needs repo side test data
* added option and tests for outputting optional segmentation file
* saving for test push
* versions updated, test data added
* Update main.nf
* fixed versions info, should report correctly now
* small update to main.nf outputs formatting
* Apply suggestions from code review
* Update test_data.config
* Apply suggestions from code review
Co-authored-by: GCJMackenzie <gavin.mackenzie@nibsc.org>
Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>
* added output channel for stats file, updated meta yml with description and test yml with check for stats file
* Update modules/gatk4/mutect2/main.nf
Co-authored-by: GCJMackenzie <gavin.mackenzie@nibsc.org>
Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>
* mutect2 files added, first draft of module code entered
* removing comment from main.nf
* removing comment from main.nf
* test added, commit made before editing yaml
* tests added, still needs final check and info/comments added
* gatk4 version changed to gatk4=4.2.0.0
* multiple sample support added, information added to module yaml file
* Update meta.yml
fixed linting error
* add keywords to meta.yml
* Corrections made to meta.yml
* removed whitespace from meta.yml
Co-authored-by: Gavin.Mackenzie <gavin.mackenzie@nibsc.org>
Co-authored-by: Maxime U. Garcia <max.u.garcia@gmail.com>
* first commit, added template files for new module
* created getpileupsummaries script, tests and both yml files
* fixed typo in meta.yml
* Update modules/gatk4/getpileupsummaries/meta.yml
changed gz_tbi to gz.tbi as suggested
Co-authored-by: Maxime U. Garcia <maxime.garcia@scilifelab.se>
Co-authored-by: GCJMackenzie <gavin.mackenzie@nibsc.org>
Co-authored-by: Maxime U. Garcia <max.u.garcia@gmail.com>
Co-authored-by: Maxime U. Garcia <maxime.garcia@scilifelab.se>
* Update README
* Rename pytest_software.yml to pytest_modules.yml
* Rename main software directory to modules
* Remove deprecated modules
* Rename tests software to modules
* Replace paths for tests in pytest_modules.yml
* Replace software with modules in Github Actions
* Replace software with modules in main.nf tests
* Rename software to modules in test.yml
