* Add functionality to handle vbz compression
In order for nanopolish to be able handle the default compression for Mk1C Minions (vbz) it must be aware of where to find the plugin. Exporting the HDF5_PLUGIN_PATH found in the conda install (also used to make the biocontainer image) is the solution
* Make the HDF5_PLUGIN_PATH more configurable
Allow the HDF5_PLUGIN_PATH to be changed via a section in a config file e.g
```
params {
modules {
.....
'nanopore_artic_minion' {
.....
hd5_plugin_path = '/usr/local/lib/python3.6/site-packages/ont_fast5_api/vbz_plugin'
}
......
}
}
```
* Update modules/artic/minion/main.nf
Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>
* Bump software versions for viralrecon modules
* Remove custom params.save_unaligned from bowtie2_align
* Unify samtools modules and error if input and output names are the same
* Fix ALL the tests
* Removed if-statement to only run on more than 1 file, now it will run on single files as well.
* Added a test for running the cat_cat module on a single file.
* Created a new test.yml with nf-core modules create-test-yml -t cat/cat
* Edited test.yml to not include paths and md5sums for versions.yml, and also removed sometimes variable md5sums
* Added files for bcftools/sort
* Fixed output format and removed md5 checksum
* Change input to avoid identical in/output names
* Created rows for bcftools/sort in pytest_modules.yml
* Change intervals to be part of sample specific input
* Fix some tests
* Update checksum
* Update intervals
* Update intervals
* Try out gavins idea for adding the file
* update test line
* update test line
* update test line
* revert contains line
* hmmcopy/mapCounter
* update test
* Remove bam tag
* Remove /tmp/ path from test.yml
* Update modules/hmmcopy/mapcounter/meta.yml
Incorporate formatting changes
Co-authored-by: James A. Fellows Yates <jfy133@gmail.com>
* Update modules/hmmcopy/mapcounter/meta.yml
Co-authored-by: James A. Fellows Yates <jfy133@gmail.com>
* Update tests/modules/hmmcopy/mapcounter/main.nf
Co-authored-by: James A. Fellows Yates <jfy133@gmail.com>
Co-authored-by: Simon Pearce <simon.pearce@cruk.manchester.ac.uk>
Co-authored-by: James A. Fellows Yates <jfy133@gmail.com>
* added new module snpsift/split
* added options.args
* added .vcf.gz to input
* removed test and updated to new NF DSL2 syntax
* Updated to new NF DSL2 syntax
* added option to join vcf files
Co-authored-by: Robert A. Petit III <robbie.petit@gmail.com>
Co-authored-by: FriederikeHanssen <Friederike.hanssen@qbic.uni-tuebingen.de>
* committing to pull updated nf-core files
* saving changes to checout other branch
* committing progress so far, difficulty with test data
* uploading to be used as draft PR
* fix linting error in meta.yml
* attempt to group reference inputs together
* updated input format for resources
* meta.yml updated with new resource names
* added output channel for recal index
* module only takes single vcf file input now
* committing to checkout
* update to new syntax, remove indel test for now
* updated to use memory options and new test data
* Update modules/gatk4/variantrecalibrator/main.nf
Co-authored-by: FriederikeHanssen <Friederike.hanssen@qbic.uni-tuebingen.de>
* Update main.nf
* Update modules/gatk4/variantrecalibrator/main.nf
Co-authored-by: FriederikeHanssen <Friederike.hanssen@qbic.uni-tuebingen.de>
* remove duplicate test keys from test_data.config
Co-authored-by: GCJMackenzie <gavin.mackenzie@nibsc.org>
Co-authored-by: FriederikeHanssen <Friederike.hanssen@qbic.uni-tuebingen.de>
* initial commit to setup branch
* workflow finished
* Update nextflow.config
* tumour to tumor, getpileup passed as nomral and tumor
* paired_somatic renamed to tumor_normal_somatic
* Apply suggestions from code review
Co-authored-by: Maxime U. Garcia <maxime.garcia@scilifelab.se>
* Update subworkflows/nf-core/gatk_tumor_normal_somatic_variant_calling/main.nf
Co-authored-by: Maxime U. Garcia <maxime.garcia@scilifelab.se>
* updated index names in meta.yml
* changed index file names in main script and test
* Apply suggestions from code review
Co-authored-by: Maxime U. Garcia <maxime.garcia@scilifelab.se>
* Apply suggestions from code review
* fixed bug from changes
* Apply suggestions from code review
* modified yml to allow new subworkflow testing
* Update test.yml
* Update test.yml
* add applyvqsr
* added memory options, new test data used
* Update main.nf
* Update main.nf
Co-authored-by: GCJMackenzie <gavin.mackenzie@nibsc.org>
Co-authored-by: Maxime U. Garcia <maxime.garcia@scilifelab.se>
* Initial structure
* Working with local singularity image
* Working generateMap.pl script
* Remote not working bioconda
* Working generateMap with biocontainer
* Lint changes
* Updated hmmcopy container version to be consistent
* Fix failing test
* Remove path to perl
* No hardpath to script
* Update main.nf
Moved version outside of process, add support for zipped fasta file
* Revert to not allowing gzip via pipe, as perl script can't cope
Co-authored-by: Simon Pearce <simon.pearce@cruk.manchester.ac.uk>
* initial commit to setup branch
* workflow finished
* Update nextflow.config
* tumour to tumor, getpileup passed as nomral and tumor
* paired_somatic renamed to tumor_normal_somatic
* Apply suggestions from code review
Co-authored-by: Maxime U. Garcia <maxime.garcia@scilifelab.se>
* Update subworkflows/nf-core/gatk_tumor_normal_somatic_variant_calling/main.nf
Co-authored-by: Maxime U. Garcia <maxime.garcia@scilifelab.se>
* updated index names in meta.yml
* changed index file names in main script and test
* Apply suggestions from code review
Co-authored-by: Maxime U. Garcia <maxime.garcia@scilifelab.se>
* Apply suggestions from code review
* fixed bug from changes
* Apply suggestions from code review
* modified yml to allow new subworkflow testing
* Update test.yml
* Update test.yml
* added output channel for tbi files, tweaked method of adding blank inputs for gendb tests
* Update main.nf
* Update main.nf
Co-authored-by: GCJMackenzie <gavin.mackenzie@nibsc.org>
Co-authored-by: Maxime U. Garcia <maxime.garcia@scilifelab.se>
* feat: each output type has dedicated channel replace bgzip with gzip can only zip one at a time
* Add condition moving of unbinned files
* fix: solution for moving sometimes non-existant files
* fix: update meta.yml to add the new channels
* fix: remove most of the checksums due to variability
* fix: tweaking of output
* Update modules/metabat2/metabat2/main.nf
Co-authored-by: Maxime Borry <maxibor@users.noreply.github.com>
* Fix find commands
* Fix find commands
Co-authored-by: Maxime Borry <maxibor@users.noreply.github.com>
* feat: view is now in args2 so we can use sort
* forgot one split_cpus
* feat: update with new logic
* fix: add more info
* fix: remove split_cpus logic
* Add comment line for consistency
* Remove all functions.nf
* Remove include functions.nf and publishDir options
* Replace options.args3 with task.ext.args3 - 3 modules
* Replace options.args3 with task.ext.args3 - 17 modules
* Replace {task.cpus} with task.cpus
* Replace off on off off off off off off off on off on off on off off off on off off off on on off off off on on off off off off off off off on off off off off on off on on off off off on on on on off off off on off on on off on on off off on on on off on on off on off off off off on off off off on off off on off on off off off on on off on off on off off on off off off on off off off on off off off off on off off off on on on off on on off off on off on on on off on on off on on on off off off off off on on off off on off off off off off on off off on on off on on off on off off off on off off off off on on off on off off on off off on off on off off off off off off off off on on off on off off off.args with
* Add def args = task.ext.args line to all modules in script section
* Replace options.args with args and args_list
* Initialise args2 and args3 properly
* Replace container syntax
* Revert container changes for cellranger/mkref
* Replace getProcessName in all modules
* Replace getSoftwareName in all modules
* Unify modules using VERSION variable
* Replae options.suffix with task.ext.suffix
* Remove NF version restriction for CI
* Bump NF version in README
* Replace task.process.tokenize logic with task.process
* Minor tweaks to unify syntax in tests main.nf
* Add a separate nextflow.config for each module
* Transfer remaining module options to nextflow.config
* Remove addParams from tests main.nf
* Remove TODO statements
* Use -c to import module specific config
* Bump NF version to 21.10.3
* Fix tests for artic/minion
* Fix broken publishDir syntax
* Standardise and fix obvious failing module tests
* Remove kronatools to krona
* Comment out tags in subworkflow test.yml
* Fix failing module tests
* Add consistent indentation to nextflow.config
* Comment out subworklow definitions
* Fix kallistobustools/ref
* Fix rmarkdownnotebook
* Fix jupyternotebook
* Quote task.process
* Add plink2/vcf to pytest_modules.yml
* Remove NF_CORE_MODULES_TEST from pytest CI
* Fix more tests
* Move bacteroides_fragilis to prokaryotes folder
* Fix cooler merge tests
* Fix kallistobustools/count tests
* Fix kallistobustools/ref tests
* Update test_10x_1_fastq_gz file for kallistobustools/count tests
* Fix bcftools/query tests
* Fix delly/call tests
* Fix cooler/zoomify tests
* Fix csvtk/split tests
* Fix gatk4/intervallisttools tests
* Fix gatk4/variantfiltration
* Fix pydamage/filter tests
* Fix test data for unicycler
* Fix gstama/collapse module
* Fix leehom tests
* Fix metaphlan3 tests
* Fix pairtools/select tests
* Update nextflow.config
* Update nextflow.config
* feat: update syntax
* Fix arriba tests
* Fix more failing tests
* Update test syntax
* Remove comments from tests nextflow.config
* Apply suggestions from code review
* Fix kallistobustools/count module
* Update dumpsoftwareversions module
* Update custom/dumpsoftwareversions
* Add args2 to untar module
* Update leftover modules
* Remove last remaining addParams
* Change syntax from task.ext.suffix to tast.ext.prefix
* Change nextflow.config in all tests to use ext.prefix instead of ext.suffix
Co-authored-by: JoseEspinosa <kadomu@gmail.com>
Co-authored-by: Gregor Sturm <mail@gregor-sturm.de>
Co-authored-by: MaxUlysse <max.u.garcia@gmail.com>
* Add comment line for consistency
* Remove all functions.nf
* Remove include functions.nf and publishDir options
* Replace options.args3 with task.ext.args3 - 3 modules
* Replace options.args3 with task.ext.args3 - 17 modules
* Replace {task.cpus} with task.cpus
* Replace off on off off off off off off off on off on off on off off off on off off off on on off off off on on off off off off off off off on off off off off on off on on off off off on on on on off off off on off on on off on on off off on on on off on on off on off off off off on off off off on off off on off on off off off on on off on off on off off on off off off on off off off on off off off off on off off off on on on off on on off off on off on on on off on on off on on on off off off off off on on off off on off off off off off on off off on on off on on off on off off off on off off off off on on off on off off on off off on off on off off off off off off off off on on off on off off off.args with
* Add def args = task.ext.args line to all modules in script section
* Replace options.args with args and args_list
* Initialise args2 and args3 properly
* Replace container syntax
* Revert container changes for cellranger/mkref
* Replace getProcessName in all modules
* Replace getSoftwareName in all modules
* Unify modules using VERSION variable
* Replae options.suffix with task.ext.suffix
* Remove NF version restriction for CI
* Bump NF version in README
* Replace task.process.tokenize logic with task.process
* Minor tweaks to unify syntax in tests main.nf
* Add a separate nextflow.config for each module
* Transfer remaining module options to nextflow.config
* Remove addParams from tests main.nf
* Remove TODO statements
* Use -c to import module specific config
* Bump NF version to 21.10.3
* Fix tests for artic/minion
* Fix broken publishDir syntax
* Standardise and fix obvious failing module tests
* Remove kronatools to krona
* Comment out tags in subworkflow test.yml
* Fix failing module tests
* Add consistent indentation to nextflow.config
* Comment out subworklow definitions
* Fix kallistobustools/ref
* Fix rmarkdownnotebook
* Fix jupyternotebook
* Quote task.process
* Add plink2/vcf to pytest_modules.yml
* Remove NF_CORE_MODULES_TEST from pytest CI
* Fix more tests
* Move bacteroides_fragilis to prokaryotes folder
* Fix cooler merge tests
* Fix kallistobustools/count tests
* Fix kallistobustools/ref tests
* Update test_10x_1_fastq_gz file for kallistobustools/count tests
* Fix bcftools/query tests
* Fix delly/call tests
* Fix cooler/zoomify tests
* Fix csvtk/split tests
* Fix gatk4/intervallisttools tests
* Fix gatk4/variantfiltration
* Fix pydamage/filter tests
* Fix test data for unicycler
* Fix gstama/collapse module
* Fix leehom tests
* Fix metaphlan3 tests
* Fix pairtools/select tests
* Update nextflow.config
* Update nextflow.config
* feat: update syntax
* Fix arriba tests
* Fix more failing tests
* Update test syntax
* Remove comments from tests nextflow.config
* Apply suggestions from code review
* Fix kallistobustools/count module
* Update dumpsoftwareversions module
* Update custom/dumpsoftwareversions
* Add args2 to untar module
* Update leftover modules
* Remove last remaining addParams
Co-authored-by: JoseEspinosa <kadomu@gmail.com>
Co-authored-by: Gregor Sturm <mail@gregor-sturm.de>
Co-authored-by: MaxUlysse <max.u.garcia@gmail.com>
* Make targets.bed optional when running in wgs mode
* added test for cram
* Update test_data_config with new reference.cnn
* Update main.nf to allow tumor-only running
Still need a unit-test for this. Almost ready, but needs this file as input https://github.com/nf-core/test-datasets/blob/modules/data/generic/cnn/reference.cnn
* re-writing previous changes, but now it wont crash the entire CI-setup
* fixing overlooked merge conflict
* last overlooked merge-conflict
* move all files to batch subfolder
* adding an optional input for a reference file (needed when running germline and tumoronly)
* minor typo
* update meta.yml
* aligning code, renaming cnvkit to cnvkit_batch, renaming tumorbam to tumor, normalbam to normal
* Update pytest_modules.yml
Co-authored-by: EC2 Default User <ec2-user@ip-172-31-21-198.us-west-2.compute.internal>
Co-authored-by: Lasse Folkersen <lassefolkersen@gmail.com>
Co-authored-by: Robert A. Petit III <robbie.petit@gmail.com>
Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>
* Fix picard/markduplicates with new options syntax
* Delete md5sum for bam files and add contains for metrics.txt
Co-authored-by: Robert A. Petit III <robbie.petit@gmail.com>
Co-authored-by: FriederikeHanssen <Friederike.hanssen@qbic.uni-tuebingen.de>
* Added vcf_index to vcf tuple; output to vcf.gz format.
* Fix: extra new line in meta.yml.
* addressed review feedback
* fix: editorconfig error
* fix: gatk memory flag
* fix: editorconfig error
* fix: Indentation
fix: Indentation
* Fix: lint editorconfig error
Removed one extra space
Co-authored-by: Robert A. Petit III <robbie.petit@gmail.com>
* fasta_fai_dict tuple is now split into separate input channels
* fix: lint errors
* fix: pytest errors
* Update modules/gatk4/splitncigarreads/meta.yml
* Update modules/gatk4/splitncigarreads/main.nf
Co-authored-by: Maxime U. Garcia <maxime.garcia@scilifelab.se>
* add new nucmer module
* Apply suggestions from code review
Co-authored-by: Robert A. Petit III <robbie.petit@gmail.com>
* update tests with file produced by input
* Update main.nf
* Update meta.yml
Co-authored-by: Michael Cipriano <mcipriano@gmail.com>
Co-authored-by: Robert A. Petit III <robbie.petit@gmail.com>
Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>
* created and initialised krona module
* Added kronatools/ktimporttaxonomy module
* removing previous redundant work
* added contains info for html
* edited contains in test.yml
* Update get versions
Co-authored-by: Daniel Straub <42973691+d4straub@users.noreply.github.com>
* remove old syntax
Co-authored-by: Daniel Straub <42973691+d4straub@users.noreply.github.com>
* rewording module description
Co-authored-by: Daniel Straub <42973691+d4straub@users.noreply.github.com>
* added detailed keywords
Co-authored-by: Daniel Straub <42973691+d4straub@users.noreply.github.com>
* update syntax and tool version
* fixed meta.yml issues
* remove contains line from test.yml
* re-wrote module after nf-core/tools update - should work now
* removed md5
* Update modules/kronatools/ktimporttaxonomy/main.nf
Co-authored-by: Daniel Straub <42973691+d4straub@users.noreply.github.com>
* update meta save
* removed typo
* double quotes to single quotes around html
* re-ran test, which updated md5
* removed md5
* 'classifier' removed to fix linting
* update version
* removed erroneous ktimporttaxonomy2
* Updated input to include meta and database
* fixed tab issues in yaml
* added `contains` to test.yml
* edited `contains` in test.yml
* trying another `contains`
* retrying `contains`
* contains with extra line
* removed classifier from tag
* Apply suggestions from code review
* Update meta.yml
Co-authored-by: Daniel Straub <42973691+d4straub@users.noreply.github.com>
Co-authored-by: Sébastien Guizard <sguizard@ed.ac.uk>
Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>
* Add tests and yml file for macs2/callpeak
* add format option for macs2
* update macs2/callpeak to accept format argument
* update test.yml
* update the container version.
* try to fix the issue in conda container.
* Update conda and containers
* Going back to previous container versions
Co-authored-by: JoseEspinosa <kadomu@gmail.com>
* add software/cooler
* fix the wrong files uploaded.
* create a branch for cooler/zoomify
* Apply suggestions from code review
* update functions.nf to new version.
* update the test file to test-datasets.
* update the test method of zoomify
* update dump test file.
* update version.txt to version.yml
* Update modules/cooler/dump/main.nf
Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>
* fix the output bug of versions update to pytest_modules.yml
* update the test file path and fix the output versions.
* Update modules/cooler/dump/main.nf
* indent
Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>
Co-authored-by: Gregor Sturm <mail@gregor-sturm.de>
Co-authored-by: Sébastien Guizard <sguizard@ed.ac.uk>
Co-authored-by: FriederikeHanssen <Friederike.hanssen@qbic.uni-tuebingen.de>
* New modules added: issues #200 and #310
* Update main.nf
* Update meta.yml
* Update tests/modules/gatk4/genotypegvcfs/main.nf
* Apply suggestions from code review
* Update main.nf
* Updating tests for GenomicsDB input and adding the path for this test resource to test_data.config
* Some minor changes on one of the test files I forgot to include
Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>
Co-authored-by: GCJMackenzie <43276267+GCJMackenzie@users.noreply.github.com>
* add software/cooler
* fix the wrong files uploaded.
* create a branch for cooler/merge
* remove the bin_size from metadata.
* update the test_data to test-datasets
* update pytest_modules.yml
* update the test file from single input file to two input file.
update the output file from hdf5 to bedpe.
* update the version.txt to version.yml and functions.nf
* change version.yml to versions
* update the test file path and fix the output versions.
* Update meta.yml
Correct "version" to "versions"
* Update main.nf
Fix typo
* Update main.nf
Remove some spaces
Co-authored-by: Gregor Sturm <mail@gregor-sturm.de>
Co-authored-by: Sébastien Guizard <sguizard@ed.ac.uk>
* commit but won't be used because pmdtools should have a submodule
* added submodule pmdtools/filter
* removed pmdtools module created before deciding to design two submodules
* oops forgot to remove a TODO
* removed white space meta.yml, removed v in version and manually added submodule /filter to test
* Update pytest_modules.yml
* Update main.nf
added split_cpus for multi-tools module resources
* Update test.yml
added .pmd extension to match modules/ main.nf
* Update test.yml
update md5sum
* Update singularity and docker build in main.nf
From build 4 to 5 in order to match the conda one
* Update modules/pmdtools/filter/main.nf
Co-authored-by: James A. Fellows Yates <jfy133@gmail.com>
* Update modules/pmdtools/filter/main.nf
Co-authored-by: James A. Fellows Yates <jfy133@gmail.com>
* Update modules/pmdtools/filter/main.nf
Co-authored-by: James A. Fellows Yates <jfy133@gmail.com>
* Update modules/pmdtools/filter/meta.yml
Co-authored-by: James A. Fellows Yates <jfy133@gmail.com>
* Update modules/pmdtools/filter/meta.yml
Co-authored-by: James A. Fellows Yates <jfy133@gmail.com>
* Update modules/pmdtools/filter/meta.yml
Co-authored-by: James A. Fellows Yates <jfy133@gmail.com>
* Update modules/pmdtools/filter/meta.yml
Co-authored-by: James A. Fellows Yates <jfy133@gmail.com>
* Update modules/pmdtools/filter/main.nf
Co-authored-by: James A. Fellows Yates <jfy133@gmail.com>
* Update modules/pmdtools/filter/main.nf
Co-authored-by: James A. Fellows Yates <jfy133@gmail.com>
* Update main.nf adding samtools version
we need both pmdtools and samtools versions
* Update main.nf remove .pmd extension
* Update test.yml md5sum
Because file extension changed
Co-authored-by: James A. Fellows Yates <jfy133@gmail.com>
