NGSCheckMate ncm mode, working on bam files and vcf files to check that (human) samples match as expected
Co-authored-by: Simon Pearce <simon.pearce@cruk.manchester.ac.uk>
Co-authored-by: Mahesh Binzer-Panchal <mahesh.binzer-panchal@nbis.se>
* Bump chromap version 0.2.0
* Temporary use the docker container until singularity container becomes available
* Temporary use the docker container until singularity container available
* Remove empty lines
* Update singularity container after became available
* added module seqkit replace
* added when
* removed extra line
* Update modules/seqkit/replace/main.nf
Co-authored-by: Robert A. Petit III <robbie.petit@gmail.com>
* Updated meta
* updated indents
Co-authored-by: Cipriano <rrn8@cdc.gov>
Co-authored-by: Sateesh Peri <33637490+sateeshperi@users.noreply.github.com>
Co-authored-by: Robert A. Petit III <robbie.petit@gmail.com>
Signed-off-by: Thomas A. Christensen II <25492070+MillironX@users.noreply.github.com>
Co-authored-by: Sateesh Peri <33637490+sateeshperi@users.noreply.github.com>
* implement plink2/score module
* fix test yml
* fix typo :(
* set cpu
* set mem
* fix input process input block
* fix tests
Co-authored-by: Sateesh <33637490+sateeshperi@users.noreply.github.com>
* fix: remove left-over unnecessary code
* Add hamronizer/deeparg
* Add hamronisation/summarise
* Update test.yml
* Update modules/hamronization/summarize/meta.yml
Co-authored-by: Jasmin F <73216762+jasmezz@users.noreply.github.com>
* line up outputs
Co-authored-by: Robert A. Petit III <robbie.petit@gmail.com>
Co-authored-by: Jasmin F <73216762+jasmezz@users.noreply.github.com>
* update plink2/vcf to output zstandard compressed data automatically
* update meta
* set plink CPU and memory usage
Co-authored-by: Sateesh <33637490+sateeshperi@users.noreply.github.com>
* add drafty controlfreec
* get sofatware version
* use maps in map
* update paths to new and soon-to-be merged test files, add more input docu
* Stab at documenting args map
* Update syntax
* Bit more description
* Make the linter happy
* tests pass locally
* Add outputs & docu
* tests are failing locally now :/ but cpn file can also be added
* All tests passing, need to update test data again to add folder
* Clean up files
* Clean up files
* Clean up files
* Don't know how to get the test to run with the direcotry for now. they pass locally though
* Make linter happy
* Name process back
* Update to use tar folder
* fix the checksum
* bcf annotate ready2go
* edited output name
* fixed output
* updated bcftools ver
* changed contain output string
* removed contain key entirely
* fixed md5sum for test.yml
* using match instead of find
* bcftools/annotate refactored with complete test
* rm trailing white space
Co-authored-by: Robert A. Petit III <robbie.petit@gmail.com>
Signed-off-by: Thomas A. Christensen II <25492070+MillironX@users.noreply.github.com>
Co-authored-by: Sateesh <33637490+sateeshperi@users.noreply.github.com>
Co-authored-by: Robert A. Petit III <robbie.petit@gmail.com>
* Initial commit of seqtk/seq module files
* pytest.yml
* updated module and tests code, need to finish modules/main.nf
* Initial commit of seqtk/seq module files
* pytest.yml
* updated module and tests code, need to finish modules/main.nf
* Adding code and configs for seqtk/seq module
* Re-tested module following minor code update
* removed trailing whitespace errors
* Changed variable name to following reviewer suggestions
Co-authored-by: Sateesh <33637490+sateeshperi@users.noreply.github.com>
* add gatk4/combinegvcfs module
* update gatk4/combinegvcfs
* loop to create a string adding -V to each vcf file
* add contains for variable md5
* rm whitespace
* meta in output
* fix indentations
* fix indentations
* move tmpdir to args and update conda version
Co-authored-by: Peri <rrx8@cdc.gov>
Co-authored-by: Maxime U. Garcia <max.u.garcia@gmail.com>
* add picard-addorreplacereadgroups
* add picard_addorreplacereadgroups
* add new line to main.nf
* remove trailing whitespaces
* remove trailing whitespaces
* change to output in test yml
* add when directive
* picard 2.26.10 -> 2.26.9
* picard 2.26.10 -> 2.26.9 test yml
Co-authored-by: Peri <rrx8@cdc.gov>
Co-authored-by: Robert A. Petit III <robbie.petit@gmail.com>
* add picard-cleansam
* add picard/cleansam
* update test yml with output
* picard 2.26.10 -> 2.26.9
* add output to test yml
Co-authored-by: Peri <rrx8@cdc.gov>
Co-authored-by: Robert A. Petit III <robbie.petit@gmail.com>
* add picard/createsequencedictionary module
* add picard-CreateSequenceDictionary
* add picard/createsequencedictionary/
* add contains to test yml
* update test yml contains
* update test yml contains
Co-authored-by: Peri <rrx8@cdc.gov>
Co-authored-by: Robert A. Petit III <robbie.petit@gmail.com>
* add picard-fixmateinformation
* add picard-fixmateinformation
* fix trailing whitespace
* fix trailing whitespace
Co-authored-by: Peri <rrx8@cdc.gov>
Co-authored-by: Robert A. Petit III <robbie.petit@gmail.com>
* Add deeptools bamcoverage
* remove todo string
* Add in when
* fix c&p version format error
* Fix md5sums
Co-authored-by: Maxime U. Garcia <max.u.garcia@gmail.com>
* include intervals_index
In order to run the GATK `GenotypeGVCFs` tool with an interval file (such as a .bed file) you need to have the corresponding index file. Otherwise you get the following error message
```
A USER ERROR has occurred: An index is required but was not found for file genome.bed.gz: work/6c/541fce2dc670597f62a571c72288c6/genome.bed.gz. Support for unindexed block-compressed files has been temporarily disabled. Try running IndexFeatureFile on the input.
```
including the index file fixes this problem
* Update meta.yml
* Added seqtk/rename module and tests code
* Updated files and testing code for seqtk rename
* Added meta map to seqtk/rename module def
* updated prefix parameter usage
* updated test.yml to remove local filepaths --> change to output
* Added empty line to main.nf
* Update versions
* update checksums + remove variables as input for applyvqsr
* sneak in removal of values and provide them via modules.config
* update another checksum
* more checksums
* move vairable to config
* remove controlfreec, wrong branch
* add line break
* First version of the biobambam/bammarkduplicates2 module
* Fixed the path of versions.yml
* Regenerated the checksums as the previous files were generated with a single core
* Added the `when:` block, as per #1261
Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>
Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>
* hmmcopy/mapCounter
* update test
* Remove bam tag
* Remove /tmp/ path from test.yml
* Update modules/hmmcopy/mapcounter/meta.yml
Incorporate formatting changes
Co-authored-by: James A. Fellows Yates <jfy133@gmail.com>
* Update modules/hmmcopy/mapcounter/meta.yml
Co-authored-by: James A. Fellows Yates <jfy133@gmail.com>
* Update tests/modules/hmmcopy/mapcounter/main.nf
Co-authored-by: James A. Fellows Yates <jfy133@gmail.com>
* ichorCNA run
* Add panel of normals code
* Try and fix tests
* Edit string detection in tests
* Fix linting issues
* Just failing END_VERSIONS
* Fixed versions.yml
* Added DOI
* Optional name for file
* Add when command
* Updated when
* Update modules/ichorcna/createpon/main.nf
Co-authored-by: Simon Pearce <simon.pearce@cruk.manchester.ac.uk>
Co-authored-by: James A. Fellows Yates <jfy133@gmail.com>
Co-authored-by: FriederikeHanssen <Friederike.hanssen@qbic.uni-tuebingen.de>
* Match target bed to input files
* Intervals in getpileupsumamries
* more interval updates
* change targets in strelka
* remove leftover channel
* fix checksums
* add new test vcfs
* add new test vcfs
* Update modules/freebayes/main.nf
Co-authored-by: Maxime U. Garcia <maxime.garcia@scilifelab.se>
* Add msisensorpro
* remove absolute paths
* fixing tests
* fix msisensorpro tests
* Update modules/msisensorpro/msi_somatic/main.nf
Co-authored-by: Maxime U. Garcia <maxime.garcia@scilifelab.se>
* Update modules/msisensorpro/msi_somatic/main.nf
Co-authored-by: Maxime U. Garcia <maxime.garcia@scilifelab.se>
* add when back in
* add when back in
* Update modules/msisensorpro/msi_somatic/main.nf
Co-authored-by: Maxime U. Garcia <maxime.garcia@scilifelab.se>
* update description
* Update main.nf
* Update main.nf
* Update main.nf
Co-authored-by: Maxime U. Garcia <maxime.garcia@scilifelab.se>
* add plink2_extract
* fix test yml path
* Update modules/plink2/extract/main.nf
Co-authored-by: James A. Fellows Yates <jfy133@gmail.com>
* Update modules/plink2/extract/main.nf
Co-authored-by: James A. Fellows Yates <jfy133@gmail.com>
* compress output
* add DOI
* make outputs less ambiguous
* update test for compressed output
* brain is dumb
* Update modules/plink2/extract/main.nf
Co-authored-by: James A. Fellows Yates <jfy133@gmail.com>
Co-authored-by: James A. Fellows Yates <jfy133@gmail.com>
* initial commit to setup branch
* workflow finished
* Update nextflow.config
* tumour to tumor, getpileup passed as nomral and tumor
* paired_somatic renamed to tumor_normal_somatic
* Apply suggestions from code review
Co-authored-by: Maxime U. Garcia <maxime.garcia@scilifelab.se>
* Update subworkflows/nf-core/gatk_tumor_normal_somatic_variant_calling/main.nf
Co-authored-by: Maxime U. Garcia <maxime.garcia@scilifelab.se>
* updated index names in meta.yml
* changed index file names in main script and test
* Apply suggestions from code review
Co-authored-by: Maxime U. Garcia <maxime.garcia@scilifelab.se>
* Apply suggestions from code review
* fixed bug from changes
* Apply suggestions from code review
* modified yml to allow new subworkflow testing
* Update test.yml
* Update test.yml
* updated to follow the new mergebam syntax, also made unaligned input sample specific
Co-authored-by: GCJMackenzie <gavin.mackenzie@nibsc.org>
Co-authored-by: Maxime U. Garcia <maxime.garcia@scilifelab.se>
* refactor: add bcl2fastq to cellranger dockerfile
bcl2fastq required for the cellranger mkfastq module and was therefore
added to the cellranger dockerfile. Further, cellranger was updated to
the latest version, 6.1.2., with naming and containers across
cellranger modules updated accordingly.
* chore: add bcl2fastq zip to .gitignore
* style: fix code linting error
* test(cellranger): Add tiles to mkfastq
* additional dockerfile for mkfastq
* update readme and dockerfiles
* update readme
* fix: update container for mkfastq
* docs: correct typos in readme
* test: update md5sum following cellranger update
* test: update md5sum following cellranger update
* fix: new line for external args in mkfastq
* test: update mkfastq tiles argument
* test: comment out mkfastq tests until smaller test data found
* test: stub-run mkfastq test until smaller test data found
* test: fix incorrect file path for mkfastq
Co-authored-by: Edmund Miller <edmund.a.miller@protonmail.com>
Co-authored-by: ggabernet <gisela.gabernet@qbic.uni-tuebingen.de>
Co-authored-by: Gisela Gabernet <gisela.gabernet@gmail.com>
* Bump version 0.1.5 to chromap/chromap
* Bump conda samtools version to 1.14
* Get read of inconsistent md5sum in conda
* Bump version in conda and retry md5 checks
* genome index md5 hash removed, conda failed
* Remove old nextclade module
* Add nextclade/datasetget and nextclade/run modules
* Fix ECLint
* Add reference and tag as inputs to datasetget module
* Fix tests
* Adjust spacing
* Add stubs for deepvariant [ci skip]
* Update the stubs for deepvariant [ci skip]
* functional with google docker image
* cleanup
* consume docker container within singularity executor
* update the meta.yml file and ask for review
* tweak the input channel shape and test data
* tweak input data [ci skip]
* update for the new syntax
* remove the functions and rename meta vars
* Update the arguments mechanism
* update chr, region and checksum
Co-authored-by: Gregor Sturm <mail@gregor-sturm.de>
Co-authored-by: Maxime U. Garcia <max.u.garcia@gmail.com>
Co-authored-by: FriederikeHanssen <Friederike.hanssen@qbic.uni-tuebingen.de>
* Update dsh-bio to version 2.0.7, add support for compressed GFA 1.0 format
* fix ci failures
Co-authored-by: Chris Cheshire <chris.j.cheshire@gmail.com>
* Add functionality to handle vbz compression
In order for nanopolish to be able handle the default compression for Mk1C Minions (vbz) it must be aware of where to find the plugin. Exporting the HDF5_PLUGIN_PATH found in the conda install (also used to make the biocontainer image) is the solution
* Make the HDF5_PLUGIN_PATH more configurable
Allow the HDF5_PLUGIN_PATH to be changed via a section in a config file e.g
```
params {
modules {
.....
'nanopore_artic_minion' {
.....
hd5_plugin_path = '/usr/local/lib/python3.6/site-packages/ont_fast5_api/vbz_plugin'
}
......
}
}
```
* Update modules/artic/minion/main.nf
* Export HDF5_PLUGIN_PATH
The HDF5_PLUGIN_PATH variable should be exported for `artic minion` to use it
Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>
* Add functionality to handle vbz compression
In order for nanopolish to be able handle the default compression for Mk1C Minions (vbz) it must be aware of where to find the plugin. Exporting the HDF5_PLUGIN_PATH found in the conda install (also used to make the biocontainer image) is the solution
* Make the HDF5_PLUGIN_PATH more configurable
Allow the HDF5_PLUGIN_PATH to be changed via a section in a config file e.g
```
params {
modules {
.....
'nanopore_artic_minion' {
.....
hd5_plugin_path = '/usr/local/lib/python3.6/site-packages/ont_fast5_api/vbz_plugin'
}
......
}
}
```
* Update modules/artic/minion/main.nf
Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>
* Bump software versions for viralrecon modules
* Remove custom params.save_unaligned from bowtie2_align
* Unify samtools modules and error if input and output names are the same
* Fix ALL the tests
* Removed if-statement to only run on more than 1 file, now it will run on single files as well.
* Added a test for running the cat_cat module on a single file.
* Created a new test.yml with nf-core modules create-test-yml -t cat/cat
* Edited test.yml to not include paths and md5sums for versions.yml, and also removed sometimes variable md5sums
* Added files for bcftools/sort
* Fixed output format and removed md5 checksum
* Change input to avoid identical in/output names
* Created rows for bcftools/sort in pytest_modules.yml
* Change intervals to be part of sample specific input
* Fix some tests
* Update checksum
* Update intervals
* Update intervals
* Try out gavins idea for adding the file
* update test line
* update test line
* update test line
* revert contains line
* hmmcopy/mapCounter
* update test
* Remove bam tag
* Remove /tmp/ path from test.yml
* Update modules/hmmcopy/mapcounter/meta.yml
Incorporate formatting changes
Co-authored-by: James A. Fellows Yates <jfy133@gmail.com>
* Update modules/hmmcopy/mapcounter/meta.yml
Co-authored-by: James A. Fellows Yates <jfy133@gmail.com>
* Update tests/modules/hmmcopy/mapcounter/main.nf
Co-authored-by: James A. Fellows Yates <jfy133@gmail.com>
Co-authored-by: Simon Pearce <simon.pearce@cruk.manchester.ac.uk>
Co-authored-by: James A. Fellows Yates <jfy133@gmail.com>
* added new module snpsift/split
* added options.args
* added .vcf.gz to input
* removed test and updated to new NF DSL2 syntax
* Updated to new NF DSL2 syntax
* added option to join vcf files
Co-authored-by: Robert A. Petit III <robbie.petit@gmail.com>
Co-authored-by: FriederikeHanssen <Friederike.hanssen@qbic.uni-tuebingen.de>
* committing to pull updated nf-core files
* saving changes to checout other branch
* committing progress so far, difficulty with test data
* uploading to be used as draft PR
* fix linting error in meta.yml
* attempt to group reference inputs together
* updated input format for resources
* meta.yml updated with new resource names
* added output channel for recal index
* module only takes single vcf file input now
* committing to checkout
* update to new syntax, remove indel test for now
* updated to use memory options and new test data
* Update modules/gatk4/variantrecalibrator/main.nf
Co-authored-by: FriederikeHanssen <Friederike.hanssen@qbic.uni-tuebingen.de>
* Update main.nf
* Update modules/gatk4/variantrecalibrator/main.nf
Co-authored-by: FriederikeHanssen <Friederike.hanssen@qbic.uni-tuebingen.de>
* remove duplicate test keys from test_data.config
Co-authored-by: GCJMackenzie <gavin.mackenzie@nibsc.org>
Co-authored-by: FriederikeHanssen <Friederike.hanssen@qbic.uni-tuebingen.de>
* initial commit to setup branch
* workflow finished
* Update nextflow.config
* tumour to tumor, getpileup passed as nomral and tumor
* paired_somatic renamed to tumor_normal_somatic
* Apply suggestions from code review
Co-authored-by: Maxime U. Garcia <maxime.garcia@scilifelab.se>
* Update subworkflows/nf-core/gatk_tumor_normal_somatic_variant_calling/main.nf
Co-authored-by: Maxime U. Garcia <maxime.garcia@scilifelab.se>
* updated index names in meta.yml
* changed index file names in main script and test
* Apply suggestions from code review
Co-authored-by: Maxime U. Garcia <maxime.garcia@scilifelab.se>
* Apply suggestions from code review
* fixed bug from changes
* Apply suggestions from code review
* modified yml to allow new subworkflow testing
* Update test.yml
* Update test.yml
* add applyvqsr
* added memory options, new test data used
* Update main.nf
* Update main.nf
Co-authored-by: GCJMackenzie <gavin.mackenzie@nibsc.org>
Co-authored-by: Maxime U. Garcia <maxime.garcia@scilifelab.se>
* Initial structure
* Working with local singularity image
* Working generateMap.pl script
* Remote not working bioconda
* Working generateMap with biocontainer
* Lint changes
* Updated hmmcopy container version to be consistent
* Fix failing test
* Remove path to perl
* No hardpath to script
* Update main.nf
Moved version outside of process, add support for zipped fasta file
* Revert to not allowing gzip via pipe, as perl script can't cope
Co-authored-by: Simon Pearce <simon.pearce@cruk.manchester.ac.uk>
* initial commit to setup branch
* workflow finished
* Update nextflow.config
* tumour to tumor, getpileup passed as nomral and tumor
* paired_somatic renamed to tumor_normal_somatic
* Apply suggestions from code review
Co-authored-by: Maxime U. Garcia <maxime.garcia@scilifelab.se>
* Update subworkflows/nf-core/gatk_tumor_normal_somatic_variant_calling/main.nf
Co-authored-by: Maxime U. Garcia <maxime.garcia@scilifelab.se>
* updated index names in meta.yml
* changed index file names in main script and test
* Apply suggestions from code review
Co-authored-by: Maxime U. Garcia <maxime.garcia@scilifelab.se>
* Apply suggestions from code review
* fixed bug from changes
* Apply suggestions from code review
* modified yml to allow new subworkflow testing
* Update test.yml
* Update test.yml
* added output channel for tbi files, tweaked method of adding blank inputs for gendb tests
* Update main.nf
* Update main.nf
Co-authored-by: GCJMackenzie <gavin.mackenzie@nibsc.org>
Co-authored-by: Maxime U. Garcia <maxime.garcia@scilifelab.se>
* feat: each output type has dedicated channel replace bgzip with gzip can only zip one at a time
* Add condition moving of unbinned files
* fix: solution for moving sometimes non-existant files
* fix: update meta.yml to add the new channels
* fix: remove most of the checksums due to variability
* fix: tweaking of output
* Update modules/metabat2/metabat2/main.nf
Co-authored-by: Maxime Borry <maxibor@users.noreply.github.com>
* Fix find commands
* Fix find commands
Co-authored-by: Maxime Borry <maxibor@users.noreply.github.com>
* feat: view is now in args2 so we can use sort
* forgot one split_cpus
* feat: update with new logic
* fix: add more info
* fix: remove split_cpus logic
* Add comment line for consistency
* Remove all functions.nf
* Remove include functions.nf and publishDir options
* Replace options.args3 with task.ext.args3 - 3 modules
* Replace options.args3 with task.ext.args3 - 17 modules
* Replace {task.cpus} with task.cpus
* Replace off on off off off off off off off on off on off on off off off on off off off on on off off off on on off off off off off off off on off off off off on off on on off off off on on on on off off off on off on on off on on off off on on on off on on off on off off off off on off off off on off off on off on off off off on on off on off on off off on off off off on off off off on off off off off on off off off on on on off on on off off on off on on on off on on off on on on off off off off off on on off off on off off off off off on off off on on off on on off on off off off on off off off off on on off on off off on off off on off on off off off off off off off off on on off on off off off.args with
* Add def args = task.ext.args line to all modules in script section
* Replace options.args with args and args_list
* Initialise args2 and args3 properly
* Replace container syntax
* Revert container changes for cellranger/mkref
* Replace getProcessName in all modules
* Replace getSoftwareName in all modules
* Unify modules using VERSION variable
* Replae options.suffix with task.ext.suffix
* Remove NF version restriction for CI
* Bump NF version in README
* Replace task.process.tokenize logic with task.process
* Minor tweaks to unify syntax in tests main.nf
* Add a separate nextflow.config for each module
* Transfer remaining module options to nextflow.config
* Remove addParams from tests main.nf
* Remove TODO statements
* Use -c to import module specific config
* Bump NF version to 21.10.3
* Fix tests for artic/minion
* Fix broken publishDir syntax
* Standardise and fix obvious failing module tests
* Remove kronatools to krona
* Comment out tags in subworkflow test.yml
* Fix failing module tests
* Add consistent indentation to nextflow.config
* Comment out subworklow definitions
* Fix kallistobustools/ref
* Fix rmarkdownnotebook
* Fix jupyternotebook
* Quote task.process
* Add plink2/vcf to pytest_modules.yml
* Remove NF_CORE_MODULES_TEST from pytest CI
* Fix more tests
* Move bacteroides_fragilis to prokaryotes folder
* Fix cooler merge tests
* Fix kallistobustools/count tests
* Fix kallistobustools/ref tests
* Update test_10x_1_fastq_gz file for kallistobustools/count tests
* Fix bcftools/query tests
* Fix delly/call tests
* Fix cooler/zoomify tests
* Fix csvtk/split tests
* Fix gatk4/intervallisttools tests
* Fix gatk4/variantfiltration
* Fix pydamage/filter tests
* Fix test data for unicycler
* Fix gstama/collapse module
* Fix leehom tests
* Fix metaphlan3 tests
* Fix pairtools/select tests
* Update nextflow.config
* Update nextflow.config
* feat: update syntax
* Fix arriba tests
* Fix more failing tests
* Update test syntax
* Remove comments from tests nextflow.config
* Apply suggestions from code review
* Fix kallistobustools/count module
* Update dumpsoftwareversions module
* Update custom/dumpsoftwareversions
* Add args2 to untar module
* Update leftover modules
* Remove last remaining addParams
* Change syntax from task.ext.suffix to tast.ext.prefix
* Change nextflow.config in all tests to use ext.prefix instead of ext.suffix
Co-authored-by: JoseEspinosa <kadomu@gmail.com>
Co-authored-by: Gregor Sturm <mail@gregor-sturm.de>
Co-authored-by: MaxUlysse <max.u.garcia@gmail.com>
