* fix: remove left-over unnecessary code
* Add prinseq++
* Remove last todo
* Fix tests due to variability of output FASTQs (reads can be ordered differently between runs)
* Apply suggestions from code review
* callcnvs stub and tests
* partition stub and test
* histogram stub and test
* importreaddepth stub and tests
* update module scripts
Co-authored-by: Sima Rahimi <sima.rahimi@gu.se>
* add pydamage module
* remove TODOs
* split module by subcommands
* update version parsing
* remove forgotten TODOs
* update module names
* remove old holistic module
* Update modules/pydamage/analyze/main.nf
Co-authored-by: James A. Fellows Yates <jfy133@gmail.com>
* add keywords
* update resource requirement
* Update modules/pydamage/filter/main.nf
Co-authored-by: James A. Fellows Yates <jfy133@gmail.com>
* Update modules/pydamage/filter/meta.yml
Co-authored-by: James A. Fellows Yates <jfy133@gmail.com>
* merge from upstream
* update pydamage from upstream
* add freebayes
* update pydamage test from upstream
* fix meta.yml
* update functions.nf
* update test.yml
* update version parsing
* update version parsing
* fix indentation
* Update modules/freebayes/main.nf
Co-authored-by: James A. Fellows Yates <jfy133@gmail.com>
* Update modules/freebayes/main.nf
Co-authored-by: James A. Fellows Yates <jfy133@gmail.com>
* Update modules/freebayes/main.nf
Co-authored-by: James A. Fellows Yates <jfy133@gmail.com>
* add optional inputs
* Update modules/freebayes/main.nf
Co-authored-by: James A. Fellows Yates <jfy133@gmail.com>
* add bed test
* add metabat2 module
* only freebayes
* remove metabat2
* update md5sum because of vcf including date of the day
* add keyword
* rescue conflicted files
* attempt to fix ECLint
* add pytest workflow for metabat
* remove -
* Update modules/metabat2/jgisummarizebamcontigdepths/meta.yml
Co-authored-by: James A. Fellows Yates <jfy133@gmail.com>
* Update modules/metabat2/metabat2/meta.yml
Co-authored-by: James A. Fellows Yates <jfy133@gmail.com>
* Update modules/metabat2/metabat2/meta.yml
Co-authored-by: James A. Fellows Yates <jfy133@gmail.com>
* Update modules/metabat2/jgisummarizebamcontigdepths/meta.yml
Co-authored-by: James A. Fellows Yates <jfy133@gmail.com>
* add optional inputs/outpus
* remove trailing whitespace
* compressing and removing not reproducible md5sums
* follow symlinks while decompressing
* Update tests/modules/metabat2/metabat2/main.nf
Co-authored-by: James A. Fellows Yates <jfy133@gmail.com>
* Update tests/modules/metabat2/metabat2/main.nf
Co-authored-by: James A. Fellows Yates <jfy133@gmail.com>
* split tests
* export env variable
* Update modules/metabat2/jgisummarizebamcontigdepths/main.nf
Co-authored-by: James A. Fellows Yates <jfy133@gmail.com>
* Update modules/metabat2/jgisummarizebamcontigdepths/meta.yml
Co-authored-by: James A. Fellows Yates <jfy133@gmail.com>
* Update modules/metabat2/metabat2/main.nf
Co-authored-by: James A. Fellows Yates <jfy133@gmail.com>
* Update modules/metabat2/metabat2/meta.yml
Co-authored-by: James A. Fellows Yates <jfy133@gmail.com>
* answer PR comments and switch to bgzip
* add bacillus fragilis alignments
* add meta to samtools/faidx
* move to bgzip
* update freebayes test results
* bump pydamage version to 0.70
Co-authored-by: James A. Fellows Yates <jfy133@gmail.com>
Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>
Co-authored-by: Gregor Sturm <mail@gregor-sturm.de>
Co-authored-by: Sateesh Peri <33637490+sateeshperi@users.noreply.github.com>
* fix(homer): Update tagdir to have a prefix
Otherwise they have a naming collision
* test(homer): Update paths
* style(homer): Align ,'s
* chore(homer): Update md5sums
* controlfreec significance
* move freec files to own subfolder
* Fix meta.yml naming
* Fix meta.yml naming
* Fix linting
* Forgot to refactor
* forgot more refactoring
* Too much refactoring on output paths
* Too little refactoring here
* update checksum
* Use meta map and supply output file name via modules.config
* Remove all def declarations to make it work
* update tests & remove extra .
* fix ze tests
* update meta.yml with meta map info
* add tag line now that meta is available
* Mpileup also likes intervals
* Also update meta yml with inclusive input and intervals
Co-authored-by: Sateesh Peri <33637490+sateeshperi@users.noreply.github.com>
Co-authored-by: Maxime U. Garcia <max.u.garcia@gmail.com>
* fix(homer): Update expected file path to improve caching
* docs(homer): Update findpeaks
* test(homer): Add maketagdirectory dependency
Co-authored-by: Robert A. Petit III <robbie.petit@gmail.com>
* feat(bbmap): Initialize pileup module
* test(bbmap): Update outputs
* test(bbmap): Add pileup tags
* style(bbmap): Add in when
Co-authored-by: Robert A. Petit III <robbie.petit@gmail.com>
* feat: add template for Bracken
* chore: update version
* refactor: change command build
* refactor: rename report variable, change quotes
* docs: remove refactored input parameter
* fix: correctly assign arguments to options
* tests: set up single and paired end tests
* style: apply prettier
* chore: change data sources to official ones
* refactor: rename test workflows
* tests: use correct input to the new UNTAR module
* chore: update md5sums
* fix: remove left-over unnecessary code
* Adds support for meta lists for unzip and untar
* Fix test inputs
* Update all modules to support extraction of decompressed file from untar/unzip new meta + file tuple
* Update all modules to support extraction of decompressed file from untar/unzip new meta + file tuple
* Fix MALTEXTRACT/AMPS
* Fix further modules
* Fix cellranger
* Apply suggestions from code review
Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>
* fix: remove left-over unnecessary code
* Switch to more portable solution for singularity container issue by using bind paths
* Fix input collision of dummy files
* Repalce dummy with which bash
* Remove dummy usage from tests
* Apply suggestions from code review
* Fix singularity typo
* style: Add prettier config files
* build: Add prettier vscode extension
* ci: Replace markdownlint and yamllint with prettier
* style: Run prettier
* style: Use indent of 2 for markdown as well
https://github.com/nf-core/tools/pull/1470#issuecomment-1071028358
* style: Fix indent
* style: Let editorconfig take over tab widths
* style: yaml => yml
* ci: Run prettier once
Co-authored-by: Phil Ewels <phil.ewels@scilifelab.se>
Co-authored-by: Phil Ewels <phil.ewels@scilifelab.se>
* fix: remove left-over unnecessary code
* Adds --fakeroot option for singularity usage with DeepARG as workaround for broken conda dependency
* Update modules/deeparg/downloaddata/main.nf
Co-authored-by: Moritz E. Beber <midnighter@posteo.net>
* Update modules/deeparg/predict/main.nf
Co-authored-by: Moritz E. Beber <midnighter@posteo.net>
* Apply suggestions from code review
* Update main.nf
* Update main.nf
* Update main.nf
* Update main.nf
* Go back to original logic
Co-authored-by: Moritz E. Beber <midnighter@posteo.net>
* First commit
* putting correct links for singularity and docker containers (just had to search for bioconda+ascat to find them, and then put them in like the rest of the nf-core tools had it
* adding first try of relevant commands (not working yet, just took their basic pipeline example
* test commit
* remove test
* starting up work with module after 3.0.0 upgrade
* add ascat.prepareHTS statemet
* add location of docker for new mulled alleleCounter+ASCAT container
* first full run with ASCAT on HG00154.mapped.ILLUMINA.bwa.GBR.low_coverage.20101123.bam
* add notes on dropbox download
* use a newer pytest_modules.yml
* add outpit
* trying to align with current Sarek output
* adding in FH comments
* busy clearing up arguments and testing. Still WIP
* first working run, in nextflow, with sarek-like output. Still needs more work on input arguments
* cleaning up before writing up findings
* testing with putting in arguments in args
* draft for solution 3 style for arguments
* one more test added
* adding FH map
* finished testing maps for args
* wrap-up cram/crai test successfully
* updates to address ability to put in ref.fasta argument for cram running
* adding remaining import-HTS commands in as args, and removing the chr21/chr22 only testing to test-nextflow.config
* first test with auto-downloading the s3-data (when not given as an argument)
* removing download-logic for supporting files, documenting in meta.yml, fixing ref_fasta bug
* adding mulled singularity container
* removing tests
* fix left padding lint issue
* lint failure in meta.yml
* more linting errors
* add when argument
* adding stub functionality
* add stub run
* correct md5sum for versions.yml
* more testing with -runstub
* stub code in pure bash - not mixed with R
* reformat version.yml
* get rid of absolute paths in test.yml
* correct wrong md5sum
* adding allelecount conda link
* rename normal_bam to input_bam etc
* let the pipeline dev worry about matching the right loci and allele files
* dont hardcode default genomebuild
* adding download instruction comment
* add doi
* fix conda addition bug
* add args documentation
* test new indent
* new test with meta.yml indentation
* retry with new meta.yml
* retry with new meta.yml - now with empty lines around
* retry with new meta.yml - remove trailing whitepsace
* trying to fix found quote character that cannot start any token error
* try with one empty line above triple-quote and no empty line below
* trying with pipe character
* checking if its the ending triple quote
* one more try with meta.yml
* test update bioconda versioning for linting failure
* test update bioconda versioning for linting failure 2
* testing allelecounter version error on conda
Co-authored-by: @lassefolkersen
Co-authored-by: @FriederikeHanssen
* Added cnvpytor/importreaddepth module
* Corrected process name in meta.yml file
* added -chrom argument
* space correction
* Added complementary info
* fixed typo
* md5sum added
* modified the module to work on cram files as well
* Added cnvpytor/histogram module and test files
* Added cnvpytor/partition module and test files
* added cnvpytor/callcnvs module and tests
* modified by new modules
* Added test file and fixed input path in modules
* added when block
* little fixes
* skip tracking test.yml
* removed changes to test if conflicts get resolved
* updated outfile name
* corrected the version.yml content
* create files with nf-core command
* update meta.yml files
* starting to work on index main.nf
* prelim test for index
* index test working; not finding all output files
* index passing tests
* index and align passing tests
* prototyping biscuitblaster and pileup
* update containers
* updates to pileup
* pileup passing tests
* template creation for more biscuit tools
* tests passing on blaster,bsconv,pupsom
* epiread passing tests, but need to update SNP bed file path
* vcf2bed working; change test file
* all biscuit commands passing tests
* biscuitblaster rename
* try to fix permissions
* more permission fixes
* trying a couple more permission changes
* hopefully last permission fixes
* really last permission changes
* few more permissions
* add when blocks
* Remove read group meta
Co-authored-by: James A. Fellows Yates <jfy133@gmail.com>
* remove read group meta
Co-authored-by: James A. Fellows Yates <jfy133@gmail.com>
* changes for first round of review
* update meta.yml with more specific links
* Update modules/biscuit/biscuitblaster/main.nf
Co-authored-by: Sateesh Peri <33637490+sateeshperi@users.noreply.github.com>
* Apply new version reporting
Co-authored-by: Sateesh Peri <33637490+sateeshperi@users.noreply.github.com>
* Update modules/biscuit/pileup/main.nf
Co-authored-by: Sateesh Peri <33637490+sateeshperi@users.noreply.github.com>
* Update main.nf
* Update modules/biscuit/pileupsomatic/main.nf
Co-authored-by: Sateesh Peri <33637490+sateeshperi@users.noreply.github.com>
* update test file path
* Update modules/biscuit/align/main.nf
Co-authored-by: Sateesh Peri <33637490+sateeshperi@users.noreply.github.com>
* Update modules/biscuit/align/main.nf
Co-authored-by: Sateesh Peri <33637490+sateeshperi@users.noreply.github.com>
* tests passing again
* Update modules/biscuit/align/main.nf
* Update modules/biscuit/bsconv/main.nf
* Update modules/biscuit/epiread/main.nf
* Update modules/biscuit/index/main.nf
* Update test.yml
* Update modules/biscuit/pileupsomatic/main.nf
* remove module-specific extension/prefix
* remove module-specific extension/prefix
* add missing args
* switch pileup strategy
* update test.yml
* remove debug
* whitespace cleanup
* add in newline escapes
* requested changes
* Update modules/biscuit/pileup/meta.yml
Co-authored-by: Spix <nathan.spix@submit.cm.cluster>
Co-authored-by: James A. Fellows Yates <jfy133@gmail.com>
Co-authored-by: Sateesh Peri <33637490+sateeshperi@users.noreply.github.com>
Co-authored-by: Spix <nathan.spix@node107.cm.cluster>
Co-authored-by: njspix <nathan.spix@vai.org>
* fix: remove left-over unnecessary code
* Partial fix for AR module output declarations
* Remove `def` for prefix so useable in output block
* Fix tests
* Add adapterlist support
* Fix tests after addition of adapter list
NGSCheckMate ncm mode, working on bam files and vcf files to check that (human) samples match as expected
Co-authored-by: Simon Pearce <simon.pearce@cruk.manchester.ac.uk>
Co-authored-by: Mahesh Binzer-Panchal <mahesh.binzer-panchal@nbis.se>
* Bump chromap version 0.2.0
* Temporary use the docker container until singularity container becomes available
* Temporary use the docker container until singularity container available
* Remove empty lines
* Update singularity container after became available
* added module seqkit replace
* added when
* removed extra line
* Update modules/seqkit/replace/main.nf
Co-authored-by: Robert A. Petit III <robbie.petit@gmail.com>
* Updated meta
* updated indents
Co-authored-by: Cipriano <rrn8@cdc.gov>
Co-authored-by: Sateesh Peri <33637490+sateeshperi@users.noreply.github.com>
Co-authored-by: Robert A. Petit III <robbie.petit@gmail.com>
Signed-off-by: Thomas A. Christensen II <25492070+MillironX@users.noreply.github.com>
Co-authored-by: Sateesh Peri <33637490+sateeshperi@users.noreply.github.com>
* implement plink2/score module
* fix test yml
* fix typo :(
* set cpu
* set mem
* fix input process input block
* fix tests
Co-authored-by: Sateesh <33637490+sateeshperi@users.noreply.github.com>
* fix: remove left-over unnecessary code
* Add hamronizer/deeparg
* Add hamronisation/summarise
* Update test.yml
* Update modules/hamronization/summarize/meta.yml
Co-authored-by: Jasmin F <73216762+jasmezz@users.noreply.github.com>
* line up outputs
Co-authored-by: Robert A. Petit III <robbie.petit@gmail.com>
Co-authored-by: Jasmin F <73216762+jasmezz@users.noreply.github.com>
* update plink2/vcf to output zstandard compressed data automatically
* update meta
* set plink CPU and memory usage
Co-authored-by: Sateesh <33637490+sateeshperi@users.noreply.github.com>
* add drafty controlfreec
* get sofatware version
* use maps in map
* update paths to new and soon-to-be merged test files, add more input docu
* Stab at documenting args map
* Update syntax
* Bit more description
* Make the linter happy
* tests pass locally
* Add outputs & docu
* tests are failing locally now :/ but cpn file can also be added
* All tests passing, need to update test data again to add folder
* Clean up files
* Clean up files
* Clean up files
* Don't know how to get the test to run with the direcotry for now. they pass locally though
* Make linter happy
* Name process back
* Update to use tar folder
* fix the checksum
* bcf annotate ready2go
* edited output name
* fixed output
* updated bcftools ver
* changed contain output string
* removed contain key entirely
* fixed md5sum for test.yml
* using match instead of find
* bcftools/annotate refactored with complete test
* rm trailing white space
Co-authored-by: Robert A. Petit III <robbie.petit@gmail.com>
Signed-off-by: Thomas A. Christensen II <25492070+MillironX@users.noreply.github.com>
Co-authored-by: Sateesh <33637490+sateeshperi@users.noreply.github.com>
Co-authored-by: Robert A. Petit III <robbie.petit@gmail.com>
* Initial commit of seqtk/seq module files
* pytest.yml
* updated module and tests code, need to finish modules/main.nf
* Initial commit of seqtk/seq module files
* pytest.yml
* updated module and tests code, need to finish modules/main.nf
* Adding code and configs for seqtk/seq module
* Re-tested module following minor code update
* removed trailing whitespace errors
* Changed variable name to following reviewer suggestions
Co-authored-by: Sateesh <33637490+sateeshperi@users.noreply.github.com>
* add gatk4/combinegvcfs module
* update gatk4/combinegvcfs
* loop to create a string adding -V to each vcf file
* add contains for variable md5
* rm whitespace
* meta in output
* fix indentations
* fix indentations
* move tmpdir to args and update conda version
Co-authored-by: Peri <rrx8@cdc.gov>
Co-authored-by: Maxime U. Garcia <max.u.garcia@gmail.com>
* add picard-addorreplacereadgroups
* add picard_addorreplacereadgroups
* add new line to main.nf
* remove trailing whitespaces
* remove trailing whitespaces
* change to output in test yml
* add when directive
* picard 2.26.10 -> 2.26.9
* picard 2.26.10 -> 2.26.9 test yml
Co-authored-by: Peri <rrx8@cdc.gov>
Co-authored-by: Robert A. Petit III <robbie.petit@gmail.com>
* add picard-cleansam
* add picard/cleansam
* update test yml with output
* picard 2.26.10 -> 2.26.9
* add output to test yml
Co-authored-by: Peri <rrx8@cdc.gov>
Co-authored-by: Robert A. Petit III <robbie.petit@gmail.com>
* add picard/createsequencedictionary module
* add picard-CreateSequenceDictionary
* add picard/createsequencedictionary/
* add contains to test yml
* update test yml contains
* update test yml contains
Co-authored-by: Peri <rrx8@cdc.gov>
Co-authored-by: Robert A. Petit III <robbie.petit@gmail.com>
* add picard-fixmateinformation
* add picard-fixmateinformation
* fix trailing whitespace
* fix trailing whitespace
Co-authored-by: Peri <rrx8@cdc.gov>
Co-authored-by: Robert A. Petit III <robbie.petit@gmail.com>
* Add deeptools bamcoverage
* remove todo string
* Add in when
* fix c&p version format error
* Fix md5sums
Co-authored-by: Maxime U. Garcia <max.u.garcia@gmail.com>
* include intervals_index
In order to run the GATK `GenotypeGVCFs` tool with an interval file (such as a .bed file) you need to have the corresponding index file. Otherwise you get the following error message
```
A USER ERROR has occurred: An index is required but was not found for file genome.bed.gz: work/6c/541fce2dc670597f62a571c72288c6/genome.bed.gz. Support for unindexed block-compressed files has been temporarily disabled. Try running IndexFeatureFile on the input.
```
including the index file fixes this problem
* Update meta.yml
* Added seqtk/rename module and tests code
* Updated files and testing code for seqtk rename
* Added meta map to seqtk/rename module def
* updated prefix parameter usage
* updated test.yml to remove local filepaths --> change to output
* Added empty line to main.nf
* Update versions
* update checksums + remove variables as input for applyvqsr
* sneak in removal of values and provide them via modules.config
* update another checksum
* more checksums
* move vairable to config
* remove controlfreec, wrong branch
* add line break
* First version of the biobambam/bammarkduplicates2 module
* Fixed the path of versions.yml
* Regenerated the checksums as the previous files were generated with a single core
* Added the `when:` block, as per #1261
Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>
Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>
* hmmcopy/mapCounter
* update test
* Remove bam tag
* Remove /tmp/ path from test.yml
* Update modules/hmmcopy/mapcounter/meta.yml
Incorporate formatting changes
Co-authored-by: James A. Fellows Yates <jfy133@gmail.com>
* Update modules/hmmcopy/mapcounter/meta.yml
Co-authored-by: James A. Fellows Yates <jfy133@gmail.com>
* Update tests/modules/hmmcopy/mapcounter/main.nf
Co-authored-by: James A. Fellows Yates <jfy133@gmail.com>
* ichorCNA run
* Add panel of normals code
* Try and fix tests
* Edit string detection in tests
* Fix linting issues
* Just failing END_VERSIONS
* Fixed versions.yml
* Added DOI
* Optional name for file
* Add when command
* Updated when
* Update modules/ichorcna/createpon/main.nf
Co-authored-by: Simon Pearce <simon.pearce@cruk.manchester.ac.uk>
Co-authored-by: James A. Fellows Yates <jfy133@gmail.com>
Co-authored-by: FriederikeHanssen <Friederike.hanssen@qbic.uni-tuebingen.de>
* Match target bed to input files
* Intervals in getpileupsumamries
* more interval updates
* change targets in strelka
* remove leftover channel
* fix checksums
* add new test vcfs
* add new test vcfs
* Update modules/freebayes/main.nf
Co-authored-by: Maxime U. Garcia <maxime.garcia@scilifelab.se>
* Add msisensorpro
* remove absolute paths
* fixing tests
* fix msisensorpro tests
* Update modules/msisensorpro/msi_somatic/main.nf
Co-authored-by: Maxime U. Garcia <maxime.garcia@scilifelab.se>
* Update modules/msisensorpro/msi_somatic/main.nf
Co-authored-by: Maxime U. Garcia <maxime.garcia@scilifelab.se>
* add when back in
* add when back in
* Update modules/msisensorpro/msi_somatic/main.nf
Co-authored-by: Maxime U. Garcia <maxime.garcia@scilifelab.se>
* update description
* Update main.nf
* Update main.nf
* Update main.nf
Co-authored-by: Maxime U. Garcia <maxime.garcia@scilifelab.se>
* add plink2_extract
* fix test yml path
* Update modules/plink2/extract/main.nf
Co-authored-by: James A. Fellows Yates <jfy133@gmail.com>
* Update modules/plink2/extract/main.nf
Co-authored-by: James A. Fellows Yates <jfy133@gmail.com>
* compress output
* add DOI
* make outputs less ambiguous
* update test for compressed output
* brain is dumb
* Update modules/plink2/extract/main.nf
Co-authored-by: James A. Fellows Yates <jfy133@gmail.com>
Co-authored-by: James A. Fellows Yates <jfy133@gmail.com>
* initial commit to setup branch
* workflow finished
* Update nextflow.config
* tumour to tumor, getpileup passed as nomral and tumor
* paired_somatic renamed to tumor_normal_somatic
* Apply suggestions from code review
Co-authored-by: Maxime U. Garcia <maxime.garcia@scilifelab.se>
* Update subworkflows/nf-core/gatk_tumor_normal_somatic_variant_calling/main.nf
Co-authored-by: Maxime U. Garcia <maxime.garcia@scilifelab.se>
* updated index names in meta.yml
* changed index file names in main script and test
* Apply suggestions from code review
Co-authored-by: Maxime U. Garcia <maxime.garcia@scilifelab.se>
* Apply suggestions from code review
* fixed bug from changes
* Apply suggestions from code review
* modified yml to allow new subworkflow testing
* Update test.yml
* Update test.yml
* updated to follow the new mergebam syntax, also made unaligned input sample specific
Co-authored-by: GCJMackenzie <gavin.mackenzie@nibsc.org>
Co-authored-by: Maxime U. Garcia <maxime.garcia@scilifelab.se>
* refactor: add bcl2fastq to cellranger dockerfile
bcl2fastq required for the cellranger mkfastq module and was therefore
added to the cellranger dockerfile. Further, cellranger was updated to
the latest version, 6.1.2., with naming and containers across
cellranger modules updated accordingly.
* chore: add bcl2fastq zip to .gitignore
* style: fix code linting error
* test(cellranger): Add tiles to mkfastq
* additional dockerfile for mkfastq
* update readme and dockerfiles
* update readme
* fix: update container for mkfastq
* docs: correct typos in readme
* test: update md5sum following cellranger update
* test: update md5sum following cellranger update
* fix: new line for external args in mkfastq
* test: update mkfastq tiles argument
* test: comment out mkfastq tests until smaller test data found
* test: stub-run mkfastq test until smaller test data found
* test: fix incorrect file path for mkfastq
Co-authored-by: Edmund Miller <edmund.a.miller@protonmail.com>
Co-authored-by: ggabernet <gisela.gabernet@qbic.uni-tuebingen.de>
Co-authored-by: Gisela Gabernet <gisela.gabernet@gmail.com>
* Bump version 0.1.5 to chromap/chromap
* Bump conda samtools version to 1.14
* Get read of inconsistent md5sum in conda
* Bump version in conda and retry md5 checks
* genome index md5 hash removed, conda failed
* Remove old nextclade module
* Add nextclade/datasetget and nextclade/run modules
* Fix ECLint
* Add reference and tag as inputs to datasetget module
* Fix tests
* Adjust spacing
* Add stubs for deepvariant [ci skip]
* Update the stubs for deepvariant [ci skip]
* functional with google docker image
* cleanup
* consume docker container within singularity executor
* update the meta.yml file and ask for review
* tweak the input channel shape and test data
* tweak input data [ci skip]
* update for the new syntax
* remove the functions and rename meta vars
* Update the arguments mechanism
* update chr, region and checksum
Co-authored-by: Gregor Sturm <mail@gregor-sturm.de>
Co-authored-by: Maxime U. Garcia <max.u.garcia@gmail.com>
Co-authored-by: FriederikeHanssen <Friederike.hanssen@qbic.uni-tuebingen.de>
* Update dsh-bio to version 2.0.7, add support for compressed GFA 1.0 format
* fix ci failures
Co-authored-by: Chris Cheshire <chris.j.cheshire@gmail.com>
* Add functionality to handle vbz compression
In order for nanopolish to be able handle the default compression for Mk1C Minions (vbz) it must be aware of where to find the plugin. Exporting the HDF5_PLUGIN_PATH found in the conda install (also used to make the biocontainer image) is the solution
* Make the HDF5_PLUGIN_PATH more configurable
Allow the HDF5_PLUGIN_PATH to be changed via a section in a config file e.g
```
params {
modules {
.....
'nanopore_artic_minion' {
.....
hd5_plugin_path = '/usr/local/lib/python3.6/site-packages/ont_fast5_api/vbz_plugin'
}
......
}
}
```
* Update modules/artic/minion/main.nf
* Export HDF5_PLUGIN_PATH
The HDF5_PLUGIN_PATH variable should be exported for `artic minion` to use it
Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>
* Add functionality to handle vbz compression
In order for nanopolish to be able handle the default compression for Mk1C Minions (vbz) it must be aware of where to find the plugin. Exporting the HDF5_PLUGIN_PATH found in the conda install (also used to make the biocontainer image) is the solution
* Make the HDF5_PLUGIN_PATH more configurable
Allow the HDF5_PLUGIN_PATH to be changed via a section in a config file e.g
```
params {
modules {
.....
'nanopore_artic_minion' {
.....
hd5_plugin_path = '/usr/local/lib/python3.6/site-packages/ont_fast5_api/vbz_plugin'
}
......
}
}
```
* Update modules/artic/minion/main.nf
Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>
* Bump software versions for viralrecon modules
* Remove custom params.save_unaligned from bowtie2_align
* Unify samtools modules and error if input and output names are the same
* Fix ALL the tests
* Removed if-statement to only run on more than 1 file, now it will run on single files as well.
* Added a test for running the cat_cat module on a single file.
* Created a new test.yml with nf-core modules create-test-yml -t cat/cat
* Edited test.yml to not include paths and md5sums for versions.yml, and also removed sometimes variable md5sums
* Added files for bcftools/sort
* Fixed output format and removed md5 checksum
* Change input to avoid identical in/output names
* Created rows for bcftools/sort in pytest_modules.yml
* Change intervals to be part of sample specific input
* Fix some tests
* Update checksum
* Update intervals
* Update intervals
* Try out gavins idea for adding the file
* update test line
* update test line
* update test line
* revert contains line
* hmmcopy/mapCounter
* update test
* Remove bam tag
* Remove /tmp/ path from test.yml
* Update modules/hmmcopy/mapcounter/meta.yml
Incorporate formatting changes
Co-authored-by: James A. Fellows Yates <jfy133@gmail.com>
* Update modules/hmmcopy/mapcounter/meta.yml
Co-authored-by: James A. Fellows Yates <jfy133@gmail.com>
* Update tests/modules/hmmcopy/mapcounter/main.nf
Co-authored-by: James A. Fellows Yates <jfy133@gmail.com>
Co-authored-by: Simon Pearce <simon.pearce@cruk.manchester.ac.uk>
Co-authored-by: James A. Fellows Yates <jfy133@gmail.com>
* added new module snpsift/split
* added options.args
* added .vcf.gz to input
* removed test and updated to new NF DSL2 syntax
* Updated to new NF DSL2 syntax
* added option to join vcf files
Co-authored-by: Robert A. Petit III <robbie.petit@gmail.com>
Co-authored-by: FriederikeHanssen <Friederike.hanssen@qbic.uni-tuebingen.de>
* committing to pull updated nf-core files
* saving changes to checout other branch
* committing progress so far, difficulty with test data
* uploading to be used as draft PR
* fix linting error in meta.yml
* attempt to group reference inputs together
* updated input format for resources
* meta.yml updated with new resource names
* added output channel for recal index
* module only takes single vcf file input now
* committing to checkout
* update to new syntax, remove indel test for now
* updated to use memory options and new test data
* Update modules/gatk4/variantrecalibrator/main.nf
Co-authored-by: FriederikeHanssen <Friederike.hanssen@qbic.uni-tuebingen.de>
* Update main.nf
* Update modules/gatk4/variantrecalibrator/main.nf
Co-authored-by: FriederikeHanssen <Friederike.hanssen@qbic.uni-tuebingen.de>
* remove duplicate test keys from test_data.config
Co-authored-by: GCJMackenzie <gavin.mackenzie@nibsc.org>
Co-authored-by: FriederikeHanssen <Friederike.hanssen@qbic.uni-tuebingen.de>
* initial commit to setup branch
* workflow finished
* Update nextflow.config
* tumour to tumor, getpileup passed as nomral and tumor
* paired_somatic renamed to tumor_normal_somatic
* Apply suggestions from code review
Co-authored-by: Maxime U. Garcia <maxime.garcia@scilifelab.se>
* Update subworkflows/nf-core/gatk_tumor_normal_somatic_variant_calling/main.nf
Co-authored-by: Maxime U. Garcia <maxime.garcia@scilifelab.se>
* updated index names in meta.yml
* changed index file names in main script and test
* Apply suggestions from code review
Co-authored-by: Maxime U. Garcia <maxime.garcia@scilifelab.se>
* Apply suggestions from code review
* fixed bug from changes
* Apply suggestions from code review
* modified yml to allow new subworkflow testing
* Update test.yml
* Update test.yml
* add applyvqsr
* added memory options, new test data used
* Update main.nf
* Update main.nf
Co-authored-by: GCJMackenzie <gavin.mackenzie@nibsc.org>
Co-authored-by: Maxime U. Garcia <maxime.garcia@scilifelab.se>
* Initial structure
* Working with local singularity image
* Working generateMap.pl script
* Remote not working bioconda
* Working generateMap with biocontainer
* Lint changes
* Updated hmmcopy container version to be consistent
* Fix failing test
* Remove path to perl
* No hardpath to script
* Update main.nf
Moved version outside of process, add support for zipped fasta file
* Revert to not allowing gzip via pipe, as perl script can't cope
Co-authored-by: Simon Pearce <simon.pearce@cruk.manchester.ac.uk>
* initial commit to setup branch
* workflow finished
* Update nextflow.config
* tumour to tumor, getpileup passed as nomral and tumor
* paired_somatic renamed to tumor_normal_somatic
* Apply suggestions from code review
Co-authored-by: Maxime U. Garcia <maxime.garcia@scilifelab.se>
* Update subworkflows/nf-core/gatk_tumor_normal_somatic_variant_calling/main.nf
Co-authored-by: Maxime U. Garcia <maxime.garcia@scilifelab.se>
* updated index names in meta.yml
* changed index file names in main script and test
* Apply suggestions from code review
Co-authored-by: Maxime U. Garcia <maxime.garcia@scilifelab.se>
* Apply suggestions from code review
* fixed bug from changes
* Apply suggestions from code review
* modified yml to allow new subworkflow testing
* Update test.yml
* Update test.yml
* added output channel for tbi files, tweaked method of adding blank inputs for gendb tests
* Update main.nf
* Update main.nf
Co-authored-by: GCJMackenzie <gavin.mackenzie@nibsc.org>
Co-authored-by: Maxime U. Garcia <maxime.garcia@scilifelab.se>
* feat: each output type has dedicated channel replace bgzip with gzip can only zip one at a time
* Add condition moving of unbinned files
* fix: solution for moving sometimes non-existant files
* fix: update meta.yml to add the new channels
* fix: remove most of the checksums due to variability
* fix: tweaking of output
* Update modules/metabat2/metabat2/main.nf
Co-authored-by: Maxime Borry <maxibor@users.noreply.github.com>
* Fix find commands
* Fix find commands
Co-authored-by: Maxime Borry <maxibor@users.noreply.github.com>
* feat: view is now in args2 so we can use sort
* forgot one split_cpus
* feat: update with new logic
* fix: add more info
* fix: remove split_cpus logic
* Add comment line for consistency
* Remove all functions.nf
* Remove include functions.nf and publishDir options
* Replace options.args3 with task.ext.args3 - 3 modules
* Replace options.args3 with task.ext.args3 - 17 modules
* Replace {task.cpus} with task.cpus
* Replace off on off off off off off off off on off on off on off off off on off off off on on off off off on on off off off off off off off on off off off off on off on on off off off on on on on off off off on off on on off on on off off on on on off on on off on off off off off on off off off on off off on off on off off off on on off on off on off off on off off off on off off off on off off off off on off off off on on on off on on off off on off on on on off on on off on on on off off off off off on on off off on off off off off off on off off on on off on on off on off off off on off off off off on on off on off off on off off on off on off off off off off off off off on on off on off off off.args with
* Add def args = task.ext.args line to all modules in script section
* Replace options.args with args and args_list
* Initialise args2 and args3 properly
* Replace container syntax
* Revert container changes for cellranger/mkref
* Replace getProcessName in all modules
* Replace getSoftwareName in all modules
* Unify modules using VERSION variable
* Replae options.suffix with task.ext.suffix
* Remove NF version restriction for CI
* Bump NF version in README
* Replace task.process.tokenize logic with task.process
* Minor tweaks to unify syntax in tests main.nf
* Add a separate nextflow.config for each module
* Transfer remaining module options to nextflow.config
* Remove addParams from tests main.nf
* Remove TODO statements
* Use -c to import module specific config
* Bump NF version to 21.10.3
* Fix tests for artic/minion
* Fix broken publishDir syntax
* Standardise and fix obvious failing module tests
* Remove kronatools to krona
* Comment out tags in subworkflow test.yml
* Fix failing module tests
* Add consistent indentation to nextflow.config
* Comment out subworklow definitions
* Fix kallistobustools/ref
* Fix rmarkdownnotebook
* Fix jupyternotebook
* Quote task.process
* Add plink2/vcf to pytest_modules.yml
* Remove NF_CORE_MODULES_TEST from pytest CI
* Fix more tests
* Move bacteroides_fragilis to prokaryotes folder
* Fix cooler merge tests
* Fix kallistobustools/count tests
* Fix kallistobustools/ref tests
* Update test_10x_1_fastq_gz file for kallistobustools/count tests
* Fix bcftools/query tests
* Fix delly/call tests
* Fix cooler/zoomify tests
* Fix csvtk/split tests
* Fix gatk4/intervallisttools tests
* Fix gatk4/variantfiltration
* Fix pydamage/filter tests
* Fix test data for unicycler
* Fix gstama/collapse module
* Fix leehom tests
* Fix metaphlan3 tests
* Fix pairtools/select tests
* Update nextflow.config
* Update nextflow.config
* feat: update syntax
* Fix arriba tests
* Fix more failing tests
* Update test syntax
* Remove comments from tests nextflow.config
* Apply suggestions from code review
* Fix kallistobustools/count module
* Update dumpsoftwareversions module
* Update custom/dumpsoftwareversions
* Add args2 to untar module
* Update leftover modules
* Remove last remaining addParams
* Change syntax from task.ext.suffix to tast.ext.prefix
* Change nextflow.config in all tests to use ext.prefix instead of ext.suffix
Co-authored-by: JoseEspinosa <kadomu@gmail.com>
Co-authored-by: Gregor Sturm <mail@gregor-sturm.de>
Co-authored-by: MaxUlysse <max.u.garcia@gmail.com>
* Add comment line for consistency
* Remove all functions.nf
* Remove include functions.nf and publishDir options
* Replace options.args3 with task.ext.args3 - 3 modules
* Replace options.args3 with task.ext.args3 - 17 modules
* Replace {task.cpus} with task.cpus
* Replace off on off off off off off off off on off on off on off off off on off off off on on off off off on on off off off off off off off on off off off off on off on on off off off on on on on off off off on off on on off on on off off on on on off on on off on off off off off on off off off on off off on off on off off off on on off on off on off off on off off off on off off off on off off off off on off off off on on on off on on off off on off on on on off on on off on on on off off off off off on on off off on off off off off off on off off on on off on on off on off off off on off off off off on on off on off off on off off on off on off off off off off off off off on on off on off off off.args with
* Add def args = task.ext.args line to all modules in script section
* Replace options.args with args and args_list
* Initialise args2 and args3 properly
* Replace container syntax
* Revert container changes for cellranger/mkref
* Replace getProcessName in all modules
* Replace getSoftwareName in all modules
* Unify modules using VERSION variable
* Replae options.suffix with task.ext.suffix
* Remove NF version restriction for CI
* Bump NF version in README
* Replace task.process.tokenize logic with task.process
* Minor tweaks to unify syntax in tests main.nf
* Add a separate nextflow.config for each module
* Transfer remaining module options to nextflow.config
* Remove addParams from tests main.nf
* Remove TODO statements
* Use -c to import module specific config
* Bump NF version to 21.10.3
* Fix tests for artic/minion
* Fix broken publishDir syntax
* Standardise and fix obvious failing module tests
* Remove kronatools to krona
* Comment out tags in subworkflow test.yml
* Fix failing module tests
* Add consistent indentation to nextflow.config
* Comment out subworklow definitions
* Fix kallistobustools/ref
* Fix rmarkdownnotebook
* Fix jupyternotebook
* Quote task.process
* Add plink2/vcf to pytest_modules.yml
* Remove NF_CORE_MODULES_TEST from pytest CI
* Fix more tests
* Move bacteroides_fragilis to prokaryotes folder
* Fix cooler merge tests
* Fix kallistobustools/count tests
* Fix kallistobustools/ref tests
* Update test_10x_1_fastq_gz file for kallistobustools/count tests
* Fix bcftools/query tests
* Fix delly/call tests
* Fix cooler/zoomify tests
* Fix csvtk/split tests
* Fix gatk4/intervallisttools tests
* Fix gatk4/variantfiltration
* Fix pydamage/filter tests
* Fix test data for unicycler
* Fix gstama/collapse module
* Fix leehom tests
* Fix metaphlan3 tests
* Fix pairtools/select tests
* Update nextflow.config
* Update nextflow.config
* feat: update syntax
* Fix arriba tests
* Fix more failing tests
* Update test syntax
* Remove comments from tests nextflow.config
* Apply suggestions from code review
* Fix kallistobustools/count module
* Update dumpsoftwareversions module
* Update custom/dumpsoftwareversions
* Add args2 to untar module
* Update leftover modules
* Remove last remaining addParams
Co-authored-by: JoseEspinosa <kadomu@gmail.com>
Co-authored-by: Gregor Sturm <mail@gregor-sturm.de>
Co-authored-by: MaxUlysse <max.u.garcia@gmail.com>
* Make targets.bed optional when running in wgs mode
* added test for cram
* Update test_data_config with new reference.cnn
* Update main.nf to allow tumor-only running
Still need a unit-test for this. Almost ready, but needs this file as input https://github.com/nf-core/test-datasets/blob/modules/data/generic/cnn/reference.cnn
* re-writing previous changes, but now it wont crash the entire CI-setup
* fixing overlooked merge conflict
* last overlooked merge-conflict
* move all files to batch subfolder
* adding an optional input for a reference file (needed when running germline and tumoronly)
* minor typo
* update meta.yml
* aligning code, renaming cnvkit to cnvkit_batch, renaming tumorbam to tumor, normalbam to normal
* Update pytest_modules.yml
Co-authored-by: EC2 Default User <ec2-user@ip-172-31-21-198.us-west-2.compute.internal>
Co-authored-by: Lasse Folkersen <lassefolkersen@gmail.com>
Co-authored-by: Robert A. Petit III <robbie.petit@gmail.com>
Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>
* Fix picard/markduplicates with new options syntax
* Delete md5sum for bam files and add contains for metrics.txt
Co-authored-by: Robert A. Petit III <robbie.petit@gmail.com>
Co-authored-by: FriederikeHanssen <Friederike.hanssen@qbic.uni-tuebingen.de>
* Added vcf_index to vcf tuple; output to vcf.gz format.
* Fix: extra new line in meta.yml.
* addressed review feedback
* fix: editorconfig error
* fix: gatk memory flag
* fix: editorconfig error
* fix: Indentation
fix: Indentation
* Fix: lint editorconfig error
Removed one extra space
Co-authored-by: Robert A. Petit III <robbie.petit@gmail.com>
* fasta_fai_dict tuple is now split into separate input channels
* fix: lint errors
* fix: pytest errors
* Update modules/gatk4/splitncigarreads/meta.yml
* Update modules/gatk4/splitncigarreads/main.nf
Co-authored-by: Maxime U. Garcia <maxime.garcia@scilifelab.se>
* add new nucmer module
* Apply suggestions from code review
Co-authored-by: Robert A. Petit III <robbie.petit@gmail.com>
* update tests with file produced by input
* Update main.nf
* Update meta.yml
Co-authored-by: Michael Cipriano <mcipriano@gmail.com>
Co-authored-by: Robert A. Petit III <robbie.petit@gmail.com>
Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>
* created and initialised krona module
* Added kronatools/ktimporttaxonomy module
* removing previous redundant work
* added contains info for html
* edited contains in test.yml
* Update get versions
Co-authored-by: Daniel Straub <42973691+d4straub@users.noreply.github.com>
* remove old syntax
Co-authored-by: Daniel Straub <42973691+d4straub@users.noreply.github.com>
* rewording module description
Co-authored-by: Daniel Straub <42973691+d4straub@users.noreply.github.com>
* added detailed keywords
Co-authored-by: Daniel Straub <42973691+d4straub@users.noreply.github.com>
* update syntax and tool version
* fixed meta.yml issues
* remove contains line from test.yml
* re-wrote module after nf-core/tools update - should work now
* removed md5
* Update modules/kronatools/ktimporttaxonomy/main.nf
Co-authored-by: Daniel Straub <42973691+d4straub@users.noreply.github.com>
* update meta save
* removed typo
* double quotes to single quotes around html
* re-ran test, which updated md5
* removed md5
* 'classifier' removed to fix linting
* update version
* removed erroneous ktimporttaxonomy2
* Updated input to include meta and database
* fixed tab issues in yaml
* added `contains` to test.yml
* edited `contains` in test.yml
* trying another `contains`
* retrying `contains`
* contains with extra line
* removed classifier from tag
* Apply suggestions from code review
* Update meta.yml
Co-authored-by: Daniel Straub <42973691+d4straub@users.noreply.github.com>
Co-authored-by: Sébastien Guizard <sguizard@ed.ac.uk>
Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>
* Add tests and yml file for macs2/callpeak
* add format option for macs2
* update macs2/callpeak to accept format argument
* update test.yml
* update the container version.
* try to fix the issue in conda container.
* Update conda and containers
* Going back to previous container versions
Co-authored-by: JoseEspinosa <kadomu@gmail.com>
* add software/cooler
* fix the wrong files uploaded.
* create a branch for cooler/zoomify
* Apply suggestions from code review
* update functions.nf to new version.
* update the test file to test-datasets.
* update the test method of zoomify
* update dump test file.
* update version.txt to version.yml
* Update modules/cooler/dump/main.nf
Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>
* fix the output bug of versions update to pytest_modules.yml
* update the test file path and fix the output versions.
* Update modules/cooler/dump/main.nf
* indent
Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>
Co-authored-by: Gregor Sturm <mail@gregor-sturm.de>
Co-authored-by: Sébastien Guizard <sguizard@ed.ac.uk>
Co-authored-by: FriederikeHanssen <Friederike.hanssen@qbic.uni-tuebingen.de>
* New modules added: issues #200 and #310
* Update main.nf
* Update meta.yml
* Update tests/modules/gatk4/genotypegvcfs/main.nf
* Apply suggestions from code review
* Update main.nf
* Updating tests for GenomicsDB input and adding the path for this test resource to test_data.config
* Some minor changes on one of the test files I forgot to include
Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>
Co-authored-by: GCJMackenzie <43276267+GCJMackenzie@users.noreply.github.com>
* add software/cooler
* fix the wrong files uploaded.
* create a branch for cooler/merge
* remove the bin_size from metadata.
* update the test_data to test-datasets
* update pytest_modules.yml
* update the test file from single input file to two input file.
update the output file from hdf5 to bedpe.
* update the version.txt to version.yml and functions.nf
* change version.yml to versions
* update the test file path and fix the output versions.
* Update meta.yml
Correct "version" to "versions"
* Update main.nf
Fix typo
* Update main.nf
Remove some spaces
Co-authored-by: Gregor Sturm <mail@gregor-sturm.de>
Co-authored-by: Sébastien Guizard <sguizard@ed.ac.uk>
* commit but won't be used because pmdtools should have a submodule
* added submodule pmdtools/filter
* removed pmdtools module created before deciding to design two submodules
* oops forgot to remove a TODO
* removed white space meta.yml, removed v in version and manually added submodule /filter to test
* Update pytest_modules.yml
* Update main.nf
added split_cpus for multi-tools module resources
* Update test.yml
added .pmd extension to match modules/ main.nf
* Update test.yml
update md5sum
* Update singularity and docker build in main.nf
From build 4 to 5 in order to match the conda one
* Update modules/pmdtools/filter/main.nf
Co-authored-by: James A. Fellows Yates <jfy133@gmail.com>
* Update modules/pmdtools/filter/main.nf
Co-authored-by: James A. Fellows Yates <jfy133@gmail.com>
* Update modules/pmdtools/filter/main.nf
Co-authored-by: James A. Fellows Yates <jfy133@gmail.com>
* Update modules/pmdtools/filter/meta.yml
Co-authored-by: James A. Fellows Yates <jfy133@gmail.com>
* Update modules/pmdtools/filter/meta.yml
Co-authored-by: James A. Fellows Yates <jfy133@gmail.com>
* Update modules/pmdtools/filter/meta.yml
Co-authored-by: James A. Fellows Yates <jfy133@gmail.com>
* Update modules/pmdtools/filter/meta.yml
Co-authored-by: James A. Fellows Yates <jfy133@gmail.com>
* Update modules/pmdtools/filter/main.nf
Co-authored-by: James A. Fellows Yates <jfy133@gmail.com>
* Update modules/pmdtools/filter/main.nf
Co-authored-by: James A. Fellows Yates <jfy133@gmail.com>
* Update main.nf adding samtools version
we need both pmdtools and samtools versions
* Update main.nf remove .pmd extension
* Update test.yml md5sum
Because file extension changed
Co-authored-by: James A. Fellows Yates <jfy133@gmail.com>
