* fix: remove left-over unnecessary code
* Switch to more portable solution for singularity container issue by using bind paths
* Fix input collision of dummy files
* Repalce dummy with which bash
* Remove dummy usage from tests
* Apply suggestions from code review
* Fix singularity typo
* style: Add prettier config files
* build: Add prettier vscode extension
* ci: Replace markdownlint and yamllint with prettier
* style: Run prettier
* style: Use indent of 2 for markdown as well
https://github.com/nf-core/tools/pull/1470#issuecomment-1071028358
* style: Fix indent
* style: Let editorconfig take over tab widths
* style: yaml => yml
* ci: Run prettier once
Co-authored-by: Phil Ewels <phil.ewels@scilifelab.se>
Co-authored-by: Phil Ewels <phil.ewels@scilifelab.se>
* First commit
* putting correct links for singularity and docker containers (just had to search for bioconda+ascat to find them, and then put them in like the rest of the nf-core tools had it
* adding first try of relevant commands (not working yet, just took their basic pipeline example
* test commit
* remove test
* starting up work with module after 3.0.0 upgrade
* add ascat.prepareHTS statemet
* add location of docker for new mulled alleleCounter+ASCAT container
* first full run with ASCAT on HG00154.mapped.ILLUMINA.bwa.GBR.low_coverage.20101123.bam
* add notes on dropbox download
* use a newer pytest_modules.yml
* add outpit
* trying to align with current Sarek output
* adding in FH comments
* busy clearing up arguments and testing. Still WIP
* first working run, in nextflow, with sarek-like output. Still needs more work on input arguments
* cleaning up before writing up findings
* testing with putting in arguments in args
* draft for solution 3 style for arguments
* one more test added
* adding FH map
* finished testing maps for args
* wrap-up cram/crai test successfully
* updates to address ability to put in ref.fasta argument for cram running
* adding remaining import-HTS commands in as args, and removing the chr21/chr22 only testing to test-nextflow.config
* first test with auto-downloading the s3-data (when not given as an argument)
* removing download-logic for supporting files, documenting in meta.yml, fixing ref_fasta bug
* adding mulled singularity container
* removing tests
* fix left padding lint issue
* lint failure in meta.yml
* more linting errors
* add when argument
* adding stub functionality
* add stub run
* correct md5sum for versions.yml
* more testing with -runstub
* stub code in pure bash - not mixed with R
* reformat version.yml
* get rid of absolute paths in test.yml
* correct wrong md5sum
* adding allelecount conda link
* rename normal_bam to input_bam etc
* let the pipeline dev worry about matching the right loci and allele files
* dont hardcode default genomebuild
* adding download instruction comment
* add doi
* fix conda addition bug
* add args documentation
* test new indent
* new test with meta.yml indentation
* retry with new meta.yml
* retry with new meta.yml - now with empty lines around
* retry with new meta.yml - remove trailing whitepsace
* trying to fix found quote character that cannot start any token error
* try with one empty line above triple-quote and no empty line below
* trying with pipe character
* checking if its the ending triple quote
* one more try with meta.yml
* test update bioconda versioning for linting failure
* test update bioconda versioning for linting failure 2
* testing allelecounter version error on conda
Co-authored-by: @lassefolkersen
Co-authored-by: @FriederikeHanssen
* Added cnvpytor/importreaddepth module
* Corrected process name in meta.yml file
* added -chrom argument
* space correction
* Added complementary info
* fixed typo
* md5sum added
* modified the module to work on cram files as well
* Added cnvpytor/histogram module and test files
* Added cnvpytor/partition module and test files
* added cnvpytor/callcnvs module and tests
* modified by new modules
* Added test file and fixed input path in modules
* added when block
* little fixes
* skip tracking test.yml
* removed changes to test if conflicts get resolved
* updated outfile name
* corrected the version.yml content
* create files with nf-core command
* update meta.yml files
* starting to work on index main.nf
* prelim test for index
* index test working; not finding all output files
* index passing tests
* index and align passing tests
* prototyping biscuitblaster and pileup
* update containers
* updates to pileup
* pileup passing tests
* template creation for more biscuit tools
* tests passing on blaster,bsconv,pupsom
* epiread passing tests, but need to update SNP bed file path
* vcf2bed working; change test file
* all biscuit commands passing tests
* biscuitblaster rename
* try to fix permissions
* more permission fixes
* trying a couple more permission changes
* hopefully last permission fixes
* really last permission changes
* few more permissions
* add when blocks
* Remove read group meta
Co-authored-by: James A. Fellows Yates <jfy133@gmail.com>
* remove read group meta
Co-authored-by: James A. Fellows Yates <jfy133@gmail.com>
* changes for first round of review
* update meta.yml with more specific links
* Update modules/biscuit/biscuitblaster/main.nf
Co-authored-by: Sateesh Peri <33637490+sateeshperi@users.noreply.github.com>
* Apply new version reporting
Co-authored-by: Sateesh Peri <33637490+sateeshperi@users.noreply.github.com>
* Update modules/biscuit/pileup/main.nf
Co-authored-by: Sateesh Peri <33637490+sateeshperi@users.noreply.github.com>
* Update main.nf
* Update modules/biscuit/pileupsomatic/main.nf
Co-authored-by: Sateesh Peri <33637490+sateeshperi@users.noreply.github.com>
* update test file path
* Update modules/biscuit/align/main.nf
Co-authored-by: Sateesh Peri <33637490+sateeshperi@users.noreply.github.com>
* Update modules/biscuit/align/main.nf
Co-authored-by: Sateesh Peri <33637490+sateeshperi@users.noreply.github.com>
* tests passing again
* Update modules/biscuit/align/main.nf
* Update modules/biscuit/bsconv/main.nf
* Update modules/biscuit/epiread/main.nf
* Update modules/biscuit/index/main.nf
* Update test.yml
* Update modules/biscuit/pileupsomatic/main.nf
* remove module-specific extension/prefix
* remove module-specific extension/prefix
* add missing args
* switch pileup strategy
* update test.yml
* remove debug
* whitespace cleanup
* add in newline escapes
* requested changes
* Update modules/biscuit/pileup/meta.yml
Co-authored-by: Spix <nathan.spix@submit.cm.cluster>
Co-authored-by: James A. Fellows Yates <jfy133@gmail.com>
Co-authored-by: Sateesh Peri <33637490+sateeshperi@users.noreply.github.com>
Co-authored-by: Spix <nathan.spix@node107.cm.cluster>
Co-authored-by: njspix <nathan.spix@vai.org>
* fix: remove left-over unnecessary code
* Partial fix for AR module output declarations
* Remove `def` for prefix so useable in output block
* Fix tests
* Add adapterlist support
* Fix tests after addition of adapter list
NGSCheckMate ncm mode, working on bam files and vcf files to check that (human) samples match as expected
Co-authored-by: Simon Pearce <simon.pearce@cruk.manchester.ac.uk>
Co-authored-by: Mahesh Binzer-Panchal <mahesh.binzer-panchal@nbis.se>
* Bump chromap version 0.2.0
* Temporary use the docker container until singularity container becomes available
* Temporary use the docker container until singularity container available
* Remove empty lines
* Update singularity container after became available
* added module seqkit replace
* added when
* removed extra line
* Update modules/seqkit/replace/main.nf
Co-authored-by: Robert A. Petit III <robbie.petit@gmail.com>
* Updated meta
* updated indents
Co-authored-by: Cipriano <rrn8@cdc.gov>
Co-authored-by: Sateesh Peri <33637490+sateeshperi@users.noreply.github.com>
Co-authored-by: Robert A. Petit III <robbie.petit@gmail.com>
Signed-off-by: Thomas A. Christensen II <25492070+MillironX@users.noreply.github.com>
Co-authored-by: Sateesh Peri <33637490+sateeshperi@users.noreply.github.com>
* implement plink2/score module
* fix test yml
* fix typo :(
* set cpu
* set mem
* fix input process input block
* fix tests
Co-authored-by: Sateesh <33637490+sateeshperi@users.noreply.github.com>
* fix: remove left-over unnecessary code
* Add hamronizer/deeparg
* Add hamronisation/summarise
* Update test.yml
* Update modules/hamronization/summarize/meta.yml
Co-authored-by: Jasmin F <73216762+jasmezz@users.noreply.github.com>
* line up outputs
Co-authored-by: Robert A. Petit III <robbie.petit@gmail.com>
Co-authored-by: Jasmin F <73216762+jasmezz@users.noreply.github.com>
* update plink2/vcf to output zstandard compressed data automatically
* update meta
* set plink CPU and memory usage
Co-authored-by: Sateesh <33637490+sateeshperi@users.noreply.github.com>
* add drafty controlfreec
* get sofatware version
* use maps in map
* update paths to new and soon-to-be merged test files, add more input docu
* Stab at documenting args map
* Update syntax
* Bit more description
* Make the linter happy
* tests pass locally
* Add outputs & docu
* tests are failing locally now :/ but cpn file can also be added
* All tests passing, need to update test data again to add folder
* Clean up files
* Clean up files
* Clean up files
* Don't know how to get the test to run with the direcotry for now. they pass locally though
* Make linter happy
* Name process back
* Update to use tar folder
* fix the checksum
* bcf annotate ready2go
* edited output name
* fixed output
* updated bcftools ver
* changed contain output string
* removed contain key entirely
* fixed md5sum for test.yml
* using match instead of find
* bcftools/annotate refactored with complete test
* rm trailing white space
Co-authored-by: Robert A. Petit III <robbie.petit@gmail.com>
Signed-off-by: Thomas A. Christensen II <25492070+MillironX@users.noreply.github.com>
Co-authored-by: Sateesh <33637490+sateeshperi@users.noreply.github.com>
Co-authored-by: Robert A. Petit III <robbie.petit@gmail.com>
* Initial commit of seqtk/seq module files
* pytest.yml
* updated module and tests code, need to finish modules/main.nf
* Initial commit of seqtk/seq module files
* pytest.yml
* updated module and tests code, need to finish modules/main.nf
* Adding code and configs for seqtk/seq module
* Re-tested module following minor code update
* removed trailing whitespace errors
* Changed variable name to following reviewer suggestions
Co-authored-by: Sateesh <33637490+sateeshperi@users.noreply.github.com>
* add gatk4/combinegvcfs module
* update gatk4/combinegvcfs
* loop to create a string adding -V to each vcf file
* add contains for variable md5
* rm whitespace
* meta in output
* fix indentations
* fix indentations
* move tmpdir to args and update conda version
Co-authored-by: Peri <rrx8@cdc.gov>
Co-authored-by: Maxime U. Garcia <max.u.garcia@gmail.com>
* add picard-addorreplacereadgroups
* add picard_addorreplacereadgroups
* add new line to main.nf
* remove trailing whitespaces
* remove trailing whitespaces
* change to output in test yml
* add when directive
* picard 2.26.10 -> 2.26.9
* picard 2.26.10 -> 2.26.9 test yml
Co-authored-by: Peri <rrx8@cdc.gov>
Co-authored-by: Robert A. Petit III <robbie.petit@gmail.com>
* add picard-cleansam
* add picard/cleansam
* update test yml with output
* picard 2.26.10 -> 2.26.9
* add output to test yml
Co-authored-by: Peri <rrx8@cdc.gov>
Co-authored-by: Robert A. Petit III <robbie.petit@gmail.com>
* add picard/createsequencedictionary module
* add picard-CreateSequenceDictionary
* add picard/createsequencedictionary/
* add contains to test yml
* update test yml contains
* update test yml contains
Co-authored-by: Peri <rrx8@cdc.gov>
Co-authored-by: Robert A. Petit III <robbie.petit@gmail.com>
* add picard-fixmateinformation
* add picard-fixmateinformation
* fix trailing whitespace
* fix trailing whitespace
Co-authored-by: Peri <rrx8@cdc.gov>
Co-authored-by: Robert A. Petit III <robbie.petit@gmail.com>
* Add deeptools bamcoverage
* remove todo string
* Add in when
* fix c&p version format error
* Fix md5sums
Co-authored-by: Maxime U. Garcia <max.u.garcia@gmail.com>
* Added seqtk/rename module and tests code
* Updated files and testing code for seqtk rename
* Added meta map to seqtk/rename module def
* updated prefix parameter usage
* updated test.yml to remove local filepaths --> change to output
* Added empty line to main.nf
* Update versions
* update checksums + remove variables as input for applyvqsr
* sneak in removal of values and provide them via modules.config
* update another checksum
* more checksums
* move vairable to config
* remove controlfreec, wrong branch
* add line break
* First version of the biobambam/bammarkduplicates2 module
* Fixed the path of versions.yml
* Regenerated the checksums as the previous files were generated with a single core
* Added the `when:` block, as per #1261
Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>
Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>
* hmmcopy/mapCounter
* update test
* Remove bam tag
* Remove /tmp/ path from test.yml
* Update modules/hmmcopy/mapcounter/meta.yml
Incorporate formatting changes
Co-authored-by: James A. Fellows Yates <jfy133@gmail.com>
* Update modules/hmmcopy/mapcounter/meta.yml
Co-authored-by: James A. Fellows Yates <jfy133@gmail.com>
* Update tests/modules/hmmcopy/mapcounter/main.nf
Co-authored-by: James A. Fellows Yates <jfy133@gmail.com>
* ichorCNA run
* Add panel of normals code
* Try and fix tests
* Edit string detection in tests
* Fix linting issues
* Just failing END_VERSIONS
* Fixed versions.yml
* Added DOI
* Optional name for file
* Add when command
* Updated when
* Update modules/ichorcna/createpon/main.nf
Co-authored-by: Simon Pearce <simon.pearce@cruk.manchester.ac.uk>
Co-authored-by: James A. Fellows Yates <jfy133@gmail.com>
Co-authored-by: FriederikeHanssen <Friederike.hanssen@qbic.uni-tuebingen.de>
* Match target bed to input files
* Intervals in getpileupsumamries
* more interval updates
* change targets in strelka
* remove leftover channel
* fix checksums
* add new test vcfs
* add new test vcfs
* Update modules/freebayes/main.nf
Co-authored-by: Maxime U. Garcia <maxime.garcia@scilifelab.se>
* Add msisensorpro
* remove absolute paths
* fixing tests
* fix msisensorpro tests
* Update modules/msisensorpro/msi_somatic/main.nf
Co-authored-by: Maxime U. Garcia <maxime.garcia@scilifelab.se>
* Update modules/msisensorpro/msi_somatic/main.nf
Co-authored-by: Maxime U. Garcia <maxime.garcia@scilifelab.se>
* add when back in
* add when back in
* Update modules/msisensorpro/msi_somatic/main.nf
Co-authored-by: Maxime U. Garcia <maxime.garcia@scilifelab.se>
* update description
* Update main.nf
* Update main.nf
* Update main.nf
Co-authored-by: Maxime U. Garcia <maxime.garcia@scilifelab.se>
* add plink2_extract
* fix test yml path
* Update modules/plink2/extract/main.nf
Co-authored-by: James A. Fellows Yates <jfy133@gmail.com>
* Update modules/plink2/extract/main.nf
Co-authored-by: James A. Fellows Yates <jfy133@gmail.com>
* compress output
* add DOI
* make outputs less ambiguous
* update test for compressed output
* brain is dumb
* Update modules/plink2/extract/main.nf
Co-authored-by: James A. Fellows Yates <jfy133@gmail.com>
Co-authored-by: James A. Fellows Yates <jfy133@gmail.com>
* hifiasm copied from fastqc
* hifiasm tests init from fastqc
* meta.yml init; test.yml and main.nf for printing version
* Add hifiasm version printing
* Removed spaced on an empty line
* Reverted hifiasm from main
* Ignores version file checking if testing for error
* Added comment
Co-authored-by: Sviatoslav Sidorov <sviatoslav.sidorov@crick.ac.uk>
Co-authored-by: Svyatoslav Sidorov <svet.sidorov@gmail.com>
Co-authored-by: Tamara Hodgetts <hodgett@crick.ac.uk>
* initial commit to setup branch
* workflow finished
* Update nextflow.config
* tumour to tumor, getpileup passed as nomral and tumor
* paired_somatic renamed to tumor_normal_somatic
* Apply suggestions from code review
Co-authored-by: Maxime U. Garcia <maxime.garcia@scilifelab.se>
* Update subworkflows/nf-core/gatk_tumor_normal_somatic_variant_calling/main.nf
Co-authored-by: Maxime U. Garcia <maxime.garcia@scilifelab.se>
* updated index names in meta.yml
* changed index file names in main script and test
* Apply suggestions from code review
Co-authored-by: Maxime U. Garcia <maxime.garcia@scilifelab.se>
* Apply suggestions from code review
* fixed bug from changes
* Apply suggestions from code review
* modified yml to allow new subworkflow testing
* Update test.yml
* Update test.yml
* updated to follow the new mergebam syntax, also made unaligned input sample specific
Co-authored-by: GCJMackenzie <gavin.mackenzie@nibsc.org>
Co-authored-by: Maxime U. Garcia <maxime.garcia@scilifelab.se>
* refactor: add bcl2fastq to cellranger dockerfile
bcl2fastq required for the cellranger mkfastq module and was therefore
added to the cellranger dockerfile. Further, cellranger was updated to
the latest version, 6.1.2., with naming and containers across
cellranger modules updated accordingly.
* chore: add bcl2fastq zip to .gitignore
* style: fix code linting error
* test(cellranger): Add tiles to mkfastq
* additional dockerfile for mkfastq
* update readme and dockerfiles
* update readme
* fix: update container for mkfastq
* docs: correct typos in readme
* test: update md5sum following cellranger update
* test: update md5sum following cellranger update
* fix: new line for external args in mkfastq
* test: update mkfastq tiles argument
* test: comment out mkfastq tests until smaller test data found
* test: stub-run mkfastq test until smaller test data found
* test: fix incorrect file path for mkfastq
Co-authored-by: Edmund Miller <edmund.a.miller@protonmail.com>
Co-authored-by: ggabernet <gisela.gabernet@qbic.uni-tuebingen.de>
Co-authored-by: Gisela Gabernet <gisela.gabernet@gmail.com>
* Bump version 0.1.5 to chromap/chromap
* Bump conda samtools version to 1.14
* Get read of inconsistent md5sum in conda
* Bump version in conda and retry md5 checks
* genome index md5 hash removed, conda failed
* Remove old nextclade module
* Add nextclade/datasetget and nextclade/run modules
* Fix ECLint
* Add reference and tag as inputs to datasetget module
* Fix tests
* Adjust spacing
* Add stubs for deepvariant [ci skip]
* Update the stubs for deepvariant [ci skip]
* functional with google docker image
* cleanup
* consume docker container within singularity executor
* update the meta.yml file and ask for review
* tweak the input channel shape and test data
* tweak input data [ci skip]
* update for the new syntax
* remove the functions and rename meta vars
* Update the arguments mechanism
* update chr, region and checksum
Co-authored-by: Gregor Sturm <mail@gregor-sturm.de>
Co-authored-by: Maxime U. Garcia <max.u.garcia@gmail.com>
Co-authored-by: FriederikeHanssen <Friederike.hanssen@qbic.uni-tuebingen.de>
* Update dsh-bio to version 2.0.7, add support for compressed GFA 1.0 format
* fix ci failures
Co-authored-by: Chris Cheshire <chris.j.cheshire@gmail.com>
* Update seqwish to version 0.7.2
* seqwish can work with a comma-separated list of PAFs
* level with nf-core/modules master branch
* add pangenome test data keys
* the odgi test data lives in its own folder
Co-authored-by: Michael L Heuer <heuermh@acm.org>
Co-authored-by: Gregor Sturm <mail@gregor-sturm.de>
* Bump software versions for viralrecon modules
* Remove custom params.save_unaligned from bowtie2_align
* Unify samtools modules and error if input and output names are the same
* Fix ALL the tests
* Removed if-statement to only run on more than 1 file, now it will run on single files as well.
* Added a test for running the cat_cat module on a single file.
* Created a new test.yml with nf-core modules create-test-yml -t cat/cat
* Edited test.yml to not include paths and md5sums for versions.yml, and also removed sometimes variable md5sums
* Added files for bcftools/sort
* Fixed output format and removed md5 checksum
* Change input to avoid identical in/output names
* Created rows for bcftools/sort in pytest_modules.yml
* Change intervals to be part of sample specific input
* Fix some tests
* Update checksum
* Update intervals
* Update intervals
* Try out gavins idea for adding the file
* update test line
* update test line
* update test line
* revert contains line
* hmmcopy/mapCounter
* update test
* Remove bam tag
* Remove /tmp/ path from test.yml
* Update modules/hmmcopy/mapcounter/meta.yml
Incorporate formatting changes
Co-authored-by: James A. Fellows Yates <jfy133@gmail.com>
* Update modules/hmmcopy/mapcounter/meta.yml
Co-authored-by: James A. Fellows Yates <jfy133@gmail.com>
* Update tests/modules/hmmcopy/mapcounter/main.nf
Co-authored-by: James A. Fellows Yates <jfy133@gmail.com>
Co-authored-by: Simon Pearce <simon.pearce@cruk.manchester.ac.uk>
Co-authored-by: James A. Fellows Yates <jfy133@gmail.com>
* added new module snpsift/split
* added options.args
* added .vcf.gz to input
* removed test and updated to new NF DSL2 syntax
* Updated to new NF DSL2 syntax
* added option to join vcf files
Co-authored-by: Robert A. Petit III <robbie.petit@gmail.com>
Co-authored-by: FriederikeHanssen <Friederike.hanssen@qbic.uni-tuebingen.de>
* committing to pull updated nf-core files
* saving changes to checout other branch
* committing progress so far, difficulty with test data
* uploading to be used as draft PR
* fix linting error in meta.yml
* attempt to group reference inputs together
* updated input format for resources
* meta.yml updated with new resource names
* added output channel for recal index
* module only takes single vcf file input now
* committing to checkout
* update to new syntax, remove indel test for now
* updated to use memory options and new test data
* Update modules/gatk4/variantrecalibrator/main.nf
Co-authored-by: FriederikeHanssen <Friederike.hanssen@qbic.uni-tuebingen.de>
* Update main.nf
* Update modules/gatk4/variantrecalibrator/main.nf
Co-authored-by: FriederikeHanssen <Friederike.hanssen@qbic.uni-tuebingen.de>
* remove duplicate test keys from test_data.config
Co-authored-by: GCJMackenzie <gavin.mackenzie@nibsc.org>
Co-authored-by: FriederikeHanssen <Friederike.hanssen@qbic.uni-tuebingen.de>
* initial commit to setup branch
* workflow finished
* Update nextflow.config
* tumour to tumor, getpileup passed as nomral and tumor
* paired_somatic renamed to tumor_normal_somatic
* Apply suggestions from code review
Co-authored-by: Maxime U. Garcia <maxime.garcia@scilifelab.se>
* Update subworkflows/nf-core/gatk_tumor_normal_somatic_variant_calling/main.nf
Co-authored-by: Maxime U. Garcia <maxime.garcia@scilifelab.se>
* updated index names in meta.yml
* changed index file names in main script and test
* Apply suggestions from code review
Co-authored-by: Maxime U. Garcia <maxime.garcia@scilifelab.se>
* Apply suggestions from code review
* fixed bug from changes
* Apply suggestions from code review
* modified yml to allow new subworkflow testing
* Update test.yml
* Update test.yml
* add applyvqsr
* added memory options, new test data used
* Update main.nf
* Update main.nf
Co-authored-by: GCJMackenzie <gavin.mackenzie@nibsc.org>
Co-authored-by: Maxime U. Garcia <maxime.garcia@scilifelab.se>
* Initial structure
* Working with local singularity image
* Working generateMap.pl script
* Remote not working bioconda
* Working generateMap with biocontainer
* Lint changes
* Updated hmmcopy container version to be consistent
* Fix failing test
* Remove path to perl
* No hardpath to script
* Update main.nf
Moved version outside of process, add support for zipped fasta file
* Revert to not allowing gzip via pipe, as perl script can't cope
Co-authored-by: Simon Pearce <simon.pearce@cruk.manchester.ac.uk>
* initial commit to setup branch
* workflow finished
* Update nextflow.config
* tumour to tumor, getpileup passed as nomral and tumor
* paired_somatic renamed to tumor_normal_somatic
* Apply suggestions from code review
Co-authored-by: Maxime U. Garcia <maxime.garcia@scilifelab.se>
* Update subworkflows/nf-core/gatk_tumor_normal_somatic_variant_calling/main.nf
Co-authored-by: Maxime U. Garcia <maxime.garcia@scilifelab.se>
* updated index names in meta.yml
* changed index file names in main script and test
* Apply suggestions from code review
Co-authored-by: Maxime U. Garcia <maxime.garcia@scilifelab.se>
* Apply suggestions from code review
* fixed bug from changes
* Apply suggestions from code review
* modified yml to allow new subworkflow testing
* Update test.yml
* Update test.yml
* added output channel for tbi files, tweaked method of adding blank inputs for gendb tests
* Update main.nf
* Update main.nf
Co-authored-by: GCJMackenzie <gavin.mackenzie@nibsc.org>
Co-authored-by: Maxime U. Garcia <maxime.garcia@scilifelab.se>
* feat: each output type has dedicated channel replace bgzip with gzip can only zip one at a time
* Add condition moving of unbinned files
* fix: solution for moving sometimes non-existant files
* fix: update meta.yml to add the new channels
* fix: remove most of the checksums due to variability
* fix: tweaking of output
* Update modules/metabat2/metabat2/main.nf
Co-authored-by: Maxime Borry <maxibor@users.noreply.github.com>
* Fix find commands
* Fix find commands
Co-authored-by: Maxime Borry <maxibor@users.noreply.github.com>
* added code for subworkflow fgbio call umi consensus
* ironing out a few typos etc
* fixing last things
* fixed md5sum - lets see if it changes
* removing file accidentally deleted
* tidy indents
* added bwamem2 alternative
* fixed entry for both tests
* changed name second test workflow entry
* fixed workflow entry names
* fixed md5sum for file generated with bwamem2
* added syntax new DSL2
* added new config location in test command line
* added new config location in test command line
* use of prefix instead of suffix because modules have been changed in this way
* explicit alias to bwa mem1 to avoid confusion
* removed param that should be an ext optional argument in fgbio groupreadsbyumi
* missing colon in config
* missing colon in module config too
* order list alphabetically
Co-authored-by: Maxime U. Garcia <maxime.garcia@scilifelab.se>
* remove params from body
Co-authored-by: Maxime U. Garcia <maxime.garcia@scilifelab.se>
* improving readability of input structure
Co-authored-by: Mahesh Binzer-Panchal <mahesh.binzer-panchal@nbis.se>
* reverting to mandatory input
* fixed tests and workflow take values
* remove param
Co-authored-by: Maxime U. Garcia <maxime.garcia@scilifelab.se>
* simplify tests params
Co-authored-by: Maxime U. Garcia <maxime.garcia@scilifelab.se>
* formatting inputs for readability
* factoring in changes to bwamem2_mem and bwa_mem sort/view inputs
* updating test md5sum for grouped file following code update in bwamem
Co-authored-by: Maxime U. Garcia <maxime.garcia@scilifelab.se>
Co-authored-by: Maxime U. Garcia <max.u.garcia@gmail.com>
Co-authored-by: Mahesh Binzer-Panchal <mahesh.binzer-panchal@nbis.se>
* feat: view is now in args2 so we can use sort
* forgot one split_cpus
* feat: update with new logic
* fix: add more info
* fix: remove split_cpus logic
* greatly simplify syntax
* feat: add subworkflows to annotate (+ bgzip/tabix index) with ensemblvep and snpeff
* feat: get versions from all tools
* add commented infor for new annotation modules
* Add comment line for consistency
* Remove all functions.nf
* Remove include functions.nf and publishDir options
* Replace options.args3 with task.ext.args3 - 3 modules
* Replace options.args3 with task.ext.args3 - 17 modules
* Replace {task.cpus} with task.cpus
* Replace off on off off off off off off off on off on off on off off off on off off off on on off off off on on off off off off off off off on off off off off on off on on off off off on on on on off off off on off on on off on on off off on on on off on on off on off off off off on off off off on off off on off on off off off on on off on off on off off on off off off on off off off on off off off off on off off off on on on off on on off off on off on on on off on on off on on on off off off off off on on off off on off off off off off on off off on on off on on off on off off off on off off off off on on off on off off on off off on off on off off off off off off off off on on off on off off off.args with
* Add def args = task.ext.args line to all modules in script section
* Replace options.args with args and args_list
* Initialise args2 and args3 properly
* Replace container syntax
* Revert container changes for cellranger/mkref
* Replace getProcessName in all modules
* Replace getSoftwareName in all modules
* Unify modules using VERSION variable
* Replae options.suffix with task.ext.suffix
* Remove NF version restriction for CI
* Bump NF version in README
* Replace task.process.tokenize logic with task.process
* Minor tweaks to unify syntax in tests main.nf
* Add a separate nextflow.config for each module
* Transfer remaining module options to nextflow.config
* Remove addParams from tests main.nf
* Remove TODO statements
* Use -c to import module specific config
* Bump NF version to 21.10.3
* Fix tests for artic/minion
* Fix broken publishDir syntax
* Standardise and fix obvious failing module tests
* Remove kronatools to krona
* Comment out tags in subworkflow test.yml
* Fix failing module tests
* Add consistent indentation to nextflow.config
* Comment out subworklow definitions
* Fix kallistobustools/ref
* Fix rmarkdownnotebook
* Fix jupyternotebook
* Quote task.process
* Add plink2/vcf to pytest_modules.yml
* Remove NF_CORE_MODULES_TEST from pytest CI
* Fix more tests
* Move bacteroides_fragilis to prokaryotes folder
* Fix cooler merge tests
* Fix kallistobustools/count tests
* Fix kallistobustools/ref tests
* Update test_10x_1_fastq_gz file for kallistobustools/count tests
* Fix bcftools/query tests
* Fix delly/call tests
* Fix cooler/zoomify tests
* Fix csvtk/split tests
* Fix gatk4/intervallisttools tests
* Fix gatk4/variantfiltration
* Fix pydamage/filter tests
* Fix test data for unicycler
* Fix gstama/collapse module
* Fix leehom tests
* Fix metaphlan3 tests
* Fix pairtools/select tests
* Update nextflow.config
* Update nextflow.config
* feat: update syntax
* Fix arriba tests
* Fix more failing tests
* Update test syntax
* Remove comments from tests nextflow.config
* Apply suggestions from code review
* Fix kallistobustools/count module
* Update dumpsoftwareversions module
* Update custom/dumpsoftwareversions
* Add args2 to untar module
* Update leftover modules
* Remove last remaining addParams
* Change syntax from task.ext.suffix to tast.ext.prefix
* Change nextflow.config in all tests to use ext.prefix instead of ext.suffix
Co-authored-by: JoseEspinosa <kadomu@gmail.com>
Co-authored-by: Gregor Sturm <mail@gregor-sturm.de>
Co-authored-by: MaxUlysse <max.u.garcia@gmail.com>
* Add comment line for consistency
* Remove all functions.nf
* Remove include functions.nf and publishDir options
* Replace options.args3 with task.ext.args3 - 3 modules
* Replace options.args3 with task.ext.args3 - 17 modules
* Replace {task.cpus} with task.cpus
* Replace off on off off off off off off off on off on off on off off off on off off off on on off off off on on off off off off off off off on off off off off on off on on off off off on on on on off off off on off on on off on on off off on on on off on on off on off off off off on off off off on off off on off on off off off on on off on off on off off on off off off on off off off on off off off off on off off off on on on off on on off off on off on on on off on on off on on on off off off off off on on off off on off off off off off on off off on on off on on off on off off off on off off off off on on off on off off on off off on off on off off off off off off off off on on off on off off off.args with
* Add def args = task.ext.args line to all modules in script section
* Replace options.args with args and args_list
* Initialise args2 and args3 properly
* Replace container syntax
* Revert container changes for cellranger/mkref
* Replace getProcessName in all modules
* Replace getSoftwareName in all modules
* Unify modules using VERSION variable
* Replae options.suffix with task.ext.suffix
* Remove NF version restriction for CI
* Bump NF version in README
* Replace task.process.tokenize logic with task.process
* Minor tweaks to unify syntax in tests main.nf
* Add a separate nextflow.config for each module
* Transfer remaining module options to nextflow.config
* Remove addParams from tests main.nf
* Remove TODO statements
* Use -c to import module specific config
* Bump NF version to 21.10.3
* Fix tests for artic/minion
* Fix broken publishDir syntax
* Standardise and fix obvious failing module tests
* Remove kronatools to krona
* Comment out tags in subworkflow test.yml
* Fix failing module tests
* Add consistent indentation to nextflow.config
* Comment out subworklow definitions
* Fix kallistobustools/ref
* Fix rmarkdownnotebook
* Fix jupyternotebook
* Quote task.process
* Add plink2/vcf to pytest_modules.yml
* Remove NF_CORE_MODULES_TEST from pytest CI
* Fix more tests
* Move bacteroides_fragilis to prokaryotes folder
* Fix cooler merge tests
* Fix kallistobustools/count tests
* Fix kallistobustools/ref tests
* Update test_10x_1_fastq_gz file for kallistobustools/count tests
* Fix bcftools/query tests
* Fix delly/call tests
* Fix cooler/zoomify tests
* Fix csvtk/split tests
* Fix gatk4/intervallisttools tests
* Fix gatk4/variantfiltration
* Fix pydamage/filter tests
* Fix test data for unicycler
* Fix gstama/collapse module
* Fix leehom tests
* Fix metaphlan3 tests
* Fix pairtools/select tests
* Update nextflow.config
* Update nextflow.config
* feat: update syntax
* Fix arriba tests
* Fix more failing tests
* Update test syntax
* Remove comments from tests nextflow.config
* Apply suggestions from code review
* Fix kallistobustools/count module
* Update dumpsoftwareversions module
* Update custom/dumpsoftwareversions
* Add args2 to untar module
* Update leftover modules
* Remove last remaining addParams
Co-authored-by: JoseEspinosa <kadomu@gmail.com>
Co-authored-by: Gregor Sturm <mail@gregor-sturm.de>
Co-authored-by: MaxUlysse <max.u.garcia@gmail.com>
* Make targets.bed optional when running in wgs mode
* added test for cram
* Update test_data_config with new reference.cnn
* Update main.nf to allow tumor-only running
Still need a unit-test for this. Almost ready, but needs this file as input https://github.com/nf-core/test-datasets/blob/modules/data/generic/cnn/reference.cnn
* re-writing previous changes, but now it wont crash the entire CI-setup
* fixing overlooked merge conflict
* last overlooked merge-conflict
* move all files to batch subfolder
* adding an optional input for a reference file (needed when running germline and tumoronly)
* minor typo
* update meta.yml
* aligning code, renaming cnvkit to cnvkit_batch, renaming tumorbam to tumor, normalbam to normal
* Update pytest_modules.yml
Co-authored-by: EC2 Default User <ec2-user@ip-172-31-21-198.us-west-2.compute.internal>
Co-authored-by: Lasse Folkersen <lassefolkersen@gmail.com>
Co-authored-by: Robert A. Petit III <robbie.petit@gmail.com>
Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>
* Fix picard/markduplicates with new options syntax
* Delete md5sum for bam files and add contains for metrics.txt
Co-authored-by: Robert A. Petit III <robbie.petit@gmail.com>
Co-authored-by: FriederikeHanssen <Friederike.hanssen@qbic.uni-tuebingen.de>
* Added vcf_index to vcf tuple; output to vcf.gz format.
* Fix: extra new line in meta.yml.
* addressed review feedback
* fix: editorconfig error
* fix: gatk memory flag
* fix: editorconfig error
* fix: Indentation
fix: Indentation
* Fix: lint editorconfig error
Removed one extra space
Co-authored-by: Robert A. Petit III <robbie.petit@gmail.com>
* initial commit to setup branch
* workflow finished
* Update nextflow.config
* tumour to tumor, getpileup passed as nomral and tumor
* paired_somatic renamed to tumor_normal_somatic
* Apply suggestions from code review
Co-authored-by: Maxime U. Garcia <maxime.garcia@scilifelab.se>
* Update subworkflows/nf-core/gatk_tumor_normal_somatic_variant_calling/main.nf
Co-authored-by: Maxime U. Garcia <maxime.garcia@scilifelab.se>
* updated index names in meta.yml
* changed index file names in main script and test
* Apply suggestions from code review
Co-authored-by: Maxime U. Garcia <maxime.garcia@scilifelab.se>
* Apply suggestions from code review
* fixed bug from changes
* Apply suggestions from code review
* tests should now work after the yml update
* Update pytest_modules.yml
Co-authored-by: GCJMackenzie <gavin.mackenzie@nibsc.org>
Co-authored-by: Maxime U. Garcia <maxime.garcia@scilifelab.se>
Co-authored-by: Maxime U. Garcia <max.u.garcia@gmail.com>
* initial commit to set up new branch
* save changes to checkout
* workflow working, still needs test.yml and meta.yml, also fix versions file
* subworkflow finished
* Update pytest_subworkflows.yml
* Update pytest_subworkflows.yml
* Update pytest_subworkflows.yml
* fix config subworkflow name
* Update main.nf
* Update pytest_subworkflows.yml
* fixed md5sum issue likely caused by gatk version update
* tumour changed to tumor
* old dir deleted
* Comments added to explain use of placeholders '[]'
* updated index names, input channel renamed to input
* Apply suggestions from code review
* updated to perform new subworkflow testing
Co-authored-by: GCJMackenzie <gavin.mackenzie@nibsc.org>
Co-authored-by: Maxime U. Garcia <maxime.garcia@scilifelab.se>
* fasta_fai_dict tuple is now split into separate input channels
* fix: lint errors
* fix: pytest errors
* Update modules/gatk4/splitncigarreads/meta.yml
* Update modules/gatk4/splitncigarreads/main.nf
Co-authored-by: Maxime U. Garcia <maxime.garcia@scilifelab.se>
* add new nucmer module
* Apply suggestions from code review
Co-authored-by: Robert A. Petit III <robbie.petit@gmail.com>
* update tests with file produced by input
* Update main.nf
* Update meta.yml
Co-authored-by: Michael Cipriano <mcipriano@gmail.com>
Co-authored-by: Robert A. Petit III <robbie.petit@gmail.com>
Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>
* ci: Remove pytest_subworkflows
* ci(bam_sort_samtools): Depend on paths-filter instead of pytest-workflow
Co-authored-by: Harshil Patel <drpatelhh@gmail.com>
Co-authored-by: Gregor Sturm <mail@gregor-sturm.de>
Co-authored-by: Jose Espinosa-Carrasco <kadomu@gmail.com>
* ci: Revert back to one job branch
* ci(align_bowtie2): Run tests that depend on bam_sort_samtools
* ci: Fix anchor not being created yet
* ci: Update sra_fastq tags and pytest_modules
* fix(bam_sort_samtools): Update nextflow.config with params
* test(subworkflows): Update gatk_create_som_pon tags
* ci: Point to subworkflow_hacks branch of nf-core tools
Co-authored-by: Harshil Patel <drpatelhh@gmail.com>
Co-authored-by: Gregor Sturm <mail@gregor-sturm.de>
Co-authored-by: Jose Espinosa-Carrasco <kadomu@gmail.com>
* created and initialised krona module
* Added kronatools/ktimporttaxonomy module
* removing previous redundant work
* added contains info for html
* edited contains in test.yml
* Update get versions
Co-authored-by: Daniel Straub <42973691+d4straub@users.noreply.github.com>
* remove old syntax
Co-authored-by: Daniel Straub <42973691+d4straub@users.noreply.github.com>
* rewording module description
Co-authored-by: Daniel Straub <42973691+d4straub@users.noreply.github.com>
* added detailed keywords
Co-authored-by: Daniel Straub <42973691+d4straub@users.noreply.github.com>
* update syntax and tool version
* fixed meta.yml issues
* remove contains line from test.yml
* re-wrote module after nf-core/tools update - should work now
* removed md5
* Update modules/kronatools/ktimporttaxonomy/main.nf
Co-authored-by: Daniel Straub <42973691+d4straub@users.noreply.github.com>
* update meta save
* removed typo
* double quotes to single quotes around html
* re-ran test, which updated md5
* removed md5
* 'classifier' removed to fix linting
* update version
* removed erroneous ktimporttaxonomy2
* Updated input to include meta and database
* fixed tab issues in yaml
* added `contains` to test.yml
* edited `contains` in test.yml
* trying another `contains`
* retrying `contains`
* contains with extra line
* removed classifier from tag
* Apply suggestions from code review
* Update meta.yml
Co-authored-by: Daniel Straub <42973691+d4straub@users.noreply.github.com>
Co-authored-by: Sébastien Guizard <sguizard@ed.ac.uk>
Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>
* Add tests and yml file for macs2/callpeak
* add format option for macs2
* update macs2/callpeak to accept format argument
* update test.yml
* update the container version.
* try to fix the issue in conda container.
* Update conda and containers
* Going back to previous container versions
Co-authored-by: JoseEspinosa <kadomu@gmail.com>
* add software/cooler
* fix the wrong files uploaded.
* create a branch for cooler/zoomify
* Apply suggestions from code review
* update functions.nf to new version.
* update the test file to test-datasets.
* update the test method of zoomify
* update dump test file.
* update version.txt to version.yml
* Update modules/cooler/dump/main.nf
Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>
* fix the output bug of versions update to pytest_modules.yml
* update the test file path and fix the output versions.
* Update modules/cooler/dump/main.nf
* indent
Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>
Co-authored-by: Gregor Sturm <mail@gregor-sturm.de>
Co-authored-by: Sébastien Guizard <sguizard@ed.ac.uk>
Co-authored-by: FriederikeHanssen <Friederike.hanssen@qbic.uni-tuebingen.de>
* New modules added: issues #200 and #310
* Update main.nf
* Update meta.yml
* Update tests/modules/gatk4/genotypegvcfs/main.nf
* Apply suggestions from code review
* Update main.nf
* Updating tests for GenomicsDB input and adding the path for this test resource to test_data.config
* Some minor changes on one of the test files I forgot to include
Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>
Co-authored-by: GCJMackenzie <43276267+GCJMackenzie@users.noreply.github.com>
* add software/cooler
* fix the wrong files uploaded.
* create a branch for cooler/merge
* remove the bin_size from metadata.
* update the test_data to test-datasets
* update pytest_modules.yml
* update the test file from single input file to two input file.
update the output file from hdf5 to bedpe.
* update the version.txt to version.yml and functions.nf
* change version.yml to versions
* update the test file path and fix the output versions.
* Update meta.yml
Correct "version" to "versions"
* Update main.nf
Fix typo
* Update main.nf
Remove some spaces
Co-authored-by: Gregor Sturm <mail@gregor-sturm.de>
Co-authored-by: Sébastien Guizard <sguizard@ed.ac.uk>
* commit but won't be used because pmdtools should have a submodule
* added submodule pmdtools/filter
* removed pmdtools module created before deciding to design two submodules
* oops forgot to remove a TODO
* removed white space meta.yml, removed v in version and manually added submodule /filter to test
* Update pytest_modules.yml
* Update main.nf
added split_cpus for multi-tools module resources
* Update test.yml
added .pmd extension to match modules/ main.nf
* Update test.yml
update md5sum
* Update singularity and docker build in main.nf
From build 4 to 5 in order to match the conda one
* Update modules/pmdtools/filter/main.nf
Co-authored-by: James A. Fellows Yates <jfy133@gmail.com>
* Update modules/pmdtools/filter/main.nf
Co-authored-by: James A. Fellows Yates <jfy133@gmail.com>
* Update modules/pmdtools/filter/main.nf
Co-authored-by: James A. Fellows Yates <jfy133@gmail.com>
* Update modules/pmdtools/filter/meta.yml
Co-authored-by: James A. Fellows Yates <jfy133@gmail.com>
* Update modules/pmdtools/filter/meta.yml
Co-authored-by: James A. Fellows Yates <jfy133@gmail.com>
* Update modules/pmdtools/filter/meta.yml
Co-authored-by: James A. Fellows Yates <jfy133@gmail.com>
* Update modules/pmdtools/filter/meta.yml
Co-authored-by: James A. Fellows Yates <jfy133@gmail.com>
* Update modules/pmdtools/filter/main.nf
Co-authored-by: James A. Fellows Yates <jfy133@gmail.com>
* Update modules/pmdtools/filter/main.nf
Co-authored-by: James A. Fellows Yates <jfy133@gmail.com>
* Update main.nf adding samtools version
we need both pmdtools and samtools versions
* Update main.nf remove .pmd extension
* Update test.yml md5sum
Because file extension changed
Co-authored-by: James A. Fellows Yates <jfy133@gmail.com>
* feat: update gatk4 from 4.2.0.0 to 4.2.3.0
* update md5checksum
* commit all files
* actually checksum was good, but I suspect something fishy with the tests
* added template
* integrated module
* added fasta index info
* test works, have placeholder data for baits until test-data PR is merged
* added new files to config
* updated test files
* fixing fails ✨
* okay final fix here on the md5sum :face_palm:
* md5sum variable
* update meta.yml to reflect consistency to main.nf
* reverted version so conda works
* Apply suggestions from code review
Co-authored-by: Sébastien Guizard <sguizard@ed.ac.uk>
* md5sum can't be generated consistently for output
Co-authored-by: Sébastien Guizard <sguizard@ed.ac.uk>
* add pydamage module
* remove TODOs
* split module by subcommands
* update version parsing
* remove forgotten TODOs
* update module names
* remove old holistic module
* Update modules/pydamage/analyze/main.nf
Co-authored-by: James A. Fellows Yates <jfy133@gmail.com>
* add keywords
* update resource requirement
* Update modules/pydamage/filter/main.nf
Co-authored-by: James A. Fellows Yates <jfy133@gmail.com>
* Update modules/pydamage/filter/meta.yml
Co-authored-by: James A. Fellows Yates <jfy133@gmail.com>
* merge from upstream
* update pydamage from upstream
* add freebayes
* update pydamage test from upstream
* fix meta.yml
* update functions.nf
* update test.yml
* update version parsing
* update version parsing
* fix indentation
* Update modules/freebayes/main.nf
Co-authored-by: James A. Fellows Yates <jfy133@gmail.com>
* Update modules/freebayes/main.nf
Co-authored-by: James A. Fellows Yates <jfy133@gmail.com>
* Update modules/freebayes/main.nf
Co-authored-by: James A. Fellows Yates <jfy133@gmail.com>
* add optional inputs
* Update modules/freebayes/main.nf
Co-authored-by: James A. Fellows Yates <jfy133@gmail.com>
* add bed test
* add metabat2 module
* only freebayes
* remove metabat2
* update md5sum because of vcf including date of the day
* add keyword
* rescue conflicted files
* attempt to fix ECLint
* add pytest workflow for metabat
* remove -
* Update modules/metabat2/jgisummarizebamcontigdepths/meta.yml
Co-authored-by: James A. Fellows Yates <jfy133@gmail.com>
* Update modules/metabat2/metabat2/meta.yml
Co-authored-by: James A. Fellows Yates <jfy133@gmail.com>
* Update modules/metabat2/metabat2/meta.yml
Co-authored-by: James A. Fellows Yates <jfy133@gmail.com>
* Update modules/metabat2/jgisummarizebamcontigdepths/meta.yml
Co-authored-by: James A. Fellows Yates <jfy133@gmail.com>
* add optional inputs/outpus
* remove trailing whitespace
* first cmseq commit
* compressing and removing not reproducible md5sums
* save intermediate work
* follow symlinks while decompressing
* add cmseq/polymut
* add polymut
* add extra test with optional input file
* remove metabat2
* Update modules/cmseq/polymut/main.nf
Co-authored-by: James A. Fellows Yates <jfy133@gmail.com>
* Update modules/cmseq/polymut/meta.yml
Co-authored-by: James A. Fellows Yates <jfy133@gmail.com>
* Update modules/cmseq/polymut/meta.yml
Co-authored-by: James A. Fellows Yates <jfy133@gmail.com>
* fix file extension
* Update modules/cmseq/polymut/meta.yml
Co-authored-by: James A. Fellows Yates <jfy133@gmail.com>
* add test without bam index
* split tests in workflows
* answer PR review
* report version from variable
Co-authored-by: James A. Fellows Yates <jfy133@gmail.com>
Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>
* Implement PLINK_EXTRACT module
* fix plink version number
* Update main.nf
* Update test_data.config
* Update modules/plink/extract/main.nf
Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>
* just use one channel
* fix test with new channel input
Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>
* commiting changes to switch branch
* commit to setup remote branch
* first draft of the sompon workflow
* keep branch in line with gendb bugfixing
* Update test.yml
* tidy up main.nf
* fixed md5sum
Co-authored-by: GCJMackenzie <gavin.mackenzie@nibsc.org>
