Commit graph

1668 commits

Author SHA1 Message Date
GCJMackenzie
71945a5b5f
Mutect2 add mitochondria mode and update tests (#967)
* new mitochondria mode added, tests updated to allow for temp fix for test data

* add cram test

* bam/bam_idx renamed to input and input_index

Co-authored-by: GCJMackenzie <gavin.mackenzie@nibsc.org>
2021-10-29 11:27:56 +01:00
Francesco L
4b8c7ac7bd
Bam2fq (#958)
* added template for module

* update main

* added specific code

* wrong variable name in else script

* added tests for both split and nosplit

* docker test successful - updating yaml

* adding echo to version print
2021-10-29 10:46:34 +02:00
Sateesh
5b1fe84bc6
add new assembly scan module (#971)
* add new assembly scan module

* add newline endings

* fix newline ending

* add newline at end

Co-authored-by: Peri <rrx8@cdc.gov>
Co-authored-by: Robert A. Petit III <robbie.petit@gmail.com>
Co-authored-by: Gregor Sturm <mail@gregor-sturm.de>
2021-10-29 10:01:23 +02:00
Chris Cheshire
e8b33e6eb1
bedtools/genomecov updated to allow for providing a per-sample scale factor (#799)
* hifiasm copied from fastqc

* hifiasm tests init from fastqc

* meta.yml init; test.yml and main.nf for printing version

* Add hifiasm version printing

* Removed spaced on an empty line

* Reverted hifiasm from main

* Added genomecov scale module

* Updated tagging

* Removed extra module - began merging

* Removed extra module tests

* Updated genomecov to take a scale value

* Updated line endings

* Removed redundant test

* Update tests/modules/bedtools/genomecov/main.nf

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* Added checking for existing -bg arg

* Update modules/bedtools/genomecov/main.nf

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* Update modules/bedtools/genomecov/main.nf

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

Co-authored-by: Sviatoslav Sidorov <sviatoslav.sidorov@crick.ac.uk>
Co-authored-by: Svyatoslav Sidorov <svet.sidorov@gmail.com>
Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>
2021-10-28 17:50:25 +01:00
FriederikeHanssen
1662201102
Add gatk4/estimatelibrarycomplexity (#965)
* Add gatk4/estimatelibrarycomplxity

* forgot to add yml

* Fix placeholder
2021-10-28 17:49:27 +02:00
emnilsson
9402595711
New module seqtk/mergepe (#951)
* First step into creating a seqtk/mergepe module to interleave fastQ input

* First rewrite of main.nf to make the module perform the desired (interleave/merge of pe reads) task

* Modifications to test the new seqtk/mergepe module.

* Improving the seqtk/mergepe module to output single end reads as well, and making sure tests work

* Modified so that gzip uses -n and that single read entries are symlinked with ln -s instead of copied, therefore updated test.yml as well.

* Fix trailing whitespaces

Co-authored-by: Daniel Lundin <daniel.lundin@lnu.se>
2021-10-28 16:53:33 +02:00
Jose Espinosa-Carrasco
fd1189c2f5
Updating test file for optitype (#782)
* Provide an exisiting bam file for optitype

* Update main.nf

Attempt at fixing this with new testing data

* Trying slightly different approach

* Mini fixes, not sure whats wrong here

* Add bam file with NM tags in all reads for optitype

Co-authored-by: Alexander Peltzer <apeltzer@users.noreply.github.com>
Co-authored-by: Alexander Peltzer <alexander.peltzer@boehringer-ingelheim.com>
2021-10-28 14:24:52 +02:00
Gisela Gabernet
d5183a7fec
new module cellranger mkref (#896)
* add cellranger mkref module

* add cellranger mkref tests

* update test yml chksum

* fix module linting

* fix test yml

* fix getprocessname

* fix versions typo

* fix cellranger test.yml

* fix versions.yml

* test versions.yml

* fix grep version

* fix cellranger version

* add dockerfile and readme

* review container statement

* Update modules/cellranger/mkref/meta.yml

Co-authored-by: Gregor Sturm <mail@gregor-sturm.de>

* add disclaimers

* change location dockerfile

Co-authored-by: Gregor Sturm <mail@gregor-sturm.de>
2021-10-28 13:33:57 +02:00
Gisela Gabernet
0b0f87c2f7
add porechop module (#914)
* add module main porechop

* update porechop main

* add porechop functions

* update meta porechop

* add test main porechop

* add porechop pytest yml

* add porechop test.yml

* Update modules/porechop/meta.yml

Co-authored-by: Robert A. Petit III <robbie.petit@gmail.com>

* re-add porechop avoid conflict

* Update modules/porechop/meta.yml

Co-authored-by: Robert A. Petit III <robbie.petit@gmail.com>

* fix prefix suffix

Co-authored-by: Robert A. Petit III <robbie.petit@gmail.com>
2021-10-28 13:21:36 +02:00
louperelo
263bbe56d2
add new module samtools/depth (#950)
* add new module samtools_depth

* fixed main.nf for samtools/depth

* Apply suggestions from code review

Co-authored-by: James A. Fellows Yates <jfy133@gmail.com>

Co-authored-by: James A. Fellows Yates <jfy133@gmail.com>
2021-10-28 12:53:21 +02:00
James A. Fellows Yates
e27553b989
Add module: dedup (#907)
* Specify more guidelines on input channels

* Linting

* Updates based on code review

* Update README.md

* Fix broken sentence

* feat: add megahit module, currently decompressed output

* Update main.nf

* Update tests/modules/megahit/test.yml

Co-authored-by: Maxime Borry <maxibor@users.noreply.github.com>

* Apply suggestions from code review

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* feat: compress all outputs, remove md5sums due to gz stochasicity

* fix: wrong conda channel for pigz

* fix: broken singleend tests and update meta.yml

* Missed one

* Apply suggestions from code review

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* fix: pigz formatting

* Apply suggestions from code review

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* Apply suggestions from code review

* Add dedup (tests and version not working)

* Fix dedup and tests

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>
Co-authored-by: Maxime Borry <maxibor@users.noreply.github.com>
2021-10-28 12:10:21 +02:00
Francesco L
a0bc08732c
Rewritten module fgbio/fastqtobam (#916)
* added template for fastqtobam

* porting old code into new template

* update with missing getprocessname function

* test completed - updating all

* fixed linting issues

* improved reading

Co-authored-by: FriederikeHanssen <Friederike.hanssen@qbic.uni-tuebingen.de>

Co-authored-by: FriederikeHanssen <Friederike.hanssen@qbic.uni-tuebingen.de>
2021-10-27 19:06:06 +02:00
Maxime U. Garcia
80d8e87fa4
adding new manta/germline + manta/tumoronly modules (#906)
* feat: all manta/single to modules

* fix module name

* fix module name

* fix: changes from review comments

* fix: test data
2021-10-27 18:24:48 +02:00
FriederikeHanssen
257078bb39
Update strelka, by enabling BP if Manta candidates are present (#923)
* add BP to strelka/somatic

* merge conflicts

* update strelka modules for BP

* update strelka modules for BP

* apply suggestions from code review
2021-10-27 17:49:54 +02:00
Daniel Straub
12a3f80f33
add filtlong (#919) 2021-10-27 17:00:11 +02:00
FriederikeHanssen
754db250a0
Add Manta/somatic module + (fix tiny strelka params problem, i know bad practice :( ) (#912)
* remove params statement

* add manta/somatic module

* fix strelka target bed thing

* removing checksums should make this pass

* Update modules/manta/somatic/main.nf

Co-authored-by: Matthias Hörtenhuber <mashehu@users.noreply.github.com>

* fix indentation

Co-authored-by: Matthias Hörtenhuber <mashehu@users.noreply.github.com>
2021-10-27 16:14:52 +02:00
Matthias Hörtenhuber
b552958341
add paraclu (#909)
* add paraclu

* remove TODOs

* add min_cluster as input parameter, remove option parameters

* add tool_dev_url
2021-10-27 15:48:49 +02:00
Gisela Gabernet
f47c27edfb
Update checksum modules using human GTF (#900)
* update test yml star align

* update test yml stringtie merge

* update star genomegenerate yml

* update test yml rsem calculateexpression

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>
2021-10-26 23:09:04 +01:00
James A. Fellows Yates
bd2baa1e7c
New module: maxbin2 (#895)
* Specify more guidelines on input channels

* Linting

* Updates based on code review

* Update README.md

* Fix broken sentence

* feat: add megahit module, currently decompressed output

* Update main.nf

* Update tests/modules/megahit/test.yml

Co-authored-by: Maxime Borry <maxibor@users.noreply.github.com>

* Apply suggestions from code review

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* feat: compress all outputs, remove md5sums due to gz stochasicity

* fix: wrong conda channel for pigz

* fix: broken singleend tests and update meta.yml

* Missed one

* Apply suggestions from code review

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* fix: pigz formatting

* Apply suggestions from code review

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* Apply suggestions from code review

* Added, just need to finish tests once we have bacterial data

* Add prelim test data

* Fix version reporting

* Add tests based on proposed test-dataset

* Finalise new testdata

* Fix md5sum issue by removing it...

* Update main.nf

* Apply suggestions from code review

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>
Co-authored-by: Maxime Borry <maxibor@users.noreply.github.com>
2021-10-26 22:07:33 +01:00
James A. Fellows Yates
a740a6ff48
New module: checkm/lineagewf (#899)
* Specify more guidelines on input channels

* Linting

* Updates based on code review

* Update README.md

* Fix broken sentence

* feat: add megahit module, currently decompressed output

* Update main.nf

* Update tests/modules/megahit/test.yml

Co-authored-by: Maxime Borry <maxibor@users.noreply.github.com>

* Apply suggestions from code review

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* feat: compress all outputs, remove md5sums due to gz stochasicity

* fix: wrong conda channel for pigz

* fix: broken singleend tests and update meta.yml

* Missed one

* Apply suggestions from code review

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* fix: pigz formatting

* Apply suggestions from code review

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* Apply suggestions from code review

* Added but test failing due to null on output channel

* fix prefix variable

* Complete checkm_lineagewf

* Remove TODOs

* Add description of fasta_ext parameter

* Improve meta map for this context

* Update meta.yml

* Update modules/checkm/lineagewf/meta.yml

Co-authored-by: James A. Fellows Yates <jfy133@gmail.com>

* Update main.nf

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>
Co-authored-by: Maxime Borry <maxibor@users.noreply.github.com>
Co-authored-by: Daniel Lundin <erik.rikard.daniel@gmail.com>
2021-10-26 21:54:10 +01:00
Gregor Sturm
2ad98162f3
Notebook modules (#617)
* Draft rmarkdown module

* stub jupyter notebook module

* Create yaml file with params

* Update meta.yml for rmarkdown module

* Add comment on YAML

* Update notebooks module, clean up parametrize.nf

* Two separate channels for parameters and input files

* Fix Rmd render script

* Add tests for rmarkdown

* Fix tests for rmarkdown module

* Update checksums

* Fix tests for jupyter

* Test without Grab()

* Update software versions

* update rmarkdown dependencies

* Draft for multiple versions

* Fix indent of script

* Fix indent in rmarkdown script

* Emit version.syml

* Update modules/rmarkdown/main.nf

Co-authored-by: James A. Fellows Yates <jfy133@gmail.com>

* Update modules/rmarkdown/meta.yml

Co-authored-by: James A. Fellows Yates <jfy133@gmail.com>

* Update modules/rmarkdown/meta.yml

Co-authored-by: James A. Fellows Yates <jfy133@gmail.com>

* Rename rmarkdown to rmarkdownnotebook

* Add rmarkdown mulled biocontainer

* Write sessionInfo to separate log file

* Update rmarkdownnotebook

* Sessioninfo does not have a stable md5sum

* Update jupyternotebook

* Update meta

* Add jupyternotebook biocontainers

* Handle Groovy Gstrings in parameterize

* Update to versions.yml

* Update functions.nf

* Fix versions yaml

* Fix EC lint

* Update modules/rmarkdownnotebook/main.nf

Co-authored-by: James A. Fellows Yates <jfy133@gmail.com>

* Update modules/jupyternotebook/main.nf

Co-authored-by: James A. Fellows Yates <jfy133@gmail.com>

* Use official test data

* Harshilify

* Make parameters channel clearer

* Apply suggestions from code review

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* Apply suggestions from code review

* Update main.nf

Co-authored-by: James A. Fellows Yates <jfy133@gmail.com>
Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>
2021-10-24 20:51:56 +02:00
Sébastien Guizard
0a5ddd0ad0
Update module: bamtools/split (#885)
* 👌 IMPROVE: Add some pacbio test files

* 🐛 FIX: Add Pacbio index to test_data.config

* 👌 IMPROVE: Re add 10000 data test

* 👌 IMPROVE: Add some pbindex

* 🐛 FIX: Add pbi extension to files

* 📦 NEW: Add galgal6 chr30 test data

* 📦 NEW: Add bamtools module

* 👌 IMPROVE: Ignore test data

* 👌 IMPROVE: Update to last templates version

* 👌 IMPROVE: Update module to last template version

* 👌 IMPROVE: Update module to last template version

* 👌 IMPROVE: Final version of test datasets config

* 👌 IMPROVE: Remove useless index + Fix Typos

* 👌 IMPROVE: Add some pacbio test files

* 🐛 FIX: Add Pacbio index to test_data.config

* 👌 IMPROVE: Re add 10000 data test

* 👌 IMPROVE: Add some pbindex

* 🐛 FIX: Add pbi extension to files

* 📦 NEW: Add galgal6 chr30 test data

* 📦 NEW: Add bamtools module

* 👌 IMPROVE: Ignore test data

* 👌 IMPROVE: Update to last templates version

* 👌 IMPROVE: Update module to last template version

* 👌 IMPROVE: Update module to last template version

* 👌 IMPROVE: Final version of test datasets config

* 👌 IMPROVE: Remove useless index + Fix Typos

* 👌 IMPROVE: Update with new versions.yml file

* 🐛 FIX: Update meta.yml + correct typos

* Update modules/bamtools/split/meta.yml

Add bam, split, chunk tags

Co-authored-by: James A. Fellows Yates <jfy133@gmail.com>

* 🐛 FIX: Correct meta.yml

* 🐛 FIX: Grab software name using ${getSoftwareName(task.process)}

* 🐛 FIX: Update test.yml

Co-authored-by: James A. Fellows Yates <jfy133@gmail.com>
Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>
2021-10-23 19:39:27 +01:00
GCJMackenzie
3c8ca3fec4
Createsomaticpanelofnormals (#859)
* files created for createsompon, script written, meta written, still needs tests

* updated to 2.0.0 method input, however this requires a genomicsDB input now

* script finished, meta yaml updated. Tests working locally, test yaml made, needs genomicsdb example on nf-core to run repository tests

* versions updated, issue with test data not able to download directory

* updated tests to include repo-side data

* Apply suggestions from code review

* Update modules/gatk4/createsomaticpanelofnormals/main.nf

Co-authored-by: GCJMackenzie <gavin.mackenzie@nibsc.org>
Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>
2021-10-23 19:30:14 +01:00
Sébastien Guizard
8524e6b40f
Update of pbccs (#835)
* 📦 NEW: First commit of pbccs module

* 👌 IMPROVE: Remove option from command + rename output (ccs -> bam)

* 👌 IMPROVE: Move .pbi output  into report channel

* 🐛FIX: Correct code after --rq option removal from command line module

- module main.nf: Remove ramaining rq input channel
- Test main.nf: Transfert rq into addParams
- Test test.yml: Update md5sums

* 🐛FIX: Repair additionnal option usage

* 👌 IMPROVE: Add some pacbio test files

* 🐛 FIX: Add Pacbio index to test_data.config

* 👌 IMPROVE: CCS is run in parallel with --chunk option

* 👌 IMPROVE: Add Pbindex in bam ouput channel

* 👌 IMPROVE: Change label to process_low

* 👌 IMPROVE: Define reports files names + add json version of txt report

* 🐛 FIX: Add missing backslashes

* 🐛 FIX: Add missing gz extension

* 🐛 FIX: update ouput channel

* 🐛 FIX: output file name

* 👌 IMPROVE: .gitignore

* 👌 IMPROVE: Update function.nf to last version

* 👌 IMPROVE: Update saveAs in main.nf

* 👌 IMPROVE: Add pbccs module

* 🐛 FIX: Fix Broken test

* 👌 IMPROVE: Update test_data.config

* 🐛 FIX: Fix test

* 👌 IMPROVE: Update path of test dataset files

* 👌 IMPROVE: Remove useless index + Fix Typos

* 📦 NEW: First commit of pbccs module

* 👌 IMPROVE: Remove option from command + rename output (ccs -> bam)

* 👌 IMPROVE: Move .pbi output  into report channel

* 🐛FIX: Correct code after --rq option removal from command line module

- module main.nf: Remove ramaining rq input channel
- Test main.nf: Transfert rq into addParams
- Test test.yml: Update md5sums

* 🐛FIX: Repair additionnal option usage

* 👌 IMPROVE: Add some pacbio test files

* 🐛 FIX: Add Pacbio index to test_data.config

* 👌 IMPROVE: CCS is run in parallel with --chunk option

* 👌 IMPROVE: Add Pbindex in bam ouput channel

* 👌 IMPROVE: Change label to process_low

* 👌 IMPROVE: Define reports files names + add json version of txt report

* 🐛 FIX: Add missing backslashes

* 🐛 FIX: Add missing gz extension

* 🐛 FIX: update ouput channel

* 🐛 FIX: output file name

* 👌 IMPROVE: .gitignore

* 👌 IMPROVE: Update function.nf to last version

* 👌 IMPROVE: Update saveAs in main.nf

* 👌 IMPROVE: Add pbccs module

* 🐛 FIX: Fix Broken test

* 👌 IMPROVE: Update test_data.config

* 🐛 FIX: Fix test

* 👌 IMPROVE: Update path of test dataset files

* 👌 IMPROVE: Remove useless index + Fix Typos

* 🐛 FIX: fill contains args

* 👌 IMPROVE: One output => One Channel

* 👌 IMPROVE: One input => One channel

* 🐛 FIX: Update tests

* 🐛 FIX: Remove TODOs from test.yaml

* 👌 IMPROVE: Revert and keep bam and pbi together

* 🐛 FIX: Remove old rq input from meta.yml

* 👌 IMPROVE: Update test to match input channels

* 👌 IMPROVE: use prefix for for output file name

* 👌 IMPROVE: Update to new versions.yml

* 👌 IMPROVE: Update pbccs from v6.0.0 to v6.0.2

* 👌 IMPROVE: Keep track of the former sample id in meta

* Update modules/pbccs/main.nf

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* 👌 IMPROVE: remove former_id from meta

* 👌 IMPROVE: Use chunk number in output filename

Co-authored-by: James A. Fellows Yates <jfy133@gmail.com>
Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>
2021-10-23 19:09:41 +01:00
Sébastien Guizard
d3369789da
New module: gstama/merge (#813)
* 👌 IMPROVE: Add some pacbio test files

* 🐛 FIX: Add Pacbio index to test_data.config

* 👌 IMPROVE: Re add 10000 data test

* 👌 IMPROVE: Add some pbindex

* 🐛 FIX: Add pbi extension to files

* 📦 NEW: Add galgal6 chr30 test data

* 📦 NEW: Add bamtools module

* 👌 IMPROVE: ignore test data

* 👌 IMPROVE : add test bed files

* 📦 NEW: Add gstama/merge module

* 🐛 FIX: Change process label

* 👌 IMPROVE: do not merge empty bed

* 🐛 FIX: Change 0 lines files detection

* 🐛 FIX: replace spaces by tab

* 🐛 FIX: Remove tuple for report channel and add version output channel

* 👌 IMPROVE: Update to last templates version

* 👌 IMPROVE: Update module to last template version

* 👌 IMPROVE: Final version of test datasets config

* 👌 IMPROVE: Update test

* 👌 IMPROVE: Remove useless index + Fix Typos

* 👌 IMPROVE: Fix Typos

* 👌 IMPROVE: Updates + clean code

- Update to last versions.yml file
- Better output channels
- Update meta.yml

* 👌 IMPROVE: Correct typo

* 👌 IMPROVE: Remove included filelist creation and add an input channel

* 🐛 FIX: Correct typo

* 👌 IMPROVE: Add filelist file

* 🐛 FIX: tama_merge.py emit a version number

* Update modules/gstama/merge/meta.yml

Co-authored-by: James A. Fellows Yates <jfy133@gmail.com>

* 👌 IMPROVE: Update meta.yml

* Update main.nf

* Apply suggestions from code review

Co-authored-by: James A. Fellows Yates <jfy133@gmail.com>
Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>
2021-10-23 19:00:39 +01:00
Sébastien Guizard
481d3c811d
New module: gstama/collapse (#809)
* 👌 IMPROVE: Add some pacbio test files

* 🐛 FIX: Add Pacbio index to test_data.config

* 👌 IMPROVE: Re add 10000 data test

* 👌 IMPROVE: Add some pbindex

* 🐛 FIX: Add pbi extension to files

* 📦 NEW: Add galgal6 chr30 test data

* 📦 NEW: Add gd-tama module

* 🐛 FIX (TEMP): Update singularity container address

* 📦 NEW: Add bamtools module

* 📦 NEW: Rewrite and rename module (gstama => gstama/collapse)

* 👌 IMPROVE: ignore test data

* 👌 IMPROVE: Remove junk files

* 👌 IMPROVE: Update output

* 👌 IMPROVE: Add channel for publishing tama's metadata outputs

* 👌 IMPROVE: Update process label

* 🐛 FIX: Use depot.galxyproject.org url for singularity

* 👌 IMPROVE: autoselect running mode

* 🐛 FIX: correct gstama collapse bash test

* 👌 IMPROVE: Update to last templates version

* 👌 IMPROVE: Update tama package and label

* 👌 IMPROVE: Final version of test datasets config

* 👌 IMPROVE: Remove useless index + Fix Typos

* 👌 IMPROVE: Update test

* 👌 IMPROVE: Add some pacbio test files

* 🐛 FIX: Add Pacbio index to test_data.config

* 👌 IMPROVE: Re add 10000 data test

* 👌 IMPROVE: Add some pbindex

* 🐛 FIX: Add pbi extension to files

* 📦 NEW: Add galgal6 chr30 test data

* 📦 NEW: Add gd-tama module

* 🐛 FIX (TEMP): Update singularity container address

* 📦 NEW: Add bamtools module

* 📦 NEW: Rewrite and rename module (gstama => gstama/collapse)

* 👌 IMPROVE: ignore test data

* 👌 IMPROVE: Update output

* 👌 IMPROVE: Add channel for publishing tama's metadata outputs

* 👌 IMPROVE: Update process label

* 🐛 FIX: Use depot.galxyproject.org url for singularity

* 👌 IMPROVE: autoselect running mode

* 🐛 FIX: correct gstama collapse bash test

* 👌 IMPROVE: Update to last templates version

* 👌 IMPROVE: Update tama package and label

* 👌 IMPROVE: Final version of test datasets config

* 👌 IMPROVE: Remove useless index + Fix Typos

* 👌 IMPROVE: Update test

* 👌 IMPROVE: delete unnecessary files

* 👌 IMPROVE: Update + clean

- Remove unnecessary files
- Update to new versions.yml file
- Better output channels

* 👌 IMPROVE: Update meta.yml and output channels

* 👌 IMPROVE: Remove useless files

* 👌 IMPROVE: Remove automatic MODE setup

* 👌 IMPROVE: Applied @jfy133 code modification suggestions

* Update modules/gstama/collapse/meta.yml

Co-authored-by: James A. Fellows Yates <jfy133@gmail.com>

* 🐛 FIX: Add missing fasta option in meta.yml

* 🐛 FIX: Fix typo

* 🐛 FIX: Update package version

* Update main.nf

* Update meta.yml

* Update modules/gstama/collapse/meta.yml

* Apply suggestions from code review

* Update tests/modules/gstama/collapse/main.nf

* Update main.nf

Co-authored-by: James A. Fellows Yates <jfy133@gmail.com>
Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>
2021-10-23 18:55:28 +01:00
GCJMackenzie
7676d9d728
Filtermutectcalls (#796)
* first commit with files for filtermutectcalls initialised

* found missing test file that needs to be resolved

* saving config changes

* fixing pytest_module conflict

* finished module, just needs repository side tests added

* test data added, versions file updated

* modified to emit correct versions file

* Update main.nf

* Update test_data.config

* updated test script

* fixed main.nf

* Update main.nf

* Update main.nf

* removed whitespace from test script

* Update test_data.config

* Update .gitignore

* Update test_data.config

* tests changed to new names, main script edited to match comments on learnreads pr

* Update meta.yml

* Apply suggestions from code review

* Update main.nf

* Apply suggestions from code review

* Apply suggestions from code review

* Update main.nf

* Update main.nf

* Update main.nf

* Update main.nf

Co-authored-by: GCJMackenzie <gavin.mackenzie@nibsc.org>
Co-authored-by: James A. Fellows Yates <jfy133@gmail.com>
Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>
2021-10-23 18:45:19 +01:00
Kevin
81ed0e0ff2
added meta.yml for umitools (#860)
* added meta.yml for umitools

* Update modules/umitools/dedup/meta.yml

type: list --> type: file

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* Update modules/umitools/dedup/meta.yml

aww thanks @drpateh :D

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* Update modules/umitools/dedup/meta.yml

module can only handle one BAM at a time, ergo

BAM files --> BAM file

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* Update meta.yml

added `pattern` for input `bam` and `bai`

* removed trailing whitespace to appease linter

* added license to new meta.yml files

* Apply suggestions from code review

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>
2021-10-23 17:30:10 +01:00
Kevin
3aacd46da2
Backfill software licenses meta (#876)
* backfilled modules with meta.yml that had no license identifier

* harmonized BSD license names

* whitespace linting at modules/unzip/meta.yml:12

* harmonized software from US NIH-NCBI/NIST to 'US-Government-Work'

* Update modules/bcftools/index/meta.yml

`bcftools` is dual-licensed, use associative array to allow for multiple licenses

Co-authored-by: Michael L Heuer <heuermh@acm.org>

Co-authored-by: Michael L Heuer <heuermh@acm.org>
2021-10-22 15:39:54 -07:00
Jose Espinosa-Carrasco
32f6191aca
New module: genrich (#877)
* Add genrich module

* Rearrange genrich module from genrich/genrich to genrich

* Remove copy/paste code

* Fix meta.yml

* Implement save_duplicates independently of -r opt
2021-10-22 12:22:02 +02:00
Benjamin Wingfield
4ed5e4eff3
New module: ucsc/liftover (#868)
* add liftOver module

* add liftover module tests

* fix getProcessName

* fix tests

* fix out of date function

* version numbers should be numeric

* drop versions.yml from test.yml

* Update modules/ucsc/liftover/main.nf

Remove software name variable

Co-authored-by: Jose Espinosa-Carrasco <kadomu@gmail.com>

* Update tests/modules/ucsc/liftover/main.nf

Use test chain file

Co-authored-by: Jose Espinosa-Carrasco <kadomu@gmail.com>

* add genome_chain_gz to test data config

* update md5sum for new chain test data

* Fix indentation in file declaration

Co-authored-by: Jose Espinosa-Carrasco <kadomu@gmail.com>
2021-10-21 18:04:15 +02:00
Chris Cheshire
4d89d6b2f0
I accidently deleted a branch before the PR merged for PR 800 (#881)
* hifiasm copied from fastqc

* hifiasm tests init from fastqc

* meta.yml init; test.yml and main.nf for printing version

* Add hifiasm version printing

* Removed spaced on an empty line

* Reverted hifiasm from main

* Updated seacr callpeak to include a control threshold

* Whitespace

Co-authored-by: Sviatoslav Sidorov <sviatoslav.sidorov@crick.ac.uk>
Co-authored-by: Svyatoslav Sidorov <svet.sidorov@gmail.com>
2021-10-21 12:28:59 +01:00
Jose Espinosa-Carrasco
b5fa91d0f7
Check only for file being generated (#879) 2021-10-21 11:32:05 +02:00
Maxime Borry
eb04a0f1f6
New module: freebayes (#818)
* add pydamage module

Co-authored-by: James A. Fellows Yates <jfy133@gmail.com>
2021-10-20 15:19:31 +02:00
James A. Fellows Yates
97fe899f79
fix: reduce number of required input files for damage profiler (#612)
* Reduce number of required input files for damage profiler

* Remove rebugging

* Add optional species list file.

* Working pending updated test-dataset update

* Add genome header to config
2021-10-20 10:02:30 +02:00
Harshil Patel
4e9e732b76
Add strelka/somatic module (#866)
* Add strelka/somatic module

* Fill out meta.yml properly
2021-10-18 22:34:23 +01:00
James A. Fellows Yates
cbfc8eb46c
Pydamage analyzer update (#863)
* Specify more guidelines on input channels

* Linting

* Updates based on code review

* Update README.md

* Fix broken sentence

* feat: add megahit module, currently decompressed output

* Update main.nf

* Update tests/modules/megahit/test.yml

Co-authored-by: Maxime Borry <maxibor@users.noreply.github.com>

* Apply suggestions from code review

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* feat: compress all outputs, remove md5sums due to gz stochasicity

* fix: wrong conda channel for pigz

* fix: broken singleend tests and update meta.yml

* Missed one

* Apply suggestions from code review

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* fix: pigz formatting

* Apply suggestions from code review

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* Apply suggestions from code review

* Update md5sum due to test-dataset update

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>
Co-authored-by: Maxime Borry <maxibor@users.noreply.github.com>
2021-10-18 15:24:49 +02:00
FriederikeHanssen
b6486ef8b4
Add compressed bed files (#864)
* add cram files to config

* Update tests/config/test_data.config

* Add compressed bed file

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>
2021-10-15 10:10:53 +01:00
FriederikeHanssen
d0e4ee3ccd
Add cram files to config (#862)
* add cram files to config

* Update tests/config/test_data.config

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>
2021-10-15 09:40:16 +01:00
Sébastien Guizard
1cf207a5b6
Update isoseq3/cluster (#856)
* 📦 NEW: Add isoseq3/cluster module

* 🐛FIX: Fix reports channel and add .pbi to it

* 🐛FIX: Fix report channel definition

* 👌IMPROVE: Move .pbi file into reports channel

* 👌IMPROVE: remove --use_qvs option from command line

* 👌 IMPROVE: Add in addParams removed options from command line

* 👌 IMPROVE: Add some pacbio test files

* 🐛 FIX: Add Pacbio index to test_data.config

* 👌 IMPROVE: Re add 10000 data test

* 👌 IMPROVE: Add some pbindex

* 🐛 FIX: Add pbi extension to files

* 👌 IMPROVE: The module accept one channel (primers moved into the first channel)

* 📦 NEW: Add galgal6 chr30 test data

* 📦 NEW: Add bamtools module

* 👌 IMPROVE: Ignore test data

* 👌 IMPROVE: Update to last templates version

* 👌 IMPROVE: Update to last templates version

* 👌 IMPROVE: add singletons parameter and improve outputs

* 🐛 FIX: Update test with last module model

* 👌 IMPROVE: Add test tag

* 👌 IMPROVE: Update module to last template version

* 👌 IMPROVE: Update module to last template version

* 👌 IMPROVE: Update test data config

* 👌 IMPROVE: Remove pbi from input files

* 👌 IMPROVE: Remove unused index

* 👌 IMPROVE: Final version of test datasets config

* 👌 IMPROVE: Final version of test datasets config

* 👌 IMPROVE: Remove useless index + Fix Typos

* 👌 IMPROVE: Remove useless index + Fix Typos

* 👌 IMPROVE: Fill contains args

* 📦 NEW: Add isoseq3/cluster module

* 🐛FIX: Fix reports channel and add .pbi to it

* 🐛FIX: Fix report channel definition

* 👌IMPROVE: Move .pbi file into reports channel

* 👌IMPROVE: remove --use_qvs option from command line

* 👌 IMPROVE: Add in addParams removed options from command line

* 👌 IMPROVE: Add some pacbio test files

* 🐛 FIX: Add Pacbio index to test_data.config

* 👌 IMPROVE: Re add 10000 data test

* 👌 IMPROVE: Add some pbindex

* 🐛 FIX: Add pbi extension to files

* 👌 IMPROVE: The module accept one channel (primers moved into the first channel)

* 👌 IMPROVE: Update to last templates version

* 👌 IMPROVE: add singletons parameter and improve outputs

* 🐛 FIX: Update test with last module model

* 👌 IMPROVE: Add test tag

* 👌 IMPROVE: Update test data config

* 👌 IMPROVE: Remove pbi from input files

* 👌 IMPROVE: Remove unused index

* 👌 IMPROVE: Final version of test datasets config

* 👌 IMPROVE: Remove useless index + Fix Typos

* 👌 IMPROVE: Fill contains args

* 👌 IMPROVE: Add some pacbio test files

* 🐛 FIX: Add Pacbio index to test_data.config

* 👌 IMPROVE: Re add 10000 data test

* 👌 IMPROVE: Add some pbindex

* 🐛 FIX: Add pbi extension to files

* 📦 NEW: Add galgal6 chr30 test data

* 📦 NEW: Add bamtools module

* 👌 IMPROVE: Ignore test data

* 👌 IMPROVE: Update to last templates version

* 👌 IMPROVE: Update module to last template version

* 👌 IMPROVE: Update module to last template version

* 👌 IMPROVE: Final version of test datasets config

* 👌 IMPROVE: Remove useless index + Fix Typos

* 👌 IMPROVE: Update code to new versions capture + better output channels

* 👌 IMPROVE: Update with new versions.yml file

* 🐛 FIX: Update meta.yml + correct typos

* 👌 IMPROVE: Clean output file names + correct typo

* 🐛 FIX: Remove bamtools/split module from isoseq3/cluster

* 🐛 FIX: Update output filename pattern

input filename and output filename were the same

* 👌 IMPROVE: Update meta.yml
2021-10-14 11:07:53 +01:00
Moritz E. Beber
c912117972
feat: add sub-workflow for SRA (#836)
* feat: add sub-workflow for SRA
* Combine prefetch and fasterq-dump into one sub-workflow
* tests: add sub-workflow to pytest config
2021-10-14 11:50:31 +02:00
Mei Wu
d1794d1934
Add TIDDIT cov (#822)
* added template for tiddit/cov

* test finished

* quick fix to meta info

* Apply suggestions from code review

Co-authored-by: James A. Fellows Yates <jfy133@gmail.com>

* applying suggestions

Co-authored-by: James A. Fellows Yates <jfy133@gmail.com>

Co-authored-by: James A. Fellows Yates <jfy133@gmail.com>
2021-10-13 12:59:35 +02:00
James A. Fellows Yates
7b1e84f7be
Add bcftools/index (#812)
* feat: add bcftools index

* Extend tests to also test gen for TBI

* Update meta.yml

* Update meta.yml
2021-10-13 10:40:04 +02:00
James A. Fellows Yates
359f721cc9
Add MEGAHIT (#810)
* Specify more guidelines on input channels

* Linting

* Updates based on code review

* Update README.md

* Fix broken sentence

* feat: add megahit module, currently decompressed output

* Update main.nf

* Update tests/modules/megahit/test.yml

Co-authored-by: Maxime Borry <maxibor@users.noreply.github.com>

* Apply suggestions from code review

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* feat: compress all outputs, remove md5sums due to gz stochasicity

* fix: wrong conda channel for pigz

* fix: broken singleend tests and update meta.yml

* Missed one

* Apply suggestions from code review

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* fix: pigz formatting

* Apply suggestions from code review

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* Apply suggestions from code review

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>
Co-authored-by: Maxime Borry <maxibor@users.noreply.github.com>
2021-10-12 16:06:06 +01:00
Moritz E. Beber
de997825de
Add a new module for fasterq-dump (#807)
* chore: use template to create fasterq module

* feat: add fasterq-dump process module

* docs: provide input and output descriptions

* docs: add comment on `--temp`

* fix: use correct variable

* tests: define test output

* refactor: address review comments

* refactor: remove vdb-config input

* chore: add new test data to config

* tests: define single-end and paired-end cases

* refactor: choose specific output

* tests: do not expect single FASTQ for paired-end

* feat: add compression

* Apply suggestions from code review

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* tests: revert the test data name

* Apply suggestions from code review

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>
2021-10-12 14:20:58 +01:00
Sébastien Guizard
3a4935d21b
New module: bamtools/split (#798)
* 👌 IMPROVE: Add some pacbio test files

* 🐛 FIX: Add Pacbio index to test_data.config

* 👌 IMPROVE: Re add 10000 data test

* 👌 IMPROVE: Add some pbindex

* 🐛 FIX: Add pbi extension to files

* 📦 NEW: Add galgal6 chr30 test data

* 📦 NEW: Add bamtools module

* 👌 IMPROVE: Ignore test data

* 👌 IMPROVE: Update to last templates version

* 👌 IMPROVE: Update module to last template version

* 👌 IMPROVE: Update module to last template version

* 👌 IMPROVE: Final version of test datasets config

* 👌 IMPROVE: Remove useless index + Fix Typos

* 👌 IMPROVE: Add some pacbio test files

* 🐛 FIX: Add Pacbio index to test_data.config

* 👌 IMPROVE: Re add 10000 data test

* 👌 IMPROVE: Add some pbindex

* 🐛 FIX: Add pbi extension to files

* 📦 NEW: Add galgal6 chr30 test data

* 📦 NEW: Add bamtools module

* 👌 IMPROVE: Ignore test data

* 👌 IMPROVE: Update to last templates version

* 👌 IMPROVE: Update module to last template version

* 👌 IMPROVE: Update module to last template version

* 👌 IMPROVE: Final version of test datasets config

* 👌 IMPROVE: Remove useless index + Fix Typos

* 👌 IMPROVE: Update with new versions.yml file

* 🐛 FIX: Update meta.yml + correct typos

* Update modules/bamtools/split/meta.yml

Add bam, split, chunk tags

Co-authored-by: James A. Fellows Yates <jfy133@gmail.com>

* 🐛 FIX: Correct meta.yml

Co-authored-by: James A. Fellows Yates <jfy133@gmail.com>
2021-10-12 14:43:08 +02:00
Moritz E. Beber
194e598a34
Fix workflow (#817)
* tests: fix tags definition

* fix: correct typo
2021-10-12 11:58:19 +01:00
Edmund Miller
d0df4b03e3
ci: Duplicate tests for subworkflows (#815)
Causing an issue with only running the subworkflow tests and now the
modules. Just for now, we can come back to this.
2021-10-12 08:14:20 +01:00
Moritz E. Beber
07c0830057
Add a module for sra-tools prefetch (#714)
* chore: apply module template

* refactor: add NCBI settings to options

* docs: complete meta information

* feat: add prefetch process

* fix: correct bash commands

* tests: define the right tests

* style: move option definition to satisfy linting

* fix: extract version correctly

* fix: correct newline issues

* refactor: address review comments

* Apply suggestions from code review

* chore: add retrying via nf-core label

* refactor: validate download thoroughly

* refactor: remove vdb-config input

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>
2021-10-11 22:30:41 +01:00
Edmund Miller
c19671dca9
Subworkflow Infrastructure (#662)
* feat(subworkflows): Add align_bowtie2 subworkflow

For testing CI setup

* test(align_bowtie2): Add initial list of changes to test

* test(align_bowtie2): Add initial test

* refactor: Use tags to run subworkflows ci

For every underlying module used by workflow and allow the modules
pytest-modules definition be the source of truth.

* refactor: Use individual directories for subworkflows

* docs(align_bowtie2): Add initial meta.yml

Copied most of it from the bowtie2/align module.

* fix(align_bowtie2): Fix module include paths

* test(bam_sort_samtools): Add initial test

* ci(bam_sort_samtools): Add modules that trigger the tag

* test(bam_stats_samtools): Add initial test

* ci(bam_stats_samtools): Add keys to pick up changes

* docs(bam_samtools): Add initial meta.yml

* test(align_bowtie2): Fix path to subworkflow

* test(align_bowtie2): Update entry point

* fix(bam_sort_samtools): Update include paths

* test(bam_sort_samtools): Fix path

* style: Clean up addParams

* test(samtools_sort): Add suffix for test

* test(align_bowtie2): Add samtools_options for suffix

* test(bam_stats_samtools): Update path

* test(bam_stats_samtools): Use stats input

Otherwise it's just an example of how it's used in the bam_sort_samtools subworkflow

* ci(linting): Skip module linting of subworkflows

* ci(linting): Clean up startsWith statement

* test(bam_stats_samtools): Use single end test data for single end test

* test(bam_stats_samtools): Add expected files

* test(align_bowtie2): Add paired-end test

* test(align_bowtie2): Sort order of output

* test(align_bowtie2): Update hashes

* docs(align_bowtie2): Fix typo

* test(align_bowtie2): Update samtools output names

* test(align_bowtie2): Remove md5sums for bam/bai

* feat(subworkflows): Add nextflow.configs

These can be used for default settings in the future. They can then be
included in the conf/modules.config so that the params don't have to be
duplicated in the root nextflow.config.

* docs(subworkflows): Include modules instead of tools

* fix: Update to versions

* chore(align_bowtie2): Remove duplicate tag

* style: Format yamls

* test(subworkflows): Only check versions for modules

* chore: Update subworkflows to match rnaseq dev

* fix(subworkflows): Update paths

* fix(bam_sort_samtools): Fix sort parameters for testing

* Apply suggestions from code review

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* docs: Update TODOs with a message

* ci: Try using a matrix for strategy

* ci: Try passing an array

* Revert "ci: Try passing an array"

This reverts commit d3611fcd8332bbb9a8501e8dd299d0a623aaecaa.

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>
2021-10-08 16:02:42 +01:00