Commit graph

764 commits

Author SHA1 Message Date
Matthias Hörtenhuber
b552958341
add paraclu (#909)
* add paraclu

* remove TODOs

* add min_cluster as input parameter, remove option parameters

* add tool_dev_url
2021-10-27 15:48:49 +02:00
Gisela Gabernet
f47c27edfb
Update checksum modules using human GTF (#900)
* update test yml star align

* update test yml stringtie merge

* update star genomegenerate yml

* update test yml rsem calculateexpression

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>
2021-10-26 23:09:04 +01:00
James A. Fellows Yates
bd2baa1e7c
New module: maxbin2 (#895)
* Specify more guidelines on input channels

* Linting

* Updates based on code review

* Update README.md

* Fix broken sentence

* feat: add megahit module, currently decompressed output

* Update main.nf

* Update tests/modules/megahit/test.yml

Co-authored-by: Maxime Borry <maxibor@users.noreply.github.com>

* Apply suggestions from code review

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* feat: compress all outputs, remove md5sums due to gz stochasicity

* fix: wrong conda channel for pigz

* fix: broken singleend tests and update meta.yml

* Missed one

* Apply suggestions from code review

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* fix: pigz formatting

* Apply suggestions from code review

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* Apply suggestions from code review

* Added, just need to finish tests once we have bacterial data

* Add prelim test data

* Fix version reporting

* Add tests based on proposed test-dataset

* Finalise new testdata

* Fix md5sum issue by removing it...

* Update main.nf

* Apply suggestions from code review

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>
Co-authored-by: Maxime Borry <maxibor@users.noreply.github.com>
2021-10-26 22:07:33 +01:00
James A. Fellows Yates
a740a6ff48
New module: checkm/lineagewf (#899)
* Specify more guidelines on input channels

* Linting

* Updates based on code review

* Update README.md

* Fix broken sentence

* feat: add megahit module, currently decompressed output

* Update main.nf

* Update tests/modules/megahit/test.yml

Co-authored-by: Maxime Borry <maxibor@users.noreply.github.com>

* Apply suggestions from code review

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* feat: compress all outputs, remove md5sums due to gz stochasicity

* fix: wrong conda channel for pigz

* fix: broken singleend tests and update meta.yml

* Missed one

* Apply suggestions from code review

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* fix: pigz formatting

* Apply suggestions from code review

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* Apply suggestions from code review

* Added but test failing due to null on output channel

* fix prefix variable

* Complete checkm_lineagewf

* Remove TODOs

* Add description of fasta_ext parameter

* Improve meta map for this context

* Update meta.yml

* Update modules/checkm/lineagewf/meta.yml

Co-authored-by: James A. Fellows Yates <jfy133@gmail.com>

* Update main.nf

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>
Co-authored-by: Maxime Borry <maxibor@users.noreply.github.com>
Co-authored-by: Daniel Lundin <erik.rikard.daniel@gmail.com>
2021-10-26 21:54:10 +01:00
Gregor Sturm
2ad98162f3
Notebook modules (#617)
* Draft rmarkdown module

* stub jupyter notebook module

* Create yaml file with params

* Update meta.yml for rmarkdown module

* Add comment on YAML

* Update notebooks module, clean up parametrize.nf

* Two separate channels for parameters and input files

* Fix Rmd render script

* Add tests for rmarkdown

* Fix tests for rmarkdown module

* Update checksums

* Fix tests for jupyter

* Test without Grab()

* Update software versions

* update rmarkdown dependencies

* Draft for multiple versions

* Fix indent of script

* Fix indent in rmarkdown script

* Emit version.syml

* Update modules/rmarkdown/main.nf

Co-authored-by: James A. Fellows Yates <jfy133@gmail.com>

* Update modules/rmarkdown/meta.yml

Co-authored-by: James A. Fellows Yates <jfy133@gmail.com>

* Update modules/rmarkdown/meta.yml

Co-authored-by: James A. Fellows Yates <jfy133@gmail.com>

* Rename rmarkdown to rmarkdownnotebook

* Add rmarkdown mulled biocontainer

* Write sessionInfo to separate log file

* Update rmarkdownnotebook

* Sessioninfo does not have a stable md5sum

* Update jupyternotebook

* Update meta

* Add jupyternotebook biocontainers

* Handle Groovy Gstrings in parameterize

* Update to versions.yml

* Update functions.nf

* Fix versions yaml

* Fix EC lint

* Update modules/rmarkdownnotebook/main.nf

Co-authored-by: James A. Fellows Yates <jfy133@gmail.com>

* Update modules/jupyternotebook/main.nf

Co-authored-by: James A. Fellows Yates <jfy133@gmail.com>

* Use official test data

* Harshilify

* Make parameters channel clearer

* Apply suggestions from code review

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* Apply suggestions from code review

* Update main.nf

Co-authored-by: James A. Fellows Yates <jfy133@gmail.com>
Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>
2021-10-24 20:51:56 +02:00
Sébastien Guizard
0a5ddd0ad0
Update module: bamtools/split (#885)
* 👌 IMPROVE: Add some pacbio test files

* 🐛 FIX: Add Pacbio index to test_data.config

* 👌 IMPROVE: Re add 10000 data test

* 👌 IMPROVE: Add some pbindex

* 🐛 FIX: Add pbi extension to files

* 📦 NEW: Add galgal6 chr30 test data

* 📦 NEW: Add bamtools module

* 👌 IMPROVE: Ignore test data

* 👌 IMPROVE: Update to last templates version

* 👌 IMPROVE: Update module to last template version

* 👌 IMPROVE: Update module to last template version

* 👌 IMPROVE: Final version of test datasets config

* 👌 IMPROVE: Remove useless index + Fix Typos

* 👌 IMPROVE: Add some pacbio test files

* 🐛 FIX: Add Pacbio index to test_data.config

* 👌 IMPROVE: Re add 10000 data test

* 👌 IMPROVE: Add some pbindex

* 🐛 FIX: Add pbi extension to files

* 📦 NEW: Add galgal6 chr30 test data

* 📦 NEW: Add bamtools module

* 👌 IMPROVE: Ignore test data

* 👌 IMPROVE: Update to last templates version

* 👌 IMPROVE: Update module to last template version

* 👌 IMPROVE: Update module to last template version

* 👌 IMPROVE: Final version of test datasets config

* 👌 IMPROVE: Remove useless index + Fix Typos

* 👌 IMPROVE: Update with new versions.yml file

* 🐛 FIX: Update meta.yml + correct typos

* Update modules/bamtools/split/meta.yml

Add bam, split, chunk tags

Co-authored-by: James A. Fellows Yates <jfy133@gmail.com>

* 🐛 FIX: Correct meta.yml

* 🐛 FIX: Grab software name using ${getSoftwareName(task.process)}

* 🐛 FIX: Update test.yml

Co-authored-by: James A. Fellows Yates <jfy133@gmail.com>
Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>
2021-10-23 19:39:27 +01:00
GCJMackenzie
3c8ca3fec4
Createsomaticpanelofnormals (#859)
* files created for createsompon, script written, meta written, still needs tests

* updated to 2.0.0 method input, however this requires a genomicsDB input now

* script finished, meta yaml updated. Tests working locally, test yaml made, needs genomicsdb example on nf-core to run repository tests

* versions updated, issue with test data not able to download directory

* updated tests to include repo-side data

* Apply suggestions from code review

* Update modules/gatk4/createsomaticpanelofnormals/main.nf

Co-authored-by: GCJMackenzie <gavin.mackenzie@nibsc.org>
Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>
2021-10-23 19:30:14 +01:00
Sébastien Guizard
8524e6b40f
Update of pbccs (#835)
* 📦 NEW: First commit of pbccs module

* 👌 IMPROVE: Remove option from command + rename output (ccs -> bam)

* 👌 IMPROVE: Move .pbi output  into report channel

* 🐛FIX: Correct code after --rq option removal from command line module

- module main.nf: Remove ramaining rq input channel
- Test main.nf: Transfert rq into addParams
- Test test.yml: Update md5sums

* 🐛FIX: Repair additionnal option usage

* 👌 IMPROVE: Add some pacbio test files

* 🐛 FIX: Add Pacbio index to test_data.config

* 👌 IMPROVE: CCS is run in parallel with --chunk option

* 👌 IMPROVE: Add Pbindex in bam ouput channel

* 👌 IMPROVE: Change label to process_low

* 👌 IMPROVE: Define reports files names + add json version of txt report

* 🐛 FIX: Add missing backslashes

* 🐛 FIX: Add missing gz extension

* 🐛 FIX: update ouput channel

* 🐛 FIX: output file name

* 👌 IMPROVE: .gitignore

* 👌 IMPROVE: Update function.nf to last version

* 👌 IMPROVE: Update saveAs in main.nf

* 👌 IMPROVE: Add pbccs module

* 🐛 FIX: Fix Broken test

* 👌 IMPROVE: Update test_data.config

* 🐛 FIX: Fix test

* 👌 IMPROVE: Update path of test dataset files

* 👌 IMPROVE: Remove useless index + Fix Typos

* 📦 NEW: First commit of pbccs module

* 👌 IMPROVE: Remove option from command + rename output (ccs -> bam)

* 👌 IMPROVE: Move .pbi output  into report channel

* 🐛FIX: Correct code after --rq option removal from command line module

- module main.nf: Remove ramaining rq input channel
- Test main.nf: Transfert rq into addParams
- Test test.yml: Update md5sums

* 🐛FIX: Repair additionnal option usage

* 👌 IMPROVE: Add some pacbio test files

* 🐛 FIX: Add Pacbio index to test_data.config

* 👌 IMPROVE: CCS is run in parallel with --chunk option

* 👌 IMPROVE: Add Pbindex in bam ouput channel

* 👌 IMPROVE: Change label to process_low

* 👌 IMPROVE: Define reports files names + add json version of txt report

* 🐛 FIX: Add missing backslashes

* 🐛 FIX: Add missing gz extension

* 🐛 FIX: update ouput channel

* 🐛 FIX: output file name

* 👌 IMPROVE: .gitignore

* 👌 IMPROVE: Update function.nf to last version

* 👌 IMPROVE: Update saveAs in main.nf

* 👌 IMPROVE: Add pbccs module

* 🐛 FIX: Fix Broken test

* 👌 IMPROVE: Update test_data.config

* 🐛 FIX: Fix test

* 👌 IMPROVE: Update path of test dataset files

* 👌 IMPROVE: Remove useless index + Fix Typos

* 🐛 FIX: fill contains args

* 👌 IMPROVE: One output => One Channel

* 👌 IMPROVE: One input => One channel

* 🐛 FIX: Update tests

* 🐛 FIX: Remove TODOs from test.yaml

* 👌 IMPROVE: Revert and keep bam and pbi together

* 🐛 FIX: Remove old rq input from meta.yml

* 👌 IMPROVE: Update test to match input channels

* 👌 IMPROVE: use prefix for for output file name

* 👌 IMPROVE: Update to new versions.yml

* 👌 IMPROVE: Update pbccs from v6.0.0 to v6.0.2

* 👌 IMPROVE: Keep track of the former sample id in meta

* Update modules/pbccs/main.nf

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* 👌 IMPROVE: remove former_id from meta

* 👌 IMPROVE: Use chunk number in output filename

Co-authored-by: James A. Fellows Yates <jfy133@gmail.com>
Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>
2021-10-23 19:09:41 +01:00
Sébastien Guizard
d3369789da
New module: gstama/merge (#813)
* 👌 IMPROVE: Add some pacbio test files

* 🐛 FIX: Add Pacbio index to test_data.config

* 👌 IMPROVE: Re add 10000 data test

* 👌 IMPROVE: Add some pbindex

* 🐛 FIX: Add pbi extension to files

* 📦 NEW: Add galgal6 chr30 test data

* 📦 NEW: Add bamtools module

* 👌 IMPROVE: ignore test data

* 👌 IMPROVE : add test bed files

* 📦 NEW: Add gstama/merge module

* 🐛 FIX: Change process label

* 👌 IMPROVE: do not merge empty bed

* 🐛 FIX: Change 0 lines files detection

* 🐛 FIX: replace spaces by tab

* 🐛 FIX: Remove tuple for report channel and add version output channel

* 👌 IMPROVE: Update to last templates version

* 👌 IMPROVE: Update module to last template version

* 👌 IMPROVE: Final version of test datasets config

* 👌 IMPROVE: Update test

* 👌 IMPROVE: Remove useless index + Fix Typos

* 👌 IMPROVE: Fix Typos

* 👌 IMPROVE: Updates + clean code

- Update to last versions.yml file
- Better output channels
- Update meta.yml

* 👌 IMPROVE: Correct typo

* 👌 IMPROVE: Remove included filelist creation and add an input channel

* 🐛 FIX: Correct typo

* 👌 IMPROVE: Add filelist file

* 🐛 FIX: tama_merge.py emit a version number

* Update modules/gstama/merge/meta.yml

Co-authored-by: James A. Fellows Yates <jfy133@gmail.com>

* 👌 IMPROVE: Update meta.yml

* Update main.nf

* Apply suggestions from code review

Co-authored-by: James A. Fellows Yates <jfy133@gmail.com>
Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>
2021-10-23 19:00:39 +01:00
Sébastien Guizard
481d3c811d
New module: gstama/collapse (#809)
* 👌 IMPROVE: Add some pacbio test files

* 🐛 FIX: Add Pacbio index to test_data.config

* 👌 IMPROVE: Re add 10000 data test

* 👌 IMPROVE: Add some pbindex

* 🐛 FIX: Add pbi extension to files

* 📦 NEW: Add galgal6 chr30 test data

* 📦 NEW: Add gd-tama module

* 🐛 FIX (TEMP): Update singularity container address

* 📦 NEW: Add bamtools module

* 📦 NEW: Rewrite and rename module (gstama => gstama/collapse)

* 👌 IMPROVE: ignore test data

* 👌 IMPROVE: Remove junk files

* 👌 IMPROVE: Update output

* 👌 IMPROVE: Add channel for publishing tama's metadata outputs

* 👌 IMPROVE: Update process label

* 🐛 FIX: Use depot.galxyproject.org url for singularity

* 👌 IMPROVE: autoselect running mode

* 🐛 FIX: correct gstama collapse bash test

* 👌 IMPROVE: Update to last templates version

* 👌 IMPROVE: Update tama package and label

* 👌 IMPROVE: Final version of test datasets config

* 👌 IMPROVE: Remove useless index + Fix Typos

* 👌 IMPROVE: Update test

* 👌 IMPROVE: Add some pacbio test files

* 🐛 FIX: Add Pacbio index to test_data.config

* 👌 IMPROVE: Re add 10000 data test

* 👌 IMPROVE: Add some pbindex

* 🐛 FIX: Add pbi extension to files

* 📦 NEW: Add galgal6 chr30 test data

* 📦 NEW: Add gd-tama module

* 🐛 FIX (TEMP): Update singularity container address

* 📦 NEW: Add bamtools module

* 📦 NEW: Rewrite and rename module (gstama => gstama/collapse)

* 👌 IMPROVE: ignore test data

* 👌 IMPROVE: Update output

* 👌 IMPROVE: Add channel for publishing tama's metadata outputs

* 👌 IMPROVE: Update process label

* 🐛 FIX: Use depot.galxyproject.org url for singularity

* 👌 IMPROVE: autoselect running mode

* 🐛 FIX: correct gstama collapse bash test

* 👌 IMPROVE: Update to last templates version

* 👌 IMPROVE: Update tama package and label

* 👌 IMPROVE: Final version of test datasets config

* 👌 IMPROVE: Remove useless index + Fix Typos

* 👌 IMPROVE: Update test

* 👌 IMPROVE: delete unnecessary files

* 👌 IMPROVE: Update + clean

- Remove unnecessary files
- Update to new versions.yml file
- Better output channels

* 👌 IMPROVE: Update meta.yml and output channels

* 👌 IMPROVE: Remove useless files

* 👌 IMPROVE: Remove automatic MODE setup

* 👌 IMPROVE: Applied @jfy133 code modification suggestions

* Update modules/gstama/collapse/meta.yml

Co-authored-by: James A. Fellows Yates <jfy133@gmail.com>

* 🐛 FIX: Add missing fasta option in meta.yml

* 🐛 FIX: Fix typo

* 🐛 FIX: Update package version

* Update main.nf

* Update meta.yml

* Update modules/gstama/collapse/meta.yml

* Apply suggestions from code review

* Update tests/modules/gstama/collapse/main.nf

* Update main.nf

Co-authored-by: James A. Fellows Yates <jfy133@gmail.com>
Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>
2021-10-23 18:55:28 +01:00
GCJMackenzie
7676d9d728
Filtermutectcalls (#796)
* first commit with files for filtermutectcalls initialised

* found missing test file that needs to be resolved

* saving config changes

* fixing pytest_module conflict

* finished module, just needs repository side tests added

* test data added, versions file updated

* modified to emit correct versions file

* Update main.nf

* Update test_data.config

* updated test script

* fixed main.nf

* Update main.nf

* Update main.nf

* removed whitespace from test script

* Update test_data.config

* Update .gitignore

* Update test_data.config

* tests changed to new names, main script edited to match comments on learnreads pr

* Update meta.yml

* Apply suggestions from code review

* Update main.nf

* Apply suggestions from code review

* Apply suggestions from code review

* Update main.nf

* Update main.nf

* Update main.nf

* Update main.nf

Co-authored-by: GCJMackenzie <gavin.mackenzie@nibsc.org>
Co-authored-by: James A. Fellows Yates <jfy133@gmail.com>
Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>
2021-10-23 18:45:19 +01:00
Jose Espinosa-Carrasco
32f6191aca
New module: genrich (#877)
* Add genrich module

* Rearrange genrich module from genrich/genrich to genrich

* Remove copy/paste code

* Fix meta.yml

* Implement save_duplicates independently of -r opt
2021-10-22 12:22:02 +02:00
Benjamin Wingfield
4ed5e4eff3
New module: ucsc/liftover (#868)
* add liftOver module

* add liftover module tests

* fix getProcessName

* fix tests

* fix out of date function

* version numbers should be numeric

* drop versions.yml from test.yml

* Update modules/ucsc/liftover/main.nf

Remove software name variable

Co-authored-by: Jose Espinosa-Carrasco <kadomu@gmail.com>

* Update tests/modules/ucsc/liftover/main.nf

Use test chain file

Co-authored-by: Jose Espinosa-Carrasco <kadomu@gmail.com>

* add genome_chain_gz to test data config

* update md5sum for new chain test data

* Fix indentation in file declaration

Co-authored-by: Jose Espinosa-Carrasco <kadomu@gmail.com>
2021-10-21 18:04:15 +02:00
Chris Cheshire
4d89d6b2f0
I accidently deleted a branch before the PR merged for PR 800 (#881)
* hifiasm copied from fastqc

* hifiasm tests init from fastqc

* meta.yml init; test.yml and main.nf for printing version

* Add hifiasm version printing

* Removed spaced on an empty line

* Reverted hifiasm from main

* Updated seacr callpeak to include a control threshold

* Whitespace

Co-authored-by: Sviatoslav Sidorov <sviatoslav.sidorov@crick.ac.uk>
Co-authored-by: Svyatoslav Sidorov <svet.sidorov@gmail.com>
2021-10-21 12:28:59 +01:00
Jose Espinosa-Carrasco
b5fa91d0f7
Check only for file being generated (#879) 2021-10-21 11:32:05 +02:00
Maxime Borry
eb04a0f1f6
New module: freebayes (#818)
* add pydamage module

Co-authored-by: James A. Fellows Yates <jfy133@gmail.com>
2021-10-20 15:19:31 +02:00
James A. Fellows Yates
97fe899f79
fix: reduce number of required input files for damage profiler (#612)
* Reduce number of required input files for damage profiler

* Remove rebugging

* Add optional species list file.

* Working pending updated test-dataset update

* Add genome header to config
2021-10-20 10:02:30 +02:00
Harshil Patel
4e9e732b76
Add strelka/somatic module (#866)
* Add strelka/somatic module

* Fill out meta.yml properly
2021-10-18 22:34:23 +01:00
James A. Fellows Yates
cbfc8eb46c
Pydamage analyzer update (#863)
* Specify more guidelines on input channels

* Linting

* Updates based on code review

* Update README.md

* Fix broken sentence

* feat: add megahit module, currently decompressed output

* Update main.nf

* Update tests/modules/megahit/test.yml

Co-authored-by: Maxime Borry <maxibor@users.noreply.github.com>

* Apply suggestions from code review

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* feat: compress all outputs, remove md5sums due to gz stochasicity

* fix: wrong conda channel for pigz

* fix: broken singleend tests and update meta.yml

* Missed one

* Apply suggestions from code review

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* fix: pigz formatting

* Apply suggestions from code review

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* Apply suggestions from code review

* Update md5sum due to test-dataset update

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>
Co-authored-by: Maxime Borry <maxibor@users.noreply.github.com>
2021-10-18 15:24:49 +02:00
FriederikeHanssen
b6486ef8b4
Add compressed bed files (#864)
* add cram files to config

* Update tests/config/test_data.config

* Add compressed bed file

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>
2021-10-15 10:10:53 +01:00
FriederikeHanssen
d0e4ee3ccd
Add cram files to config (#862)
* add cram files to config

* Update tests/config/test_data.config

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>
2021-10-15 09:40:16 +01:00
Sébastien Guizard
1cf207a5b6
Update isoseq3/cluster (#856)
* 📦 NEW: Add isoseq3/cluster module

* 🐛FIX: Fix reports channel and add .pbi to it

* 🐛FIX: Fix report channel definition

* 👌IMPROVE: Move .pbi file into reports channel

* 👌IMPROVE: remove --use_qvs option from command line

* 👌 IMPROVE: Add in addParams removed options from command line

* 👌 IMPROVE: Add some pacbio test files

* 🐛 FIX: Add Pacbio index to test_data.config

* 👌 IMPROVE: Re add 10000 data test

* 👌 IMPROVE: Add some pbindex

* 🐛 FIX: Add pbi extension to files

* 👌 IMPROVE: The module accept one channel (primers moved into the first channel)

* 📦 NEW: Add galgal6 chr30 test data

* 📦 NEW: Add bamtools module

* 👌 IMPROVE: Ignore test data

* 👌 IMPROVE: Update to last templates version

* 👌 IMPROVE: Update to last templates version

* 👌 IMPROVE: add singletons parameter and improve outputs

* 🐛 FIX: Update test with last module model

* 👌 IMPROVE: Add test tag

* 👌 IMPROVE: Update module to last template version

* 👌 IMPROVE: Update module to last template version

* 👌 IMPROVE: Update test data config

* 👌 IMPROVE: Remove pbi from input files

* 👌 IMPROVE: Remove unused index

* 👌 IMPROVE: Final version of test datasets config

* 👌 IMPROVE: Final version of test datasets config

* 👌 IMPROVE: Remove useless index + Fix Typos

* 👌 IMPROVE: Remove useless index + Fix Typos

* 👌 IMPROVE: Fill contains args

* 📦 NEW: Add isoseq3/cluster module

* 🐛FIX: Fix reports channel and add .pbi to it

* 🐛FIX: Fix report channel definition

* 👌IMPROVE: Move .pbi file into reports channel

* 👌IMPROVE: remove --use_qvs option from command line

* 👌 IMPROVE: Add in addParams removed options from command line

* 👌 IMPROVE: Add some pacbio test files

* 🐛 FIX: Add Pacbio index to test_data.config

* 👌 IMPROVE: Re add 10000 data test

* 👌 IMPROVE: Add some pbindex

* 🐛 FIX: Add pbi extension to files

* 👌 IMPROVE: The module accept one channel (primers moved into the first channel)

* 👌 IMPROVE: Update to last templates version

* 👌 IMPROVE: add singletons parameter and improve outputs

* 🐛 FIX: Update test with last module model

* 👌 IMPROVE: Add test tag

* 👌 IMPROVE: Update test data config

* 👌 IMPROVE: Remove pbi from input files

* 👌 IMPROVE: Remove unused index

* 👌 IMPROVE: Final version of test datasets config

* 👌 IMPROVE: Remove useless index + Fix Typos

* 👌 IMPROVE: Fill contains args

* 👌 IMPROVE: Add some pacbio test files

* 🐛 FIX: Add Pacbio index to test_data.config

* 👌 IMPROVE: Re add 10000 data test

* 👌 IMPROVE: Add some pbindex

* 🐛 FIX: Add pbi extension to files

* 📦 NEW: Add galgal6 chr30 test data

* 📦 NEW: Add bamtools module

* 👌 IMPROVE: Ignore test data

* 👌 IMPROVE: Update to last templates version

* 👌 IMPROVE: Update module to last template version

* 👌 IMPROVE: Update module to last template version

* 👌 IMPROVE: Final version of test datasets config

* 👌 IMPROVE: Remove useless index + Fix Typos

* 👌 IMPROVE: Update code to new versions capture + better output channels

* 👌 IMPROVE: Update with new versions.yml file

* 🐛 FIX: Update meta.yml + correct typos

* 👌 IMPROVE: Clean output file names + correct typo

* 🐛 FIX: Remove bamtools/split module from isoseq3/cluster

* 🐛 FIX: Update output filename pattern

input filename and output filename were the same

* 👌 IMPROVE: Update meta.yml
2021-10-14 11:07:53 +01:00
Moritz E. Beber
c912117972
feat: add sub-workflow for SRA (#836)
* feat: add sub-workflow for SRA
* Combine prefetch and fasterq-dump into one sub-workflow
* tests: add sub-workflow to pytest config
2021-10-14 11:50:31 +02:00
Mei Wu
d1794d1934
Add TIDDIT cov (#822)
* added template for tiddit/cov

* test finished

* quick fix to meta info

* Apply suggestions from code review

Co-authored-by: James A. Fellows Yates <jfy133@gmail.com>

* applying suggestions

Co-authored-by: James A. Fellows Yates <jfy133@gmail.com>

Co-authored-by: James A. Fellows Yates <jfy133@gmail.com>
2021-10-13 12:59:35 +02:00
James A. Fellows Yates
7b1e84f7be
Add bcftools/index (#812)
* feat: add bcftools index

* Extend tests to also test gen for TBI

* Update meta.yml

* Update meta.yml
2021-10-13 10:40:04 +02:00
James A. Fellows Yates
359f721cc9
Add MEGAHIT (#810)
* Specify more guidelines on input channels

* Linting

* Updates based on code review

* Update README.md

* Fix broken sentence

* feat: add megahit module, currently decompressed output

* Update main.nf

* Update tests/modules/megahit/test.yml

Co-authored-by: Maxime Borry <maxibor@users.noreply.github.com>

* Apply suggestions from code review

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* feat: compress all outputs, remove md5sums due to gz stochasicity

* fix: wrong conda channel for pigz

* fix: broken singleend tests and update meta.yml

* Missed one

* Apply suggestions from code review

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* fix: pigz formatting

* Apply suggestions from code review

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* Apply suggestions from code review

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>
Co-authored-by: Maxime Borry <maxibor@users.noreply.github.com>
2021-10-12 16:06:06 +01:00
Moritz E. Beber
de997825de
Add a new module for fasterq-dump (#807)
* chore: use template to create fasterq module

* feat: add fasterq-dump process module

* docs: provide input and output descriptions

* docs: add comment on `--temp`

* fix: use correct variable

* tests: define test output

* refactor: address review comments

* refactor: remove vdb-config input

* chore: add new test data to config

* tests: define single-end and paired-end cases

* refactor: choose specific output

* tests: do not expect single FASTQ for paired-end

* feat: add compression

* Apply suggestions from code review

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* tests: revert the test data name

* Apply suggestions from code review

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>
2021-10-12 14:20:58 +01:00
Sébastien Guizard
3a4935d21b
New module: bamtools/split (#798)
* 👌 IMPROVE: Add some pacbio test files

* 🐛 FIX: Add Pacbio index to test_data.config

* 👌 IMPROVE: Re add 10000 data test

* 👌 IMPROVE: Add some pbindex

* 🐛 FIX: Add pbi extension to files

* 📦 NEW: Add galgal6 chr30 test data

* 📦 NEW: Add bamtools module

* 👌 IMPROVE: Ignore test data

* 👌 IMPROVE: Update to last templates version

* 👌 IMPROVE: Update module to last template version

* 👌 IMPROVE: Update module to last template version

* 👌 IMPROVE: Final version of test datasets config

* 👌 IMPROVE: Remove useless index + Fix Typos

* 👌 IMPROVE: Add some pacbio test files

* 🐛 FIX: Add Pacbio index to test_data.config

* 👌 IMPROVE: Re add 10000 data test

* 👌 IMPROVE: Add some pbindex

* 🐛 FIX: Add pbi extension to files

* 📦 NEW: Add galgal6 chr30 test data

* 📦 NEW: Add bamtools module

* 👌 IMPROVE: Ignore test data

* 👌 IMPROVE: Update to last templates version

* 👌 IMPROVE: Update module to last template version

* 👌 IMPROVE: Update module to last template version

* 👌 IMPROVE: Final version of test datasets config

* 👌 IMPROVE: Remove useless index + Fix Typos

* 👌 IMPROVE: Update with new versions.yml file

* 🐛 FIX: Update meta.yml + correct typos

* Update modules/bamtools/split/meta.yml

Add bam, split, chunk tags

Co-authored-by: James A. Fellows Yates <jfy133@gmail.com>

* 🐛 FIX: Correct meta.yml

Co-authored-by: James A. Fellows Yates <jfy133@gmail.com>
2021-10-12 14:43:08 +02:00
Moritz E. Beber
07c0830057
Add a module for sra-tools prefetch (#714)
* chore: apply module template

* refactor: add NCBI settings to options

* docs: complete meta information

* feat: add prefetch process

* fix: correct bash commands

* tests: define the right tests

* style: move option definition to satisfy linting

* fix: extract version correctly

* fix: correct newline issues

* refactor: address review comments

* Apply suggestions from code review

* chore: add retrying via nf-core label

* refactor: validate download thoroughly

* refactor: remove vdb-config input

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>
2021-10-11 22:30:41 +01:00
Edmund Miller
c19671dca9
Subworkflow Infrastructure (#662)
* feat(subworkflows): Add align_bowtie2 subworkflow

For testing CI setup

* test(align_bowtie2): Add initial list of changes to test

* test(align_bowtie2): Add initial test

* refactor: Use tags to run subworkflows ci

For every underlying module used by workflow and allow the modules
pytest-modules definition be the source of truth.

* refactor: Use individual directories for subworkflows

* docs(align_bowtie2): Add initial meta.yml

Copied most of it from the bowtie2/align module.

* fix(align_bowtie2): Fix module include paths

* test(bam_sort_samtools): Add initial test

* ci(bam_sort_samtools): Add modules that trigger the tag

* test(bam_stats_samtools): Add initial test

* ci(bam_stats_samtools): Add keys to pick up changes

* docs(bam_samtools): Add initial meta.yml

* test(align_bowtie2): Fix path to subworkflow

* test(align_bowtie2): Update entry point

* fix(bam_sort_samtools): Update include paths

* test(bam_sort_samtools): Fix path

* style: Clean up addParams

* test(samtools_sort): Add suffix for test

* test(align_bowtie2): Add samtools_options for suffix

* test(bam_stats_samtools): Update path

* test(bam_stats_samtools): Use stats input

Otherwise it's just an example of how it's used in the bam_sort_samtools subworkflow

* ci(linting): Skip module linting of subworkflows

* ci(linting): Clean up startsWith statement

* test(bam_stats_samtools): Use single end test data for single end test

* test(bam_stats_samtools): Add expected files

* test(align_bowtie2): Add paired-end test

* test(align_bowtie2): Sort order of output

* test(align_bowtie2): Update hashes

* docs(align_bowtie2): Fix typo

* test(align_bowtie2): Update samtools output names

* test(align_bowtie2): Remove md5sums for bam/bai

* feat(subworkflows): Add nextflow.configs

These can be used for default settings in the future. They can then be
included in the conf/modules.config so that the params don't have to be
duplicated in the root nextflow.config.

* docs(subworkflows): Include modules instead of tools

* fix: Update to versions

* chore(align_bowtie2): Remove duplicate tag

* style: Format yamls

* test(subworkflows): Only check versions for modules

* chore: Update subworkflows to match rnaseq dev

* fix(subworkflows): Update paths

* fix(bam_sort_samtools): Fix sort parameters for testing

* Apply suggestions from code review

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* docs: Update TODOs with a message

* ci: Try using a matrix for strategy

* ci: Try passing an array

* Revert "ci: Try passing an array"

This reverts commit d3611fcd8332bbb9a8501e8dd299d0a623aaecaa.

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>
2021-10-08 16:02:42 +01:00
GCJMackenzie
f479d4fb8d
Learnreadorientationmodel (#794)
* files for learnreadorientationmodel initialised for first commit

* finished scripts and yml files. test working locally but needs an f1r2 test data on nf-core before it can be submitted

* updated test data location

* versions file updated, test data added

* updated versions file, edited test file

* small formatting update to main.nf

* Update main.nf

* Update test_data.config

* updated tests main.nf

* Update test_data.config

* Apply suggestions from code review

* Update modules/gatk4/learnreadorientationmodel/main.nf

* Update modules/gatk4/learnreadorientationmodel/meta.yml

* fixed tests failing

Co-authored-by: GCJMackenzie <gavin.mackenzie@nibsc.org>
Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>
2021-10-07 13:55:06 +01:00
Sébastien Guizard
5a49d2c1bf
New module: isoseq3/cluster (#801)
* 📦 NEW: Add isoseq3/cluster module

* 🐛FIX: Fix reports channel and add .pbi to it

* 🐛FIX: Fix report channel definition

* 👌IMPROVE: Move .pbi file into reports channel

* 👌IMPROVE: remove --use_qvs option from command line

* 👌 IMPROVE: Add in addParams removed options from command line

* 👌 IMPROVE: Add some pacbio test files

* 🐛 FIX: Add Pacbio index to test_data.config

* 👌 IMPROVE: Re add 10000 data test

* 👌 IMPROVE: Add some pbindex

* 🐛 FIX: Add pbi extension to files

* 👌 IMPROVE: The module accept one channel (primers moved into the first channel)

* 📦 NEW: Add galgal6 chr30 test data

* 📦 NEW: Add bamtools module

* 👌 IMPROVE: Ignore test data

* 👌 IMPROVE: Update to last templates version

* 👌 IMPROVE: Update to last templates version

* 👌 IMPROVE: add singletons parameter and improve outputs

* 🐛 FIX: Update test with last module model

* 👌 IMPROVE: Add test tag

* 👌 IMPROVE: Update module to last template version

* 👌 IMPROVE: Update module to last template version

* 👌 IMPROVE: Update test data config

* 👌 IMPROVE: Remove pbi from input files

* 👌 IMPROVE: Remove unused index

* 👌 IMPROVE: Final version of test datasets config

* 👌 IMPROVE: Final version of test datasets config

* 👌 IMPROVE: Remove useless index + Fix Typos

* 👌 IMPROVE: Remove useless index + Fix Typos

* 👌 IMPROVE: Fill contains args

* 📦 NEW: Add isoseq3/cluster module

* 🐛FIX: Fix reports channel and add .pbi to it

* 🐛FIX: Fix report channel definition

* 👌IMPROVE: Move .pbi file into reports channel

* 👌IMPROVE: remove --use_qvs option from command line

* 👌 IMPROVE: Add in addParams removed options from command line

* 👌 IMPROVE: Add some pacbio test files

* 🐛 FIX: Add Pacbio index to test_data.config

* 👌 IMPROVE: Re add 10000 data test

* 👌 IMPROVE: Add some pbindex

* 🐛 FIX: Add pbi extension to files

* 👌 IMPROVE: The module accept one channel (primers moved into the first channel)

* 👌 IMPROVE: Update to last templates version

* 👌 IMPROVE: add singletons parameter and improve outputs

* 🐛 FIX: Update test with last module model

* 👌 IMPROVE: Add test tag

* 👌 IMPROVE: Update test data config

* 👌 IMPROVE: Remove pbi from input files

* 👌 IMPROVE: Remove unused index

* 👌 IMPROVE: Final version of test datasets config

* 👌 IMPROVE: Remove useless index + Fix Typos

* 👌 IMPROVE: Fill contains args

* 👌 IMPROVE: Add some pacbio test files

* 🐛 FIX: Add Pacbio index to test_data.config

* 👌 IMPROVE: Re add 10000 data test

* 👌 IMPROVE: Add some pbindex

* 🐛 FIX: Add pbi extension to files

* 📦 NEW: Add galgal6 chr30 test data

* 📦 NEW: Add bamtools module

* 👌 IMPROVE: Ignore test data

* 👌 IMPROVE: Update to last templates version

* 👌 IMPROVE: Update module to last template version

* 👌 IMPROVE: Update module to last template version

* 👌 IMPROVE: Final version of test datasets config

* 👌 IMPROVE: Remove useless index + Fix Typos

* 👌 IMPROVE: Update code to new versions capture + better output channels

* 👌 IMPROVE: Update with new versions.yml file

* 🐛 FIX: Update meta.yml + correct typos

* 👌 IMPROVE: Clean output file names + correct typo

* 🐛 FIX: Remove bamtools/split module from isoseq3/cluster
2021-10-07 10:06:02 +01:00
Sébastien Guizard
79d38a306b
New module: isoseq3/refine (#748)
* 📦 NEW: Add isoseq3/refine module

* 👌 IMPROVE: Add some pacbio test files

* 🐛 FIX: Add Pacbio index to test_data.config

* 👌 IMPROVE: Re add 10000 data test

* 👌 IMPROVE: Add parallelization

* 🐛 FIX: Correct Typo

* 👌 IMPROVE: Add some pbindex

* 🐛 FIX: Add pbi extension to files

* 👌 IMPROVE: The module accept one channel (primers moved into the first channel)

* 👌 IMPROVE: Assign a value channel to primers input 

Improve workflow code readability

* 👌 IMPROVE: Update to the version of templates

* 👌 IMPROVE: Update module to last template version

* 👌 IMPROVE: Remove pbi from input files

* 👌 IMPROVE: Update test file

* 👌 IMPROVE: Final version of test datasets config

* 👌 IMPROVE: Remove useless index + Fix Typos

* 👌 IMPROVE: Fill contains args

* 📦 NEW: Add isoseq3/refine module

* 👌 IMPROVE: Add parallelization

* 🐛 FIX: Correct Typo

* 👌 IMPROVE: Add some pacbio test files

* 🐛 FIX: Add Pacbio index to test_data.config

* 👌 IMPROVE: Re add 10000 data test

* 👌 IMPROVE: Add some pbindex

* 🐛 FIX: Add pbi extension to files

* 👌 IMPROVE: The module accept one channel (primers moved into the first channel)

* 👌 IMPROVE: Assign a value channel to primers input 

Improve workflow code readability

* 👌 IMPROVE: Update to the version of templates

* 👌 IMPROVE: Update module to last template version

* 👌 IMPROVE: Remove pbi from input files

* 👌 IMPROVE: Update test file

* 👌 IMPROVE: Final version of test datasets config

* 👌 IMPROVE: Remove useless index + Fix Typos

* 👌 IMPROVE: Fill contains args

* 👌 IMPROVE: Add one channel per output file

* 👌 IMPROVE: Minor updates

* 👌 IMPROVE: Minors Update

- Remove TODO from test.yml
- Remove useless piece of code

* 📦 NEW: Add isoseq3/refine module

* 👌 IMPROVE: Add parallelization

* 🐛 FIX: Correct Typo

* 👌 IMPROVE: Add some pacbio test files

* 🐛 FIX: Add Pacbio index to test_data.config

* 👌 IMPROVE: Re add 10000 data test

* 👌 IMPROVE: Add some pbindex

* 🐛 FIX: Add pbi extension to files

* 👌 IMPROVE: The module accept one channel (primers moved into the first channel)

* 👌 IMPROVE: Assign a value channel to primers input 

Improve workflow code readability

* 👌 IMPROVE: Update to the version of templates

* 👌 IMPROVE: Update module to last template version

* 👌 IMPROVE: Remove pbi from input files

* 👌 IMPROVE: Update test file

* 👌 IMPROVE: Fill contains args

* 📦 NEW: Add isoseq3/refine module

* 👌 IMPROVE: Add parallelization

* 🐛 FIX: Correct Typo

* 👌 IMPROVE: Add some pacbio test files

* 🐛 FIX: Add Pacbio index to test_data.config

* 👌 IMPROVE: Re add 10000 data test

* 👌 IMPROVE: Add some pbindex

* 🐛 FIX: Add pbi extension to files

* 👌 IMPROVE: The module accept one channel (primers moved into the first channel)

* 👌 IMPROVE: Assign a value channel to primers input 

Improve workflow code readability

* 👌 IMPROVE: Update to the version of templates

* 👌 IMPROVE: Update module to last template version

* 👌 IMPROVE: Remove pbi from input files

* 👌 IMPROVE: Update test file

* 👌 IMPROVE: Add one channel per output file

* 👌 IMPROVE: Minor updates

* 👌 IMPROVE: Minors Update

- Remove TODO from test.yml
- Remove useless piece of code

* 🐛 FIX: Remove unwanted files

* 🐛 FIX: Protect \

* 🐛 FIX: Remove test files

* Apply suggestions from code review

* Apply suggestions from code review

* Update tests/modules/isoseq3/refine/test.yml

Co-authored-by: Gregor Sturm <mail@gregor-sturm.de>
Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>
2021-10-06 11:13:48 +01:00
Jose Espinosa-Carrasco
84f2302920
Correct parsing versions with trailing zeros (#795)
* Correct parsing versions with trailing zeros

* Fix test

* Update modules/custom/dumpsoftwareversions/main.nf

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* Fix tests and go back to output versions.yml

* Update tests/test_versions_yml.py to use BaseLoader

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>
Co-authored-by: Gregor Sturm <mail@gregor-sturm.de>
2021-10-06 08:16:36 +02:00
Sébastien Guizard
bcf2681b03
New module: pbbam/pbmerge (#752)
* 👌 IMPROVE: Add some pacbio test files

* 📦 NEW: Add pbbam/pbmerge module

* 🐛 FIX: Add optional arguments to command line

* 👌 IMPROVE: Update to last templates version

* 👌 IMPROVE: Update module to last template version

* 👌 IMPROVE: Update test data config and test script

* 👌 IMPROVE: Remove useless index + Fix Typos

* 👌 IMPROVE: Add some pacbio test files

* 📦 NEW: Add pbbam/pbmerge module

* 🐛 FIX: Add optional arguments to command line

* 👌 IMPROVE: Update to last templates version

* 👌 IMPROVE: Update module to last template version

* 👌 IMPROVE: Update test data config and test script

* 👌 IMPROVE: Remove useless index + Fix Typos

* 👌 IMPROVE: Update and clean code

* 🐛 FIX: Update module path in test

* 🐛 FIX: Add missing () + correct module path in test

* 👌 IMPROVE: Update pbmerge from version 1.6.0 to 1.7.0

* 👌 IMPROVE: Change output filename suffix for something more generic

* 🐛 Update test.yml

* Apply suggestions from code review

* Update tests/modules/pbbam/pbmerge/test.yml

* Update tests/modules/pbbam/pbmerge/main.nf

Co-authored-by: Gregor Sturm <mail@gregor-sturm.de>
Co-authored-by: Robert A. Petit III <robbie.petit@gmail.com>
Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>
2021-10-05 23:16:45 +01:00
GCJMackenzie
aa32a8a72e
new module: gatk4/calculatecontamination (#778)
* initiated files for calculate contamination

* pushing local repo to remote

* created script, filled in meta yml, created tests and test yml. local checks passing, needs repo side test data

* added option and tests for outputting optional segmentation file

* saving for test push

* versions updated, test data added

* Update main.nf

* fixed versions info, should report correctly now

* small update to main.nf outputs formatting

* Apply suggestions from code review

* Update test_data.config

* Apply suggestions from code review

Co-authored-by: GCJMackenzie <gavin.mackenzie@nibsc.org>
Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>
2021-10-05 22:52:00 +01:00
Robert A. Petit III
053797510d
add pirate module (#777)
* new module pirate

* remove md5 check for non reproducible binary files

* get those to-dos out

* Update main.nf

* Update meta.yml

* Apply suggestions from code review

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>
2021-10-05 22:28:25 +01:00
Robert A. Petit III
e77b3d72f3
add spatyper module (#784)
* add spatyper module

* lint fix

* Apply suggestions from code review

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>
2021-10-05 22:21:35 +01:00
Robert A. Petit III
0ba88fb869
add roary module (#776)
* add module roary

* Update meta.yml

* Update meta.yml

* Update meta.yml

* Update meta.yml

* Update main.nf

* Update meta.yml

* Apply suggestions from code review

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>
2021-10-05 22:08:47 +01:00
Robert A. Petit III
8d04c34934
add ismapper module (#773)
* add ismapper module

* Update main.nf

* Update main.nf

* Update meta.yml

* Apply suggestions from code review

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>
2021-10-05 21:55:41 +01:00
Robert A. Petit III
8179bab819
add csvtk/concat module (#785)
* add csvtk/concat module

* Update modules/csvtk/concat/main.nf

Co-authored-by: Gregor Sturm <mail@gregor-sturm.de>

* allow alternate delimiters

* Update main.nf

* Update modules/csvtk/concat/main.nf

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* Update modules/csvtk/concat/main.nf

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* Update modules/csvtk/concat/main.nf

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* Update modules/csvtk/concat/main.nf

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* Update modules/csvtk/concat/main.nf

* Apply suggestions from code review

Co-authored-by: Gregor Sturm <mail@gregor-sturm.de>
Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>
2021-10-05 21:48:47 +01:00
Robert A. Petit III
bb7beff497
add hicap module (#772)
* add hicap module

* add info on optional inputs

* fix typo

* Update meta.yml

* Update main.nf

* Update meta.yml

* Update modules/hicap/main.nf

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* Update modules/hicap/main.nf

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>
2021-10-05 21:42:09 +01:00
Robert A. Petit III
7d98bf1d7d
add mashtree module (#767)
* add mashtree module

* remove todo

* whitespace adjustment

* remove un-reproducible md5sum

* Update main.nf

* Update main.nf

* Update meta.yml

* Apply suggestions from code review

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>
2021-10-05 21:27:30 +01:00
Abhinav Sharma
3868c3ab4b
Add gtdbtk/classifywf module (#765)
* initial commit [ci skip]

* reuse the modules code from nf-core/mag [ci skip]

* add contextual information for the module [ci skip]

* add stubs to avoid downloading db [ci skip]

* trigger test

* iterate on tests [ci skip]

* itereate tests [ci skip]

* add bins [ci skip]

* fix stubs [ci skip]

* interation on tests with stubs [ci skip]

* use the existing pattern and fasta for input

* accomodate the new version file format

* use variable for the stub [ci skip]

* update the versions file in meta.yml

* Accomodate code review regarding publishDir function [ci skip]

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* remove extra newline

* use bioconda channel

* update the description for filtered file

* Apply suggestions from code review

* Update main.nf

* Update main.nf

* Update modules/gtdbtk/classifywf/meta.yml

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

Co-authored-by: Robert A. Petit III <robbie.petit@gmail.com>
Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>
2021-10-05 21:23:01 +01:00
Lee Katz
f20c427339
added classic mlst module (#742)
* added classic mlst module

* removed nf-core TODO comments

* included drpatelh suggestions

* adjust version capture identation

* update main to pass lint

* follow output expected by test.yml

* suggested prefix change from rpetit3

* Apply suggestions from code review

Co-authored-by: Gregor Sturm <mail@gregor-sturm.de>
Co-authored-by: Robert A. Petit III <robbie.petit@gmail.com>
Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>
2021-10-05 20:49:46 +01:00
Jose Espinosa-Carrasco
5b1cea7f7f
Add bbmap/bbsplit module (#771)
* Add bbmap/bbsplit module

* Conda complains about md5sum

* Apply suggestions from code review

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>
2021-09-30 13:37:35 +01:00
James A. Fellows Yates
01cc326c23
add Amps (#768)
* Specify more guidelines on input channels

* Linting

* Updates based on code review

* Update README.md

* Fix broken sentence

* Start work, continue once on non-mobile internet

* finished and working on conda

* Update modules/amps/main.nf

Co-authored-by: Jose Espinosa-Carrasco <kadomu@gmail.com>

* Apply suggestions from code review

Co-authored-by: Jose Espinosa-Carrasco <kadomu@gmail.com>

Co-authored-by: Jose Espinosa-Carrasco <kadomu@gmail.com>
2021-09-30 12:54:16 +02:00
Harshil Patel
b2c2d4deb4
Add custom/dumpsoftwareversions modules for nf-core pipeline template (#761)
* Add custom/dumpsoftwareversions modules for nf-core pipeline template

* Remove md5sums due to differing NF versions
2021-09-29 14:27:00 +01:00
Harshil Patel
b932210f27
Fix flash and cat/fastq modules (#759)
* Fix version commands: round 3

* Fix seqkit/split2 modules

* Fix flash and cat/fastq modules

* Remove md5sums on gz files
2021-09-28 21:14:11 +01:00
Robert A. Petit III
5c463ca6b4
few version and test data config fixes (#758)
* update kleborate version info

* fix stderr capture

* few more version fixes

* fix version info on more tools
2021-09-28 20:42:04 +01:00
Gregor Sturm
c3687ef54b
fix more ver yml (#757)
* Fix featurecounts

* whitespace change to trigger CI on yara/mapper

* update test yaml
2021-09-28 20:25:10 +01:00
Jose Espinosa-Carrasco
cde1d827f9
Fix yml ver (#756)
* Fix kallisto index tests

* Fix nanoplot

* Fix kallistobustools

* Fix pairix

* Fix plasmidid

* Fix pbccs

* Fix raxmlng

* Fix prokka

* Fix shovill

* Fix typo

* Deleted workflow by mistake added again
2021-09-28 18:33:07 +02:00
Gregor Sturm
512f5dfc27
Better error message for FileNotFoundErrors (#755)
* Better error message for FileNotFoundErrors

* Update tests/test_versions_yml.py

Co-authored-by: James A. Fellows Yates <jfy133@gmail.com>

* Update test_versions_yml.py

Co-authored-by: James A. Fellows Yates <jfy133@gmail.com>
2021-09-28 16:51:35 +02:00
Harshil Patel
9c31cf1566
Fix version commands: round 3 (#754)
* Fix version commands: round 3

* Fix seqkit/split2 modules
2021-09-28 14:37:47 +01:00
James A. Fellows Yates
e971f538a9
Module new version reporting fixes (#753)
* Specify more guidelines on input channels

* Linting

* Updates based on code review

* Update README.md

* Fix broken sentence

* Fix IQ tree

* Fix picard markdup and merge sam

* Fix plink/vcf version

* Fix plink version output

* Fix prokka version command

* Fix pydamage

* Try fixing markduplicates

* Fix snpEff

* Fix vcftools version

* Fix pydamage and filtersamreads test run

* Fix MarkDuplicates tests

* Add missing unsorted checks

* Remove MD5 sym due to stochasicity in BAM file
2021-09-28 10:51:19 +01:00
Harshil Patel
3c5492b4a3
Fix more version commands (#750)
* Fix outstanding tests

* Fix more version commands

* Fix remaining modules
2021-09-28 06:56:27 +01:00
Harshil Patel
43c2779258
Fix version commands (#749)
* Fix version commands

* Fix version commands: again
2021-09-27 22:10:37 +01:00
Sébastien Guizard
4ec8b025bd
New module: LIMA (#719)
* 📦 NEW: Add module lima

* 👌 IMPROVE: Move .pbi output to reports channel

* 🐛 FIX: Fix report channel definition

* 👌IMPROVE; Remove options from command line

update test script with removed options

* 👌 IMPROVE: Add some pacbio test files

* 🐛 FIX: Add Pacbio index to test_data.config

* 👌 IMPROVE: Re add 10000 data test

* 🐛 FIX: Add pbi input

* 👌 IMPROVE: Add parallelization to lima

* 👌 IMPROVE: Add some pbindex

* 🐛 FIX: Add pbi extension to files

* 👌 IMPROVE: The accept one channel (primers move into the first channel)

* 👌 IMPROVE: Assign a value channel for pimers 

Improve code workflow readability

* 👌 IMPROVE: Update .gitignore

* 👌 IMPROVE: Update module to last template version

* 🐛 FIX: Correct Singularity and Docker URL

* 👌 IMPROVE: Update to the last version of modules template

* 👌 IMPROVE: Update test_data.config

* 👌 IMPROVE: Remove pbi from input files

* 👌 IMPROVE: Final version of test datasets config

* 👌 IMPROVE: Remove useless index + Fix Typos

* 🐛 FIX: Fill contains args

* 📦 NEW: Add module lima

* 👌 IMPROVE: Move .pbi output to reports channel

* 🐛 FIX: Fix report channel definition

* 👌IMPROVE; Remove options from command line

update test script with removed options

* 🐛 FIX: Add pbi input

* 👌 IMPROVE: Add parallelization to lima

* 👌 IMPROVE: Add some pacbio test files

* 🐛 FIX: Add Pacbio index to test_data.config

* 👌 IMPROVE: Re add 10000 data test

* 👌 IMPROVE: Add some pbindex

* 🐛 FIX: Add pbi extension to files

* 👌 IMPROVE: The accept one channel (primers move into the first channel)

* 👌 IMPROVE: Assign a value channel for pimers 

Improve code workflow readability

* 👌 IMPROVE: Update .gitignore

* 👌 IMPROVE: Update module to last template version

* 🐛 FIX: Correct Singularity and Docker URL

* 👌 IMPROVE: Update to the last version of modules template

* 👌 IMPROVE: Update test_data.config

* 👌 IMPROVE: Remove pbi from input files

* 👌 IMPROVE: Final version of test datasets config

* 👌 IMPROVE: Remove useless index + Fix Typos

* 🐛 FIX: Fill contains args

* 👌 IMPROVE: Add channel for each output

* 👌 IMPROVE: Remove comments

* 📦 NEW: Add module lima

* 👌 IMPROVE: Move .pbi output to reports channel

* 🐛 FIX: Fix report channel definition

* 👌IMPROVE; Remove options from command line

update test script with removed options

* 🐛 FIX: Add pbi input

* 👌 IMPROVE: Add parallelization to lima

* 👌 IMPROVE: Add some pacbio test files

* 🐛 FIX: Add Pacbio index to test_data.config

* 👌 IMPROVE: Re add 10000 data test

* 👌 IMPROVE: Add some pbindex

* 🐛 FIX: Add pbi extension to files

* 👌 IMPROVE: The accept one channel (primers move into the first channel)

* 👌 IMPROVE: Assign a value channel for pimers 

Improve code workflow readability

* 👌 IMPROVE: Update module to last template version

* 🐛 FIX: Correct Singularity and Docker URL

* 👌 IMPROVE: Update to the last version of modules template

* 👌 IMPROVE: Update test_data.config

* 👌 IMPROVE: Remove pbi from input files

* 🐛 FIX: Fill contains args

* 📦 NEW: Add module lima

* 👌 IMPROVE: Move .pbi output to reports channel

* 🐛 FIX: Fix report channel definition

* 👌IMPROVE; Remove options from command line

update test script with removed options

* 🐛 FIX: Add pbi input

* 👌 IMPROVE: Add parallelization to lima

* 👌 IMPROVE: Add some pacbio test files

* 🐛 FIX: Add Pacbio index to test_data.config

* 👌 IMPROVE: Re add 10000 data test

* 👌 IMPROVE: Add some pbindex

* 🐛 FIX: Add pbi extension to files

* 👌 IMPROVE: The accept one channel (primers move into the first channel)

* 👌 IMPROVE: Assign a value channel for pimers 

Improve code workflow readability

* 👌 IMPROVE: Update module to last template version

* 🐛 FIX: Correct Singularity and Docker URL

* 👌 IMPROVE: Update to the last version of modules template

* 👌 IMPROVE: Update test_data.config

* 👌 IMPROVE: Remove pbi from input files

* 👌 IMPROVE: Final version of test datasets config

* 👌 IMPROVE: Remove useless index + Fix Typos

* 🐛 FIX: Fill contains args

* 👌 IMPROVE: Add channel for each output

* 👌 IMPROVE: Remove comments

* 🐛 FIX: Clean test_data.config

* Update modules/lima/main.nf

Add meta to each output

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* Update modules/lima/main.nf

Remove useless parenthesis

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* 🐛 FIX: Keep version number only

* 🐛 FIX: Reintegrate prefix variable and use it to define output file name

* 👌 IMPROVE: add suffix arg to check output files names

* 👌 IMPROVE: Use prefix for output filename

* 🐛 FIX: Set optional output

Allow usage of different input formats

* 👌 IMPROVE: Update meta file

* 👌 IMPROVE: Update test

One test for each input file type

* 👌 IMPROVE: add fasta, fastq.gz, fastq, fastq.gz test files

* 👌 IMPROVE: Update with last templates / Follow new version.yaml rule

* 🐛 FIX: Fix typos and include getProcessName function

* 👌 IMPROVE: Update .gitignore

* 👌 IMPROVE: Using suffix to manage output was not a my best idea

Add a bash code to detect extension and update output file name

* 👌 IMPROVE: clean code

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>
Co-authored-by: Gregor Sturm <mail@gregor-sturm.de>
Co-authored-by: Mahesh Binzer-Panchal <mahesh.binzer-panchal@nbis.se>
2021-09-27 16:14:35 +01:00
Gregor Sturm
d73a988ff7
Cover case when processes have been imported under different name (#744)
Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>
2021-09-27 09:40:50 +01:00
Gregor Sturm
ab67a1d41b
Update fastqc to produce multi-version versions.yml (#665)
* Update fastqc to produce multi-version versions.yml

* Update readme and pull request template

* Fix markdownlint

* remove  variable

* Change publish dir to lowercase

* Re-add getSoftwareName

* Add custom pytest-workflow test to ensure versions.yml is valid

* Add docstring

* Remove __init__.py as it is not needed

* Remove changes to README, since this part went to nf-co.re

* Add NF_CORE_TEST env var

* Fix editorconfig

* Add additional consistency checks for versions.yml

* Update multiqc module

* Fix output channel
2021-09-24 10:01:54 +01:00
Stephen Ficklin
ca53f7525b
Diamond (#710)
* Added diamond

* minor tweaks & yml fix

* Fixed spacing issues due to failing lint

* Update modules/diamond/blastp/main.nf

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* Update modules/diamond/blastp/main.nf

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* Update modules/diamond/blastp/main.nf

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* Update modules/diamond/blastp/main.nf

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* Update modules/diamond/blastp/main.nf

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* Update modules/diamond/blastx/main.nf

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* Update modules/diamond/blastx/main.nf

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* Update modules/diamond/blastx/main.nf

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* Update modules/diamond/blastx/main.nf

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* Update modules/diamond/makedb/main.nf

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* Update modules/diamond/makedb/main.nf

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* Update tests/modules/diamond/blastp/main.nf

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* Update tests/modules/diamond/blastx/main.nf

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* Update tests/modules/diamond/blastx/main.nf

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* Update tests/modules/diamond/blastp/main.nf

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* Update modules/diamond/blastp/meta.yml

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>
2021-09-23 09:13:04 +01:00
Ramprasad Neethiraj
25943a4c23
Add glnexus (#729)
* Add glnexus

* Fix lint error

* Refactor

* Suggested changes

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>
2021-09-22 13:31:01 +01:00
James A. Fellows Yates
5758e9f451
Unzip update (#730)
* Specify more guidelines on input channels

* Linting

* Updates based on code review

* Update README.md

* Fix broken sentence

* Change test dataset
2021-09-22 11:02:32 +01:00
Abhinav Sharma
77a2895785
Add module kleborate (#711)
* initial commit [ci skip]

* remove todo from the module files [ci skip]

* add a sample test case [ci skip]

* push the latest work [ci skip]

* bump kleborate build

* test passing with the new build for kleborate [ci skip]

* ready for review

* Apply suggestions from code review

Co-authored-by: Robert A. Petit III <robbie.petit@gmail.com>
Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>
2021-09-21 20:45:42 +01:00
Abhinav Sharma
0d53a34eed
module fastani (#695)
* initiate agrvate module

* remove todos [ci skip]

* initiate fastani draft [ci skip]

* clean stubs [ci skip]

* interim commit [ci skip]

* accomodate the batch/per-sample processing [ci skip]

* use the meta map [ci skip]

* run first test [ci skip]

* remove extra spaces [ci skip]

* change output file name [ci skip]

* update the expected output [ci skip]

* update the files used for test [ci skip]

* fix typo [ci skip]

* test passing [ci skip]

* update the description

* remove extra files

* accomodate CR suggestions [ci skip]

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* accomodate CR suggestions [ci skip]

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* accomodate CR suggestions [ci skip]

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* use meta map for batch analysis

* fix the tests

* rely upon tuples

* Apply suggestions from code review

* Update main.nf

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>
2021-09-21 20:20:26 +01:00
James A. Fellows Yates
7830a4a80c
add: MALTEXTRACT (#725)
* Specify more guidelines on input channels

* Linting

* Updates based on code review

* Update README.md

* Fix broken sentence

* Start maltextract module

* start tests

* Get tests working now we have test data

* Apply suggestions from code review

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* Changes after review

* Update tests/modules/maltextract/main.nf

Co-authored-by: Jose Espinosa-Carrasco <kadomu@gmail.com>

* Update tests/modules/maltextract/main.nf

Co-authored-by: Jose Espinosa-Carrasco <kadomu@gmail.com>

* Update tests/modules/maltextract/main.nf

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>
Co-authored-by: Jose Espinosa-Carrasco <kadomu@gmail.com>
2021-09-21 19:57:27 +01:00
Harshil Patel
1d6f47ce54
Refactor cat/cat module (#723)
* Refactor cat/cat module

* Change gzip terminology
2021-09-21 11:17:00 +01:00
Daniel Lundin
b32c46c6a2
CAT CAT (#722)
* bbmap/align done

* Tests for single end and prebuilt index

* Write bam file directly

* Forgot to use all cpus for bbmap

* Test md5sums

* Added pigz support

* Update modules/bbmap/align/meta.yml

Co-authored-by: James A. Fellows Yates <jfy133@gmail.com>

* process_medium and fastq

* cat/cat module

* Remove filter from CAT_CAT

Co-authored-by: James A. Fellows Yates <jfy133@gmail.com>
Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>
2021-09-20 21:02:22 +01:00
Michael L Heuer
60d8bd7c04
Update pangolin to 3.1.11 (#721)
* Update pangolin to 3.1.11.

* Update md5sum for test.pangolin.csv.
2021-09-20 19:59:05 +01:00
Daniel Lundin
97b803a8a7
Module to map reads with BBMap (#717) 2021-09-20 11:27:34 +02:00
GCJMackenzie
3c4eaec52b
Update for mutect2: add output channel for stats file (#716)
* added output channel for stats file, updated meta yml with description and test yml with check for stats file

* Update modules/gatk4/mutect2/main.nf

Co-authored-by: GCJMackenzie <gavin.mackenzie@nibsc.org>
Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>
2021-09-17 09:56:56 +01:00
Maxime Borry
7e45cbf4d1
Add PyDamage filter (#713)
* add pydamage module

* remove TODOs

* split module by subcommands

* update version parsing

* remove forgotten TODOs

* update module names

* remove old holistic module

* Update modules/pydamage/analyze/main.nf

Co-authored-by: James A. Fellows Yates <jfy133@gmail.com>

* add keywords

* update resource requirement

* Update modules/pydamage/filter/main.nf

Co-authored-by: James A. Fellows Yates <jfy133@gmail.com>

* Update modules/pydamage/filter/meta.yml

Co-authored-by: James A. Fellows Yates <jfy133@gmail.com>

Co-authored-by: James A. Fellows Yates <jfy133@gmail.com>
2021-09-16 15:05:49 +02:00
Maxime Borry
d9dfbe9d9d
Add pydamage analyze module (#705)
* add pydamage module

* remove TODOs

* split module by subcommands

* update version parsing

* remove forgotten TODOs

* update module names

* remove old holistic module

* Update modules/pydamage/analyze/main.nf

Co-authored-by: James A. Fellows Yates <jfy133@gmail.com>

* add keywords

* simplify PR to analyze subcommand

Co-authored-by: James A. Fellows Yates <jfy133@gmail.com>
2021-09-16 14:03:51 +02:00
Sébastien Guizard
bbf268c5d3
new module: pbccs (#688)
* 📦 NEW: First commit of pbccs module

* 👌 IMPROVE: Remove option from command + rename output (ccs -> bam)

* 👌 IMPROVE: Move .pbi output  into report channel

* 🐛FIX: Correct code after --rq option removal from command line module

- module main.nf: Remove ramaining rq input channel
- Test main.nf: Transfert rq into addParams
- Test test.yml: Update md5sums

* 🐛FIX: Repair additionnal option usage

* 👌 IMPROVE: Add some pacbio test files

* 🐛 FIX: Add Pacbio index to test_data.config

* 👌 IMPROVE: CCS is run in parallel with --chunk option

* 👌 IMPROVE: Add Pbindex in bam ouput channel

* 👌 IMPROVE: Change label to process_low

* 👌 IMPROVE: Define reports files names + add json version of txt report

* 🐛 FIX: Add missing backslashes

* 🐛 FIX: Add missing gz extension

* 🐛 FIX: update ouput channel

* 🐛 FIX: output file name

* 👌 IMPROVE: .gitignore

* 👌 IMPROVE: Update function.nf to last version

* 👌 IMPROVE: Update saveAs in main.nf

* 👌 IMPROVE: Add pbccs module

* 🐛 FIX: Fix Broken test

* 👌 IMPROVE: Update test_data.config

* 🐛 FIX: Fix test

* 👌 IMPROVE: Update path of test dataset files

* 👌 IMPROVE: Remove useless index + Fix Typos

* 📦 NEW: First commit of pbccs module

* 👌 IMPROVE: Remove option from command + rename output (ccs -> bam)

* 👌 IMPROVE: Move .pbi output  into report channel

* 🐛FIX: Correct code after --rq option removal from command line module

- module main.nf: Remove ramaining rq input channel
- Test main.nf: Transfert rq into addParams
- Test test.yml: Update md5sums

* 🐛FIX: Repair additionnal option usage

* 👌 IMPROVE: Add some pacbio test files

* 🐛 FIX: Add Pacbio index to test_data.config

* 👌 IMPROVE: CCS is run in parallel with --chunk option

* 👌 IMPROVE: Add Pbindex in bam ouput channel

* 👌 IMPROVE: Change label to process_low

* 👌 IMPROVE: Define reports files names + add json version of txt report

* 🐛 FIX: Add missing backslashes

* 🐛 FIX: Add missing gz extension

* 🐛 FIX: update ouput channel

* 🐛 FIX: output file name

* 👌 IMPROVE: .gitignore

* 👌 IMPROVE: Update function.nf to last version

* 👌 IMPROVE: Update saveAs in main.nf

* 👌 IMPROVE: Add pbccs module

* 🐛 FIX: Fix Broken test

* 👌 IMPROVE: Update test_data.config

* 🐛 FIX: Fix test

* 👌 IMPROVE: Update path of test dataset files

* 👌 IMPROVE: Remove useless index + Fix Typos

* 🐛 FIX: fill contains args

* 👌 IMPROVE: One output => One Channel

* 👌 IMPROVE: One input => One channel

* 🐛 FIX: Update tests

* 🐛 FIX: Remove TODOs from test.yaml

* 👌 IMPROVE: Revert and keep bam and pbi together

* 🐛 FIX: Remove old rq input from meta.yml

* 👌 IMPROVE: Update test to match input channels

Co-authored-by: James A. Fellows Yates <jfy133@gmail.com>
2021-09-16 11:48:18 +01:00
Abhinav Sharma
1840289068
module for agrvate (#693)
* initiate agrvate module

* remove todos [ci skip]

* remove todos and fix containers [ci skip]

* ready for testing


Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>
2021-09-16 12:42:23 +02:00
José Fernández Navarro
e9c57083a0
Fix bug in gffread (#686)
* Fix bug in gffread that would cause it to fail if the input has .gtf as extension

* Update test.yml

* Update meta file

* Update main.nf

* Apply suggestions from code review

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>
2021-09-15 19:55:08 +01:00
Robert A. Petit III
073bbf1b26
add staphopia-sccmec module (#702)
* add staphopia-sccmec module

* add additional test

* change output name

* Update main.nf

* Update test.yml

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>
2021-09-15 17:24:11 +01:00
Mahesh Binzer-Panchal
58134cb929
Chromap Module (#659)
* Initialise chromap module

* Revert "Initialise chromap module"

This reverts commit 47c67ae231a6f221ef5b9b7b444b583b5406852b.

* Remake chromap base files with new layout

* Copy chromap

* Copy index

* Add compression

* Update padding

* Update container

* Update chromap input test data

* Add chromap chromap tests

* Add padding

* Update comment

* update yaml file

* Remove TODOs

* Add fasta input to yaml

* Update YAML

* Remove comment, update container

* Remove comments

* Import Chromap index

* Update test.yml

* Fix read input

* Update test.yml

* Add bcftools/concat module. (#641)

* draft for bcftools modules [ci skip]

* initial test for bcftools concat

* Update the params for testing

* fix tests

* Accomodate code review [ci skip]

Co-authored-by: James A. Fellows Yates <jfy133@gmail.com>

* Update the meta file and open PR for review

* Update the keyword

* Update the tags for module [ci skip[

* add threads

Co-authored-by: James A. Fellows Yates <jfy133@gmail.com>

* add module for dragonflye (#633)

* add module for dragonflye

* fix tests for dragonflye

* Update test.yml

* Update meta.yml

* Update main.nf

* Update main.nf

* Update modules/dragonflye/meta.yml

Co-authored-by: Gregor Sturm <mail@gregor-sturm.de>

* update typos. change quote from ' to ". (#652)

* Add bcftools/norm module (#655)

* Initial draft [ci skip]

* trigger first test

* update output file path

* Tests passing

* finishing touches for meta.yml and update checksum

* tweak checksum

* add threads to the module

* skip version info for matching test md5sum [ci skip]

* Add ref fasta and finalize the module

Co-authored-by: Gregor Sturm <mail@gregor-sturm.de>

* Expansionhunter (#666)


Please enter the commit message for your changes. Lines starting

* adds expansionhunter module

Co-authored-by: Maxime U. Garcia <maxime.garcia@scilifelab.se>

* Update test.yml (#668)

* Specify in guidelines one should split CPUs when module has n > 1 tool (#660)

* Specify more guidelines on input channels

* Linting

* Updates based on code review

* Update README.md

* Fix broken sentence

* Describe CPU splitting

* Update README.md

Co-authored-by: Gregor Sturm <mail@gregor-sturm.de>

* More CPU examples

Co-authored-by: Gregor Sturm <mail@gregor-sturm.de>

* Add dsh-bio export-segments module (#631)

Co-authored-by: Gregor Sturm <mail@gregor-sturm.de>

* update: `BWA/ALN` (#653)

* Specify more guidelines on input channels

* Linting

* Updates based on code review

* Update README.md

* Fix broken sentence

* Remove reads from output channel following module guidelines. Should do a .join() based on $meta, to reassociate.

Co-authored-by: Gregor Sturm <mail@gregor-sturm.de>

* Update seqwish reported version to match bioconda version. (#678)

* Bbmap index (#683)

BBMap index module

* Initialise chromap module

* Revert "Initialise chromap module"

This reverts commit 47c67ae231a6f221ef5b9b7b444b583b5406852b.

* Remove unnecessary files

* Remove unnecessary files

* Update modules/chromap/index/main.nf

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* Update modules/chromap/index/main.nf

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* Update modules/chromap/chromap/main.nf

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* Update tests/modules/chromap/chromap/main.nf

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* Update tests/modules/chromap/chromap/main.nf

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* Update tests/modules/chromap/chromap/main.nf

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* Update modules/chromap/index/main.nf

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* Remove pytest_software.yml

* Apply suggestions from code review

Co-authored-by: Abhinav Sharma <abhi18av@users.noreply.github.com>
Co-authored-by: James A. Fellows Yates <jfy133@gmail.com>
Co-authored-by: Robert A. Petit III <robbie.petit@gmail.com>
Co-authored-by: Gregor Sturm <mail@gregor-sturm.de>
Co-authored-by: JIANHONG OU <jianhong@users.noreply.github.com>
Co-authored-by: Anders Jemt <jemten@users.noreply.github.com>
Co-authored-by: Maxime U. Garcia <maxime.garcia@scilifelab.se>
Co-authored-by: Michael L Heuer <heuermh@acm.org>
Co-authored-by: Daniel Lundin <daniel.lundin@lnu.se>
Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>
2021-09-15 17:20:55 +01:00
James A. Fellows Yates
561f16fe74
update: MALT build version bump (#699)
* Specify more guidelines on input channels

* Linting

* Updates based on code review

* Update README.md

* Fix broken sentence

* Bump versions

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>
2021-09-15 16:46:29 +01:00
Abhinav Sharma
1bc3f6cf39
module: snp-dists (#697)
* initial commit for draft [ci skip]

* baseline code [ci skip]

* update the test [ci skip]

* finalize the description and all tests passing

* accomodate optional args [ci skip]

* fix the leftover todo statement

* Update modules/snpdists/main.nf

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>
2021-09-15 16:36:49 +01:00
Daniel Lundin
3a8bfc1d33
Get rid of meta map from bbmap/index (#700)
Got rid of meta map from bbmap/index
2021-09-15 12:38:56 +02:00
Mei Wu
b2a6f5409e
modify markduplicates module (#681)
* tested

* updated meta config and test config
2021-09-15 11:02:28 +02:00
James A. Fellows Yates
c485109d9b
Add module: bamaligncleaner (#676)
* Specify more guidelines on input channels

* Linting

* Updates based on code review

* Update README.md

* Fix broken sentence

* Add bamAlignCleaner module

* Add container tags

* Update modules/bamaligncleaner/main.nf
2021-09-15 10:31:49 +02:00
Abhinav Sharma
6ff995e93d
Add bcftools/query module (#670)
* initial commit [ci skip]

* add basic structure [ci skip]

* finalized the bcftools/query module

* add optional files [ci skip]

* Add the vcf index file as param [ci skip]

* update the md5sum for output file [ci skip]

* all tests passing
2021-09-14 09:19:01 +02:00
Davi Marcon
59ca7444cf
Adding plink/vcf module (#656)
* adding plink module using nf-core tool [ci skip]

* Restructures the project for plink/vcf (#1)

* Add version string for plink
* Create a plink/vcf module

* small tweaks on main.nf and started to test [ci skip]

* small changes on test args, local test with docker passed!

* Update plink/vcf module listing

* Update tag

* fix tags as per linting guidelines

* revert to the original state of tags

* adding --threads to `main.nf` and `meta.yml` information

Co-authored-by: Abhinav Sharma <abhi18av@users.noreply.github.com>
2021-09-14 08:51:40 +02:00
GCJMackenzie
bd68797ffb
Mutect2 (#682)
* mutect2 files added, first draft of module code entered

* removing comment from main.nf

* removing comment from main.nf

* test added, commit made before editing yaml

* tests added, still needs final check and info/comments added

* gatk4 version changed to gatk4=4.2.0.0

* multiple sample support added, information added to module yaml file

* Update meta.yml

fixed linting error

* add keywords to meta.yml

* Corrections made to meta.yml

* removed whitespace from meta.yml

Co-authored-by: Gavin.Mackenzie <gavin.mackenzie@nibsc.org>
Co-authored-by: Maxime U. Garcia <max.u.garcia@gmail.com>
2021-09-13 16:16:23 +01:00
GCJMackenzie
1023a98b51
Getpileupsummaries (#689)
* first commit, added template files for new module

* created getpileupsummaries script, tests and both yml files

* fixed typo in meta.yml

* Update modules/gatk4/getpileupsummaries/meta.yml

changed gz_tbi to gz.tbi as suggested

Co-authored-by: Maxime U. Garcia <maxime.garcia@scilifelab.se>

Co-authored-by: GCJMackenzie <gavin.mackenzie@nibsc.org>
Co-authored-by: Maxime U. Garcia <max.u.garcia@gmail.com>
Co-authored-by: Maxime U. Garcia <maxime.garcia@scilifelab.se>
2021-09-13 16:04:14 +01:00
Abhinav Sharma
c5634ba99b
Add bcftools/view module (#669)
* initial commit [ci skip]

* add stubs [ci skip]

* Finalize the bcftools/view module

* accomodate optional files

* add optional region file

* refer the targets file in the tests

* all tests passing

* documen the optional parameters
2021-09-12 19:51:40 +02:00
Edmund Miller
669fb5caed
Homer Modules (#75)
* feat(homer): Add initial makeTagDirectory

* feat(homer): Add initial findPeaks module

* feat(homer): Update with new options

See 1d30e2c21a

* fix(homer): Correct findpeaks process name

* fix(homer): Takes a bam file instead of bed

* feat(homer): Add initial makeTagDirectory test

* fix(homer): Hardcode genome and configureHomer

I'd like to modularize configureHomer, but I need to figure out how
exactly the genomes work.

* fix(homer): bam => bed

Bam requires samtools to be present, which it's not in this docker image

* feat(homer): Add initial configureHomer script

* ci(homer): Add initial test

* test(homer): Reproducible configuration workaround

- I can't run both tests(one file and two files) at the same time because it breaks
- I can't copy the genome stuff from the configurehomer module because it's read only
- So I can't make the makeTagDirectory module depend on configureHomer

* test(homer): Add placeholder annotatepeaks

The required inputs are necessarily required for all workflows from what
I've used, but I'll need to look at the actual docs

* test(homer): Add missing B.bed

* test(homer): Rename two => groseq

Then all of the various workflows that homer provides can be e2e tested

* feat(homer): Add initial makeUCSCfile module

* test(homer): Add start to makeUCSCfile testing

* chore(homer): Add various cleanups

* test(homer): Rewrite annotatepeaks

Not passing yet

* test(homer): Rewrite configurehomer

* test(homer): Rewrite findpeaks

Still failing

* test(homer): Rewrite makeucscfile

Not passing yet

* test(homer): Rewrite maketagdirectory

All homer modules now follow the new structure. Time to make them pass.

* test(homer): Fix typo for workflow name

* fix(homer): Use correct container

* fix(homer): Accept fasta in maketagdirectory

Apparently all of the homer stuff can just take any old fasta and you
don't need to configure the genome ahead of time with configureHomer

* test(homer): makeTagDirectory passes now

* fix(homer): Update containers in makeucscfile

* test(homer): Rewrite makeucscfile

Takes input from maketagdirectory which is how the module should be used

* fix(homer): Update makeUCSCFile bedgraph path

* test(homer): Update makeucscfile expected output

* fix(homer): Update containers in findpeaks

* fix(homer): Change findpeaks args

The user is just going to have to know what they're doing for now

* test(homer): findPeaks rewrite with tagDir input

* test(homer): Update expected files for findPeaks

And bump filters

* style: Appease editorconfig

* ci: Remove old workflow

* tests(homer): Add md5sums

* test(homer): Add meta test

* style(homer): Capitalize HOMER

* docs(homer): Add maketagdirectory meta.yml

* docs(homer): Add makeucscfile meta.yml

* docs(homer): Add findpeaks meta.yml

* test(homer): Update to new test data standards

* chore: Remove stuff that got revived in the rebase

* chore: software => modules

* test(homer): Update tags

* test(homer): Update annotatepeaks

* ci: Fix uploading of artifacts

GitHub actions doesn't like the / in the tags

* test(homer): Remove annotate md5sum

This is failing and breaking new tests

* test(homer): Use bams instead of beds

* test(homer): Fix meta maketagdirectory

* test(homer): Fix input in all tests

* test(homer): Move back to bed files

Forgot samtools isn't present

* chore(homer): Add TODOs for tests

* test(homer): Add bed format arg

* test(homer): Update md5sums

* test(homer): Fix tags tsvs

* style(homer): Appease nf-core linting

* docs(homer): Be in line with what is in the main.nf file

Co-authored-by: Kevin Menden <kevin.menden@live.com>

Co-authored-by: Kevin Menden <kevin.menden@live.com>
2021-09-08 15:40:34 +00:00
Kevin Brick
0732028e15
Add bedtools/makewindows module (#658)
* Add bedtools/makewindows module
2021-09-07 14:36:06 -04:00
Daniel Lundin
0f59b07945
Bbmap index (#683)
BBMap index module
2021-09-03 09:28:28 +02:00
Michael L Heuer
bc7b5b3a12
Add dsh-bio export-segments module (#631)
Co-authored-by: Gregor Sturm <mail@gregor-sturm.de>
2021-08-17 15:53:41 +02:00
James A. Fellows Yates
69b21f0dc0
Update test.yml (#668) 2021-08-17 15:08:21 +02:00
Anders Jemt
b261c1f549
Expansionhunter (#666)
Please enter the commit message for your changes. Lines starting

* adds expansionhunter module

Co-authored-by: Maxime U. Garcia <maxime.garcia@scilifelab.se>
2021-08-16 17:47:42 +02:00
Abhinav Sharma
0954204f9e
Add bcftools/norm module (#655)
* Initial draft [ci skip]

* trigger first test

* update output file path

* Tests passing

* finishing touches for meta.yml and update checksum

* tweak checksum

* add threads to the module

* skip version info for matching test md5sum [ci skip]

* Add ref fasta and finalize the module

Co-authored-by: Gregor Sturm <mail@gregor-sturm.de>
2021-08-16 17:40:03 +02:00
Robert A. Petit III
653e9e05b1
add module for dragonflye (#633)
* add module for dragonflye

* fix tests for dragonflye

* Update test.yml

* Update meta.yml

* Update main.nf

* Update main.nf

* Update modules/dragonflye/meta.yml

Co-authored-by: Gregor Sturm <mail@gregor-sturm.de>
2021-08-16 11:51:30 +02:00
Abhinav Sharma
67cc3bd116
Add bcftools/concat module. (#641)
* draft for bcftools modules [ci skip]

* initial test for bcftools concat

* Update the params for testing

* fix tests

* Accomodate code review [ci skip]

Co-authored-by: James A. Fellows Yates <jfy133@gmail.com>

* Update the meta file and open PR for review

* Update the keyword

* Update the tags for module [ci skip[

* add threads

Co-authored-by: James A. Fellows Yates <jfy133@gmail.com>
2021-08-10 15:10:27 +02:00
praveenraj2018
5de3f2c50e
Added PL tag in read group information for downstream analysis (#649)
Co-authored-by: Maxime U. Garcia <max.u.garcia@gmail.com>
2021-08-04 11:16:51 +02:00
James A. Fellows Yates
292e8eceb9
module: MALT/RUN (#646)
* Specify more guidelines on input channels

* Linting

* Updates based on code review

* Update README.md

* Fix broken sentence

* Add MALT with incomplete tests

* Parameter typo fix

* Clean up test yaml

* Finish MALT module prior UNZIP and MALT_BUILD modiules

* Add required modules for tests

* Sync test out with malt-build

* Fix input parameters in tests based on final build module

* Update modules/malt/run/meta.yml

Co-authored-by: Gregor Sturm <mail@gregor-sturm.de>

Co-authored-by: Gregor Sturm <mail@gregor-sturm.de>
2021-08-04 11:06:08 +02:00
James A. Fellows Yates
6913da9d2d
module: MALT/BUILD (#645)
* Specify more guidelines on input channels

* Linting

* Updates based on code review

* Update README.md

* Fix broken sentence

* Start MALT-build

* Start MALT build (missing meta files and outputs specS)

* Local tests

* Correct test map_type

* Finished module, just waiting for UNZIP module to finalise tests

* Correct tests in preparation for Unzip

* Ouptut log file too

* Update meta.yml

* Rename log file

* Rename log file

* Remove debugging stuff

* Add Unzip module

* Linting update

* Linting update

* Fix input db

* Fix db file in cmd

* Update modules/malt/build/main.nf

* Update modules/malt/build/main.nf

* Update main.nf
2021-08-03 16:24:19 +02:00
James A. Fellows Yates
4f1c1601cf
module: bwa/sampe (#625)
* Specify more guidelines on input channels

* Linting

* Updates based on code review

* Update README.md

* Fix broken sentence

* Add bwa/aln module

* Also output reads as required with SAI

* Add sampe

* Fix container paths

* Update based on code review from @grst

* Update input docs
2021-08-02 15:37:48 +02:00
James A. Fellows Yates
8a2f01c416
module: bwa/samse (#626)
* Specify more guidelines on input channels

* Linting

* Updates based on code review

* Update README.md

* Fix broken sentence

* Add bwa/aln module

* Also output reads as required with SAI

* Add bwa samse

* Fix container paths

* remove TODO comment

* Updated based on code from from @grst on bwa/sampe

* Clarify output docs
2021-08-02 15:21:23 +02:00
James A. Fellows Yates
e01a98a704
module: unzip (#642)
* Specify more guidelines on input channels

* Linting

* Updates based on code review

* Update README.md

* Fix broken sentence

* Add unzip module

* Remove missing TODOs update mtea

* Apply changes after code-review from @grst

* Account for user trying to supply two input archives

* Remove debugging test

* Update modules/unzip/main.nf

Co-authored-by: Jose Espinosa-Carrasco <kadomu@gmail.com>

* Correct output path

Co-authored-by: Jose Espinosa-Carrasco <kadomu@gmail.com>
2021-08-02 09:40:57 +02:00
Harshil Patel
29c8474240
Update Nextclade to output all files by default (#638) 2021-07-28 19:49:50 +01:00
Harshil Patel
c5235a983d
nf-core modules bump-versions for all modules (#630)
* Add blacklist of modules that shouldn't be updated to .nf-core.yml

* nf-core modules bump-versions for all modules

* Remove TODO statements identified by linting

* Fix md5sums for failing tests

* Fix more tests
2021-07-28 09:10:44 +01:00
James A. Fellows Yates
45dee96bdf
module: bwa/aln (#624)
* Specify more guidelines on input channels

* Linting

* Updates based on code review

* Update README.md

* Fix broken sentence

* Add bwa/aln module

* Also output reads as required with SAI

* fix container paths

* Sync bwa version samese/sampe

* Apply suggestions from code review

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>
2021-07-27 08:13:48 +01:00
Johnathan D
a21cc95c69
Add variantbam (#618)
* template created for variantbam (#616)

* Add bcftools reheader (#585) (#608)

* local tests and linting passing (#585)

* fix: picard filtersamreads input (#610)

* Move readlist into same input channel as bam

* Update test reflecting input restructuring

* Update tests/modules/picard/filtersamreads/main.nf

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* fix test

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* Added module arriba (#611)

* Updated the version of STAR in align and genomegenerate modules

* Changes in test.yml

* Changes in test.yml

* Added module arriba

* Changes in test configs

* Added module Arriba for fusion detection

* Fixed review comments

* Added an output option for discarded fusions

* Resolved some conflits

* conflicts

* Apply suggestions from code review

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* added test for new header

* enhance module fastp: add `save_merged` (#598) (#614)

* enhance module fastp: add `save_merged` (#598)

* removed md5sum checks from log and json

* Apply suggestions from code review

Co-authored-by: James A. Fellows Yates <jfy133@gmail.com>
Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>
Co-authored-by: praveenraj2018 <43108054+praveenraj2018@users.noreply.github.com>

* fixed autogenerated biocontainter links

* variantbam module passing all tests/lints (#616)

* Added an optional output junction channel in STAR (#621)

* Added an optional output channel for chimeric junctions

* Fix in test.yml

* Apply suggestions from code review

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* removed qcreport output

fixes #616

Co-authored-by: James A. Fellows Yates <jfy133@gmail.com>
Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>
Co-authored-by: praveenraj2018 <43108054+praveenraj2018@users.noreply.github.com>
2021-07-26 19:07:29 +01:00
praveenraj2018
df909015b6
Added an optional output junction channel in STAR (#621)
* Added an optional output channel for chimeric junctions

* Fix in test.yml

* Apply suggestions from code review

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>
2021-07-26 19:03:30 +02:00
Johnathan D
a813e2e3a6
Add bcftools reheader (#585) (#608)
* local tests and linting passing (#585)

* fix: picard filtersamreads input (#610)

* Move readlist into same input channel as bam

* Update test reflecting input restructuring

* Update tests/modules/picard/filtersamreads/main.nf

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* fix test

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* Added module arriba (#611)

* Updated the version of STAR in align and genomegenerate modules

* Changes in test.yml

* Changes in test.yml

* Added module arriba

* Changes in test configs

* Added module Arriba for fusion detection

* Fixed review comments

* Added an output option for discarded fusions

* Resolved some conflits

* conflicts

* Apply suggestions from code review

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* added test for new header

* enhance module fastp: add `save_merged` (#598) (#614)

* enhance module fastp: add `save_merged` (#598)

* removed md5sum checks from log and json

* Apply suggestions from code review

Co-authored-by: James A. Fellows Yates <jfy133@gmail.com>
Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>
Co-authored-by: praveenraj2018 <43108054+praveenraj2018@users.noreply.github.com>
2021-07-23 22:24:19 +01:00
Johnathan D
6f561b3b41
enhance module fastp: add save_merged (#598) (#614)
* enhance module fastp: add `save_merged` (#598)

* removed md5sum checks from log and json
2021-07-23 10:44:00 +01:00
praveenraj2018
3cabc95d0e
Added module arriba (#611)
* Updated the version of STAR in align and genomegenerate modules

* Changes in test.yml

* Changes in test.yml

* Added module arriba

* Changes in test configs

* Added module Arriba for fusion detection

* Fixed review comments

* Added an output option for discarded fusions

* Resolved some conflits

* conflicts

* Apply suggestions from code review

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>
2021-07-22 15:19:42 +01:00
James A. Fellows Yates
553f51d6bf
fix: picard filtersamreads input (#610)
* Move readlist into same input channel as bam

* Update test reflecting input restructuring

* Update tests/modules/picard/filtersamreads/main.nf

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* fix test

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>
2021-07-22 11:19:51 +01:00
James A. Fellows Yates
3cc43838e1
module: picard filtersamreads (#602)
* Start work filtersamreads

* Refactored to allow optional input

* Use proper readlist test data

* Remove typo

* Fix if else condition

* Remove debugging code

* Fix container URLs

* Add required input specification meta

* Cleanup

* Apply suggestions from code review

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* Fix suffixing

* Additional formatting tweaks

* Update modules/picard/filtersamreads/main.nf

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* Update modules/picard/filtersamreads/meta.yml

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>
2021-07-21 15:22:19 +01:00
Jose Espinosa-Carrasco
217303f5c1
Add option -p to set the # of cpus on stringtie (#601)
* Add option -p  to set  the # of cpus on stringtie

* Bump version 2.1.7 to stringtie modules

* Output stringtie/merge version

* Fix padding

* Apply suggestions from code review

* Defining software variable

* Fix test, gff can't be md5 check, contains instead

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>
2021-07-21 15:38:40 +02:00
James A. Fellows Yates
a0019d4175
fix: picard sortsam (#605)
* Add picard/sortsam module

* Fix container links

* Changes after code review

* Input meta in the right place

* Correct output file suffix

* Define only `bam` in output tuple
2021-07-21 14:34:21 +01:00
praveenraj2018
f43778b0e6
Updated the version of STAR in align and genomegenerate modules (#604)
* Updated the version of STAR in align and genomegenerate modules

* Changes in test.yml

* Changes in test.yml

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>
2021-07-21 13:30:52 +01:00
James A. Fellows Yates
1a26d48104
module: picard sortsam (#603)
* Add picard/sortsam module

* Fix container links

* Changes after code review

* Input meta in the right place
2021-07-21 13:48:07 +02:00
James A. Fellows Yates
10502399ad
Replaced param with input val channel (#595)
* Replaced param with input val channel

* Apply suggestions from code review

Co-authored-by: Jose Espinosa-Carrasco <kadomu@gmail.com>
Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* Apply suggestions from code review

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* Apply suggestions from code review (missed one)

* YAML lint

Co-authored-by: Jose Espinosa-Carrasco <kadomu@gmail.com>
Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>
2021-07-21 10:00:48 +02:00
Harshil Patel
e4df336294
Add hifiasm module (#596)
* Add hifiasm module

* Tidy up module

* Add pacbio files to test_data.config
2021-07-20 21:50:22 +01:00
Johnathan D
2e619add87
Add samtools ampliconclip (#590)
* created template for `samtools/ampliconclip` (#584)

* All tests passing (#584)

* Linting fixed (#584)

* Final linting fixed (#584)

* Optional output flags moved to `input` (#584)

* typo fix (#584)

* Apply suggestions from code review

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>
2021-07-20 21:31:31 +01:00
Harshil Patel
e7e30b6da6
Bump Pangolin to 3.1.7 (#593)
* Bump Pangolin to 3.1.7

* Update md5sum

* Update README

* Re-word

* Re-word again

* Use channels
2021-07-20 12:25:36 +01:00
Johnathan D
0b40798d1b
fix: lofreq/callparallel missing arg (#562) (#586)
Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>
2021-07-19 09:19:27 +01:00
Johnathan D
8c294882d7
fix: lofreq/call test.yml md5sum (#587) 2021-07-19 08:53:27 +01:00
Maxime U. Garcia
adfb8a3d65
fix: update samtools_merge (#582)
* fix: update samtools_merge

* Update modules/samtools/merge/main.nf

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>
2021-07-16 14:32:17 +02:00
Maxime U. Garcia
b3c4667732
fix: update to gatk4.2.0.0 (#575)
* fix: update to gatk4.2.0.0

* fix: update md5sum
2021-07-16 11:26:28 +02:00
Harshil Patel
e937c7950a
Rename software/ directory to modules/ to re-organise module structure (#567)
* Update README

* Rename pytest_software.yml to pytest_modules.yml

* Rename main software directory to modules

* Remove deprecated modules

* Rename tests software to modules

* Replace paths for tests in pytest_modules.yml

* Replace software with modules in Github Actions

* Replace software with modules in main.nf tests

* Rename software to modules in test.yml
2021-07-07 10:10:18 +01:00
Svyatoslav Sidorov
95dfa7bc8d
Enhance bedtools (#557)
* hifiasm copied from fastqc

* hifiasm tests init from fastqc

* meta.yml init; test.yml and main.nf for printing version

* Add hifiasm version printing

* Removed spaced on an empty line

* Reverted hifiasm from main

* hifiasm copied from fastqc

* hifiasm tests init from fastqc

* meta.yml init; test.yml and main.nf for printing version

* Add hifiasm version printing

* Removed spaced on an empty line

* Reverted hifiasm from main

* Generalized intersect and genomecov

* Finished subtract and tests for intersect and genomecov

* Finished up meta YAMLs

* Replaced functions.nf in subtract

* do not add "." in prefix when suffix is set (#550)

when using the suffix option in the fastqc module it gets added with a "." to the ${meta.id}, this leads to sample name clashing when passing the fastqc output of raw and processed files suffixed with "trim" or "clean" to multiqc.
I suggest to remove the "." this would also be more consistent with the prefix def in most of the other nf-core modules.

##' Ref:
https://nfcore.slack.com/archives/CJRH30T6V/p1625129138043900

* Modules TLC (#551)

* Modules TLC

* Fix all the tests

* Fix linting failures (#552)

* Modules TLC

* Fix all the tests

* Fix linting failures

* Soft-link build files to bypass lint error

* Update software/rseqc/junctionannotation/main.nf

* Fix rsem (#555)

* bump bcftools filter

* fix bcftools

* rsem/preparereference

* added calculateexpression

* meta.yml and pytest_software

* paired end

* add test.yml

* fix rseqc/junctionsaturation (#553)

* bump bcftools filter

* junctionsaturation meta.yml and test

* pytest config entry

* bump bcftools version down again

* fix test

* fix bcftools

* Adapt linting action (#556)

* bump bcftools filter

* fix bcftools

* adapt module linting

* Update software/bedtools/genomecov/main.nf

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* Update software/bedtools/genomecov/main.nf

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* Update software/bedtools/genomecov/main.nf

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* Update software/bedtools/genomecov/main.nf

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* Update software/bedtools/genomecov/meta.yml

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* Update software/bedtools/genomecov/meta.yml

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* Update software/bedtools/genomecov/meta.yml

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* Update software/bedtools/genomecov/meta.yml

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* Update software/bedtools/genomecov/meta.yml

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* Update software/bedtools/intersect/main.nf

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* Update software/bedtools/genomecov/main.nf

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* Update software/bedtools/genomecov/main.nf

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* Update software/bedtools/intersect/main.nf

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* Update software/bedtools/intersect/main.nf

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* Update software/bedtools/intersect/main.nf

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* Update software/bedtools/intersect/meta.yml

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* Update software/bedtools/intersect/meta.yml

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* Update software/bedtools/intersect/meta.yml

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* Update software/bedtools/intersect/meta.yml

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* Update software/bedtools/intersect/meta.yml

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* Update software/bedtools/subtract/main.nf

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* Update software/bedtools/subtract/main.nf

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* Update software/bedtools/subtract/meta.yml

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* Update software/bedtools/subtract/meta.yml

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* Update tests/software/bedtools/genomecov/main.nf

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* Update tests/software/bedtools/genomecov/main.nf

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* Update tests/software/bedtools/intersect/main.nf

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* Update tests/software/bedtools/intersect/main.nf

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* Fixed variable names in intersect and genomecov

Co-authored-by: Sviatoslav Sidorov <sviatoslav.sidorov@crick.ac.uk>
Co-authored-by: riederd <dietmar.rieder@i-med.ac.at>
Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>
Co-authored-by: Kevin Menden <kevin.menden@t-online.de>
2021-07-07 09:44:09 +01:00
Maxime U. Garcia
e0d820f9f4
Add snpeff (#546)
* feat: add snpeff

* fix: linting

* fix: tests

* fix: add csv output

* fix: add params information

* fix: improve script

* Update software/snpeff/environment.yml

* Update software/snpeff/environment.yml

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* Apply suggestions from code review

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* Apply suggestions from code review

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* Apply suggestions from code review

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* Apply suggestions from code review

* fix test

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>
2021-07-06 13:40:55 +01:00
Maxime U. Garcia
7b4a28b6e8
feat: add VEP module (#547)
* feat: add VEP module

* fix: name

* fix: EC lint]

* feat: add info about params

* fix: params as params, not input

* fix: improve script

* Update software/ensemblvep/environment.yml

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* Apply suggestions from code review

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* Apply suggestions from code review

* Apply suggestions from code review

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>
2021-07-06 14:11:11 +02:00
Mei Wu
3f4eccbf0f
Delly/call (#565)
* testing works but need to fix paths and add exclude list

* edited meta file and removed TODOs

* left over TODOs

* test passed, final push

* resolving initial comments

* Update software/delly/call/main.nf

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>
2021-07-06 12:54:14 +01:00
Johnathan D
79f3a55f6e
Lofreq call (#564)
* created templates

* updated functions.nf to the one on dev

* Created test main

* Fasta added and docker, conda, singularity passing

* Fixed output version lint
2021-07-06 10:41:00 +01:00
Ravneet Bhuller
42adce7af1
Pull request for module: lofreq/callparallel (#562)
* first commit

* updated file

* edited files

* Update test.yml

* Update software/lofreq/callparallel/main.nf

* Update test.yml

* Update tests/software/lofreq/callparallel/test.yml

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>
2021-07-06 09:51:38 +01:00
Charles Plessy
45f2f1ee5f
Input a triple (id, fasta, params) to last/lastal (#563)
The `last/lastal` submodule takes query sequences to align to a target
index, and optionally takes one set of alignment parameters (including a
score matrix) computed by the `last/train` module for each of the
sequences.

In the previous implementation the sequences and the alignment
parameters were provided in different channels, causing them to be
sometimes desynchronised.

In the patched implementation, `last/lastal` takes a 3-tuple as
input to ensure synchronicity.  To produce this tuple in a pipeline,
one can use the `join` command as in the following example.

     LAST_TRAIN  ( query,
                   target )
     LAST_LASTAL ( query.join(LAST_TRAIN.out.param_file),
                   target )

In case no parameter file is computed one can pass a dummy file
to the module as follows:

     LAST_LASTAL ( query.map { row -> [ row[0], row[1], [] ] },
                   target )
2021-07-06 09:35:04 +01:00
Johnathan D
fbab00238f
Lofreq filter (#559)
* Created module template (#558)

* Created meta and implemented main (#558)

* Conda test and lint passing (#558)

* Updated functions.nf to the one on dev (#558)

* Update software/lofreq/filter/main.nf

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>
2021-07-05 10:24:45 +01:00
Ravneet Bhuller
cd8bacc90a
PR for lofreq/indelqual module (#539)
* first commit

* edited functions.nf

* edited functions.nf

* version line updated

* Update software/lofreq/indelqual/main.nf

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* Update software/lofreq/indelqual/main.nf

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* Update software/lofreq/indelqual/main.nf

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* Update software/lofreq/indelqual/meta.yml

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* Update tests/software/lofreq/indelqual/test.yml

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* Update tests/software/lofreq/indelqual/main.nf

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* updated files

* updated file

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>
2021-07-05 10:17:57 +01:00
Kevin Menden
b59e8054e4
fix rseqc/junctionsaturation (#553)
* bump bcftools filter

* junctionsaturation meta.yml and test

* pytest config entry

* bump bcftools version down again

* fix test

* fix bcftools
2021-07-02 13:31:09 +02:00
Kevin Menden
fce4e60864
Fix rsem (#555)
* bump bcftools filter

* fix bcftools

* rsem/preparereference

* added calculateexpression

* meta.yml and pytest_software

* paired end

* add test.yml
2021-07-02 13:09:48 +02:00
Harshil Patel
b5f6a1da79
Fix linting failures (#552)
* Modules TLC

* Fix all the tests

* Fix linting failures

* Soft-link build files to bypass lint error

* Update software/rseqc/junctionannotation/main.nf
2021-07-01 19:50:14 +01:00
Harshil Patel
b3278a1e63
Modules TLC (#551)
* Modules TLC

* Fix all the tests
2021-07-01 16:13:01 +01:00
James A. Fellows Yates
394273f173
damageprofiler (#545)
* Add damageprofiler module

* Fix tests

* Bump container hopefully with font fix

* Following code review
2021-06-30 09:46:24 +02:00
MGordon09
af4b8814b8
update muscle (#542) 2021-06-28 08:20:02 +02:00
Maxime U. Garcia
81aba5734c
Add modules bgziptabix (#544)
* feat: add modules bgziptabix

* fix: add module to config

* fix: lint

* fix: tests
2021-06-25 10:52:02 +02:00
MGordon09
4d711a1428
Add metaphlan3 module (#543)
* Add metaphlan3 module

* remove whitespace
2021-06-25 08:15:15 +02:00
JIANHONG OU
e0b7952b56
Pairtools select (#523)
* add software/pairtools

* create a branch for pairtools/select

* fix the different output of conda and docker.

* rmove the md5sum for gzip files.

* Update software/pairtools/select/main.nf

Co-authored-by: Jose Espinosa-Carrasco <kadomu@gmail.com>

* update test file and documentation.

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>
Co-authored-by: Jose Espinosa-Carrasco <kadomu@gmail.com>
2021-06-23 15:58:31 +02:00
Jose Espinosa-Carrasco
e621f78757
Update salmon/quant to provide '--libType A' option (#536)
* Update salmon/quant to provide '--libType A' option

* Modify lib_type description to  be a string

* Update tests

* lyb_type can be explicitly overwrite

* Update main.nf

* Update main.nf

* Update main.nf

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>
2021-06-17 15:13:47 +02:00
Charles Plessy
c8168bc351
Update last module (#533)
* Update LAST to version 1238.

* Update functions.nf to the latest devel version.

* Update test MD5sums after updating software version.

* Make portable on MacOS

* Allow input alignments to be uncompressed.

While the strategy in this family of modules is to make all inputs and
outputs compressed, this change might be useful to some users.

As of LAST 2138, `last/split` does not allow its input to be compressed.

* Search for .des file, that is guaranteed to be unique.

Some LAST indexes have more than one .bck file and it makes the name
detection crash.

In this commit, I also standardise how the names are detected.

* Use value input channel and optional output channels to handle formats.

As discussed on Slack, it is preferred to use a value input channel
instead of sneaking options through `params.args2` or `params.format`
as we did.

Likewise, optional output channels with clearly labeled format are
preferred to 'catch-all' wildcards.
2021-06-14 12:27:27 +01:00
Charles Plessy
894349b9b5
Fix 459 (#534)
* Update test data names.

Closes: #459

Thanks: @FriederikeHanssen

(`samtools` tests are already fixed by another commit)

* Fix file names in tests.

The update of test data name required changes in the test yml files.

I also updated the `bismark/summary/main.nf` file to get its data
from the `params.test_data` map.
2021-06-14 12:24:59 +01:00
Svyatoslav Sidorov
01dc6a289d
Feat seqtk update (#503)
* hifiasm copied from fastqc

* hifiasm tests init from fastqc

* meta.yml init; test.yml and main.nf for printing version

* Add hifiasm version printing

* Removed spaced on an empty line

* Reverted hifiasm from main

* hifiasm copied from fastqc

* hifiasm tests init from fastqc

* meta.yml init; test.yml and main.nf for printing version

* Add hifiasm version printing

* Removed spaced on an empty line

* Reverted hifiasm from main

* Added seqtk/subseq and checking for seed in seqtk/sample

* Separate authors in software/seqtk/sample/meta.yml

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* Align commans in output channesl software/seqtk/subseq/main.nf

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* Define prefix in software/seqtk/subseq/main.nf

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* Use prefix in output file name software/seqtk/subseq/main.nf

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* Define suffix in options in tests/software/seqtk/subseq/main.nf

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* Change output file name in tests/software/seqtk/subseq/test.yml

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* Remove a to-do point from tests/software/seqtk/subseq/test.yml

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* Added --no-name into gzip commands

* Update samtools from 1.10 to 1.12 (#530)

* feat: remove social preview image to use GitHub OpenGraph

* feat: update samtools from 1.10 to 1.12

* fix: CI tests

* fix: add meta.yml file for samtools/merge

* Update software/samtools/merge/meta.yml

Co-authored-by: Jose Espinosa-Carrasco <kadomu@gmail.com>

* Update software/samtools/merge/meta.yml

Co-authored-by: Jose Espinosa-Carrasco <kadomu@gmail.com>

* hifiasm copied from fastqc

* hifiasm tests init from fastqc

* meta.yml init; test.yml and main.nf for printing version

* Add hifiasm version printing

* Removed spaced on an empty line

* Reverted hifiasm from main

* Added seqtk/subseq and checking for seed in seqtk/sample

* hifiasm copied from fastqc

* hifiasm tests init from fastqc

* meta.yml init; test.yml and main.nf for printing version

* Add hifiasm version printing

* Removed spaced on an empty line

* Reverted hifiasm from main

* Separate authors in software/seqtk/sample/meta.yml

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* Align commans in output channesl software/seqtk/subseq/main.nf

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* Define prefix in software/seqtk/subseq/main.nf

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* Use prefix in output file name software/seqtk/subseq/main.nf

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* Define suffix in options in tests/software/seqtk/subseq/main.nf

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* Change output file name in tests/software/seqtk/subseq/test.yml

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* Remove a to-do point from tests/software/seqtk/subseq/test.yml

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* Added --no-name into gzip commands

* Replaced functions.nf in seqtk/subseq

* Refreshed tests for sample and subseq

* Corrected paired-end test and YAML description for sample

Co-authored-by: Sviatoslav Sidorov <sviatoslav.sidorov@crick.ac.uk>
Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>
Co-authored-by: Maxime U. Garcia <max.u.garcia@gmail.com>
Co-authored-by: Jose Espinosa-Carrasco <kadomu@gmail.com>
2021-06-14 12:23:15 +01:00
JIANHONG OU
d9e48b70ca
Pairtools restrict (#522)
* add software/pairtools

* create a branch for pairtools/restrict

* fix the different output of conda and docker

* remove customized code.

* add newline to Frag.bed file.

* change the folder of frag.bed.

* change \n to \r\n

* Remove work.frag.bed

Co-authored-by: JoseEspinosa <kadomu@gmail.com>
2021-06-10 19:39:35 +02:00
Jose Espinosa-Carrasco
3fce3f4950
Bump new nextclade version (0.14.4) (#532) 2021-06-09 14:12:21 +01:00