Commit graph

6 commits

Author SHA1 Message Date
Matthias Hörtenhuber
e745e167c1
Fix formatting in yaml files, add yamllint config (#1279)
* fix yml formatting

* allow fastq.gz and fq.gz as file input, add meta.yml and test

* fix yaml files

* Revert "allow fastq.gz and fq.gz as file input, add meta.yml and test"

This reverts commit 34002d7a7a8c7f7bb4600c3377f35c87849f71a4.

* prettier magic!

* fix comments for yamllint

* remove node version number

* fix linting errors

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>
2022-02-15 11:15:27 +00:00
Harshil Patel
9d0cad583b
Change syntax from task.ext.suffix to tast.ext.prefix in all modules (#1110)
* Add comment line for consistency

* Remove all functions.nf

* Remove include functions.nf and publishDir options

* Replace options.args3 with task.ext.args3 - 3 modules

* Replace options.args3 with task.ext.args3 - 17 modules

* Replace {task.cpus} with task.cpus

* Replace off on off off off off off off off on off on off on off off off on off off off on on off off off on on off off off off off off off on off off off off on off on on off off off on on on on off off off on off on on off on on off off on on on off on on off on off off off off on off off off on off off on off on off off off on on off on off on off off on off off off on off off off on off off off off on off off off on on on off on on off off on off on on on off on on off on on on off off off off off on on off off on off off off off off on off off on on off on on off on off off off on off off off off on on off on off off on off off on off on off off off off off off off off on on off on off off off.args with

* Add def args = task.ext.args line to all modules in script section

* Replace options.args with args and args_list

* Initialise args2 and args3 properly

* Replace container syntax

* Revert container changes for cellranger/mkref

* Replace getProcessName in all modules

* Replace getSoftwareName in all modules

* Unify modules using VERSION variable

* Replae options.suffix with task.ext.suffix

* Remove NF version restriction for CI

* Bump NF version in README

* Replace task.process.tokenize logic with task.process

* Minor tweaks to unify syntax in tests main.nf

* Add a separate nextflow.config for each module

* Transfer remaining module options to nextflow.config

* Remove addParams from tests main.nf

* Remove TODO statements

* Use -c to import module specific config

* Bump NF version to 21.10.3

* Fix tests for artic/minion

* Fix broken publishDir syntax

* Standardise and fix obvious failing module tests

* Remove kronatools to krona

* Comment out tags in subworkflow test.yml

* Fix failing module tests

* Add consistent indentation to nextflow.config

* Comment out subworklow definitions

* Fix kallistobustools/ref

* Fix rmarkdownnotebook

* Fix jupyternotebook

* Quote task.process

* Add plink2/vcf to pytest_modules.yml

* Remove NF_CORE_MODULES_TEST from pytest CI

* Fix more tests

* Move bacteroides_fragilis to prokaryotes folder

* Fix cooler merge tests

* Fix kallistobustools/count tests

* Fix kallistobustools/ref tests

* Update test_10x_1_fastq_gz file for kallistobustools/count tests

* Fix bcftools/query tests

* Fix delly/call tests

* Fix cooler/zoomify tests

* Fix csvtk/split tests

* Fix gatk4/intervallisttools tests

* Fix gatk4/variantfiltration

* Fix pydamage/filter tests

* Fix test data for unicycler

* Fix gstama/collapse module

* Fix leehom tests

* Fix metaphlan3 tests

* Fix pairtools/select tests

* Update nextflow.config

* Update nextflow.config

* feat: update syntax

* Fix arriba tests

* Fix more failing tests

* Update test syntax

* Remove comments from tests nextflow.config

* Apply suggestions from code review

* Fix kallistobustools/count module

* Update dumpsoftwareversions module

* Update custom/dumpsoftwareversions

* Add args2 to untar module

* Update leftover modules

* Remove last remaining addParams

* Change syntax from task.ext.suffix to tast.ext.prefix

* Change nextflow.config in all tests to use ext.prefix instead of ext.suffix

Co-authored-by: JoseEspinosa <kadomu@gmail.com>
Co-authored-by: Gregor Sturm <mail@gregor-sturm.de>
Co-authored-by: MaxUlysse <max.u.garcia@gmail.com>
2021-12-02 12:39:55 +00:00
Harshil Patel
20d8250d9f
Update all modules to new NF DSL2 syntax (#1099)
* Add comment line for consistency

* Remove all functions.nf

* Remove include functions.nf and publishDir options

* Replace options.args3 with task.ext.args3 - 3 modules

* Replace options.args3 with task.ext.args3 - 17 modules

* Replace {task.cpus} with task.cpus

* Replace off on off off off off off off off on off on off on off off off on off off off on on off off off on on off off off off off off off on off off off off on off on on off off off on on on on off off off on off on on off on on off off on on on off on on off on off off off off on off off off on off off on off on off off off on on off on off on off off on off off off on off off off on off off off off on off off off on on on off on on off off on off on on on off on on off on on on off off off off off on on off off on off off off off off on off off on on off on on off on off off off on off off off off on on off on off off on off off on off on off off off off off off off off on on off on off off off.args with

* Add def args = task.ext.args line to all modules in script section

* Replace options.args with args and args_list

* Initialise args2 and args3 properly

* Replace container syntax

* Revert container changes for cellranger/mkref

* Replace getProcessName in all modules

* Replace getSoftwareName in all modules

* Unify modules using VERSION variable

* Replae options.suffix with task.ext.suffix

* Remove NF version restriction for CI

* Bump NF version in README

* Replace task.process.tokenize logic with task.process

* Minor tweaks to unify syntax in tests main.nf

* Add a separate nextflow.config for each module

* Transfer remaining module options to nextflow.config

* Remove addParams from tests main.nf

* Remove TODO statements

* Use -c to import module specific config

* Bump NF version to 21.10.3

* Fix tests for artic/minion

* Fix broken publishDir syntax

* Standardise and fix obvious failing module tests

* Remove kronatools to krona

* Comment out tags in subworkflow test.yml

* Fix failing module tests

* Add consistent indentation to nextflow.config

* Comment out subworklow definitions

* Fix kallistobustools/ref

* Fix rmarkdownnotebook

* Fix jupyternotebook

* Quote task.process

* Add plink2/vcf to pytest_modules.yml

* Remove NF_CORE_MODULES_TEST from pytest CI

* Fix more tests

* Move bacteroides_fragilis to prokaryotes folder

* Fix cooler merge tests

* Fix kallistobustools/count tests

* Fix kallistobustools/ref tests

* Update test_10x_1_fastq_gz file for kallistobustools/count tests

* Fix bcftools/query tests

* Fix delly/call tests

* Fix cooler/zoomify tests

* Fix csvtk/split tests

* Fix gatk4/intervallisttools tests

* Fix gatk4/variantfiltration

* Fix pydamage/filter tests

* Fix test data for unicycler

* Fix gstama/collapse module

* Fix leehom tests

* Fix metaphlan3 tests

* Fix pairtools/select tests

* Update nextflow.config

* Update nextflow.config

* feat: update syntax

* Fix arriba tests

* Fix more failing tests

* Update test syntax

* Remove comments from tests nextflow.config

* Apply suggestions from code review

* Fix kallistobustools/count module

* Update dumpsoftwareversions module

* Update custom/dumpsoftwareversions

* Add args2 to untar module

* Update leftover modules

* Remove last remaining addParams

Co-authored-by: JoseEspinosa <kadomu@gmail.com>
Co-authored-by: Gregor Sturm <mail@gregor-sturm.de>
Co-authored-by: MaxUlysse <max.u.garcia@gmail.com>
2021-11-26 07:58:40 +00:00
Sébastien Guizard
1cf207a5b6
Update isoseq3/cluster (#856)
* 📦 NEW: Add isoseq3/cluster module

* 🐛FIX: Fix reports channel and add .pbi to it

* 🐛FIX: Fix report channel definition

* 👌IMPROVE: Move .pbi file into reports channel

* 👌IMPROVE: remove --use_qvs option from command line

* 👌 IMPROVE: Add in addParams removed options from command line

* 👌 IMPROVE: Add some pacbio test files

* 🐛 FIX: Add Pacbio index to test_data.config

* 👌 IMPROVE: Re add 10000 data test

* 👌 IMPROVE: Add some pbindex

* 🐛 FIX: Add pbi extension to files

* 👌 IMPROVE: The module accept one channel (primers moved into the first channel)

* 📦 NEW: Add galgal6 chr30 test data

* 📦 NEW: Add bamtools module

* 👌 IMPROVE: Ignore test data

* 👌 IMPROVE: Update to last templates version

* 👌 IMPROVE: Update to last templates version

* 👌 IMPROVE: add singletons parameter and improve outputs

* 🐛 FIX: Update test with last module model

* 👌 IMPROVE: Add test tag

* 👌 IMPROVE: Update module to last template version

* 👌 IMPROVE: Update module to last template version

* 👌 IMPROVE: Update test data config

* 👌 IMPROVE: Remove pbi from input files

* 👌 IMPROVE: Remove unused index

* 👌 IMPROVE: Final version of test datasets config

* 👌 IMPROVE: Final version of test datasets config

* 👌 IMPROVE: Remove useless index + Fix Typos

* 👌 IMPROVE: Remove useless index + Fix Typos

* 👌 IMPROVE: Fill contains args

* 📦 NEW: Add isoseq3/cluster module

* 🐛FIX: Fix reports channel and add .pbi to it

* 🐛FIX: Fix report channel definition

* 👌IMPROVE: Move .pbi file into reports channel

* 👌IMPROVE: remove --use_qvs option from command line

* 👌 IMPROVE: Add in addParams removed options from command line

* 👌 IMPROVE: Add some pacbio test files

* 🐛 FIX: Add Pacbio index to test_data.config

* 👌 IMPROVE: Re add 10000 data test

* 👌 IMPROVE: Add some pbindex

* 🐛 FIX: Add pbi extension to files

* 👌 IMPROVE: The module accept one channel (primers moved into the first channel)

* 👌 IMPROVE: Update to last templates version

* 👌 IMPROVE: add singletons parameter and improve outputs

* 🐛 FIX: Update test with last module model

* 👌 IMPROVE: Add test tag

* 👌 IMPROVE: Update test data config

* 👌 IMPROVE: Remove pbi from input files

* 👌 IMPROVE: Remove unused index

* 👌 IMPROVE: Final version of test datasets config

* 👌 IMPROVE: Remove useless index + Fix Typos

* 👌 IMPROVE: Fill contains args

* 👌 IMPROVE: Add some pacbio test files

* 🐛 FIX: Add Pacbio index to test_data.config

* 👌 IMPROVE: Re add 10000 data test

* 👌 IMPROVE: Add some pbindex

* 🐛 FIX: Add pbi extension to files

* 📦 NEW: Add galgal6 chr30 test data

* 📦 NEW: Add bamtools module

* 👌 IMPROVE: Ignore test data

* 👌 IMPROVE: Update to last templates version

* 👌 IMPROVE: Update module to last template version

* 👌 IMPROVE: Update module to last template version

* 👌 IMPROVE: Final version of test datasets config

* 👌 IMPROVE: Remove useless index + Fix Typos

* 👌 IMPROVE: Update code to new versions capture + better output channels

* 👌 IMPROVE: Update with new versions.yml file

* 🐛 FIX: Update meta.yml + correct typos

* 👌 IMPROVE: Clean output file names + correct typo

* 🐛 FIX: Remove bamtools/split module from isoseq3/cluster

* 🐛 FIX: Update output filename pattern

input filename and output filename were the same

* 👌 IMPROVE: Update meta.yml
2021-10-14 11:07:53 +01:00
Sébastien Guizard
5a49d2c1bf
New module: isoseq3/cluster (#801)
* 📦 NEW: Add isoseq3/cluster module

* 🐛FIX: Fix reports channel and add .pbi to it

* 🐛FIX: Fix report channel definition

* 👌IMPROVE: Move .pbi file into reports channel

* 👌IMPROVE: remove --use_qvs option from command line

* 👌 IMPROVE: Add in addParams removed options from command line

* 👌 IMPROVE: Add some pacbio test files

* 🐛 FIX: Add Pacbio index to test_data.config

* 👌 IMPROVE: Re add 10000 data test

* 👌 IMPROVE: Add some pbindex

* 🐛 FIX: Add pbi extension to files

* 👌 IMPROVE: The module accept one channel (primers moved into the first channel)

* 📦 NEW: Add galgal6 chr30 test data

* 📦 NEW: Add bamtools module

* 👌 IMPROVE: Ignore test data

* 👌 IMPROVE: Update to last templates version

* 👌 IMPROVE: Update to last templates version

* 👌 IMPROVE: add singletons parameter and improve outputs

* 🐛 FIX: Update test with last module model

* 👌 IMPROVE: Add test tag

* 👌 IMPROVE: Update module to last template version

* 👌 IMPROVE: Update module to last template version

* 👌 IMPROVE: Update test data config

* 👌 IMPROVE: Remove pbi from input files

* 👌 IMPROVE: Remove unused index

* 👌 IMPROVE: Final version of test datasets config

* 👌 IMPROVE: Final version of test datasets config

* 👌 IMPROVE: Remove useless index + Fix Typos

* 👌 IMPROVE: Remove useless index + Fix Typos

* 👌 IMPROVE: Fill contains args

* 📦 NEW: Add isoseq3/cluster module

* 🐛FIX: Fix reports channel and add .pbi to it

* 🐛FIX: Fix report channel definition

* 👌IMPROVE: Move .pbi file into reports channel

* 👌IMPROVE: remove --use_qvs option from command line

* 👌 IMPROVE: Add in addParams removed options from command line

* 👌 IMPROVE: Add some pacbio test files

* 🐛 FIX: Add Pacbio index to test_data.config

* 👌 IMPROVE: Re add 10000 data test

* 👌 IMPROVE: Add some pbindex

* 🐛 FIX: Add pbi extension to files

* 👌 IMPROVE: The module accept one channel (primers moved into the first channel)

* 👌 IMPROVE: Update to last templates version

* 👌 IMPROVE: add singletons parameter and improve outputs

* 🐛 FIX: Update test with last module model

* 👌 IMPROVE: Add test tag

* 👌 IMPROVE: Update test data config

* 👌 IMPROVE: Remove pbi from input files

* 👌 IMPROVE: Remove unused index

* 👌 IMPROVE: Final version of test datasets config

* 👌 IMPROVE: Remove useless index + Fix Typos

* 👌 IMPROVE: Fill contains args

* 👌 IMPROVE: Add some pacbio test files

* 🐛 FIX: Add Pacbio index to test_data.config

* 👌 IMPROVE: Re add 10000 data test

* 👌 IMPROVE: Add some pbindex

* 🐛 FIX: Add pbi extension to files

* 📦 NEW: Add galgal6 chr30 test data

* 📦 NEW: Add bamtools module

* 👌 IMPROVE: Ignore test data

* 👌 IMPROVE: Update to last templates version

* 👌 IMPROVE: Update module to last template version

* 👌 IMPROVE: Update module to last template version

* 👌 IMPROVE: Final version of test datasets config

* 👌 IMPROVE: Remove useless index + Fix Typos

* 👌 IMPROVE: Update code to new versions capture + better output channels

* 👌 IMPROVE: Update with new versions.yml file

* 🐛 FIX: Update meta.yml + correct typos

* 👌 IMPROVE: Clean output file names + correct typo

* 🐛 FIX: Remove bamtools/split module from isoseq3/cluster
2021-10-07 10:06:02 +01:00
Sébastien Guizard
79d38a306b
New module: isoseq3/refine (#748)
* 📦 NEW: Add isoseq3/refine module

* 👌 IMPROVE: Add some pacbio test files

* 🐛 FIX: Add Pacbio index to test_data.config

* 👌 IMPROVE: Re add 10000 data test

* 👌 IMPROVE: Add parallelization

* 🐛 FIX: Correct Typo

* 👌 IMPROVE: Add some pbindex

* 🐛 FIX: Add pbi extension to files

* 👌 IMPROVE: The module accept one channel (primers moved into the first channel)

* 👌 IMPROVE: Assign a value channel to primers input 

Improve workflow code readability

* 👌 IMPROVE: Update to the version of templates

* 👌 IMPROVE: Update module to last template version

* 👌 IMPROVE: Remove pbi from input files

* 👌 IMPROVE: Update test file

* 👌 IMPROVE: Final version of test datasets config

* 👌 IMPROVE: Remove useless index + Fix Typos

* 👌 IMPROVE: Fill contains args

* 📦 NEW: Add isoseq3/refine module

* 👌 IMPROVE: Add parallelization

* 🐛 FIX: Correct Typo

* 👌 IMPROVE: Add some pacbio test files

* 🐛 FIX: Add Pacbio index to test_data.config

* 👌 IMPROVE: Re add 10000 data test

* 👌 IMPROVE: Add some pbindex

* 🐛 FIX: Add pbi extension to files

* 👌 IMPROVE: The module accept one channel (primers moved into the first channel)

* 👌 IMPROVE: Assign a value channel to primers input 

Improve workflow code readability

* 👌 IMPROVE: Update to the version of templates

* 👌 IMPROVE: Update module to last template version

* 👌 IMPROVE: Remove pbi from input files

* 👌 IMPROVE: Update test file

* 👌 IMPROVE: Final version of test datasets config

* 👌 IMPROVE: Remove useless index + Fix Typos

* 👌 IMPROVE: Fill contains args

* 👌 IMPROVE: Add one channel per output file

* 👌 IMPROVE: Minor updates

* 👌 IMPROVE: Minors Update

- Remove TODO from test.yml
- Remove useless piece of code

* 📦 NEW: Add isoseq3/refine module

* 👌 IMPROVE: Add parallelization

* 🐛 FIX: Correct Typo

* 👌 IMPROVE: Add some pacbio test files

* 🐛 FIX: Add Pacbio index to test_data.config

* 👌 IMPROVE: Re add 10000 data test

* 👌 IMPROVE: Add some pbindex

* 🐛 FIX: Add pbi extension to files

* 👌 IMPROVE: The module accept one channel (primers moved into the first channel)

* 👌 IMPROVE: Assign a value channel to primers input 

Improve workflow code readability

* 👌 IMPROVE: Update to the version of templates

* 👌 IMPROVE: Update module to last template version

* 👌 IMPROVE: Remove pbi from input files

* 👌 IMPROVE: Update test file

* 👌 IMPROVE: Fill contains args

* 📦 NEW: Add isoseq3/refine module

* 👌 IMPROVE: Add parallelization

* 🐛 FIX: Correct Typo

* 👌 IMPROVE: Add some pacbio test files

* 🐛 FIX: Add Pacbio index to test_data.config

* 👌 IMPROVE: Re add 10000 data test

* 👌 IMPROVE: Add some pbindex

* 🐛 FIX: Add pbi extension to files

* 👌 IMPROVE: The module accept one channel (primers moved into the first channel)

* 👌 IMPROVE: Assign a value channel to primers input 

Improve workflow code readability

* 👌 IMPROVE: Update to the version of templates

* 👌 IMPROVE: Update module to last template version

* 👌 IMPROVE: Remove pbi from input files

* 👌 IMPROVE: Update test file

* 👌 IMPROVE: Add one channel per output file

* 👌 IMPROVE: Minor updates

* 👌 IMPROVE: Minors Update

- Remove TODO from test.yml
- Remove useless piece of code

* 🐛 FIX: Remove unwanted files

* 🐛 FIX: Protect \

* 🐛 FIX: Remove test files

* Apply suggestions from code review

* Apply suggestions from code review

* Update tests/modules/isoseq3/refine/test.yml

Co-authored-by: Gregor Sturm <mail@gregor-sturm.de>
Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>
2021-10-06 11:13:48 +01:00