Commit graph

1299 commits

Author SHA1 Message Date
Edmund Miller
bf165afd16
ci: Seperate out out copying nextflow to bin 2021-04-12 14:41:37 -05:00
Edmund Miller
9f6641f80f
dummy: Poke fastqc 2021-04-12 14:31:53 -05:00
Edmund Miller
b0e235d676
ci: Fix nextflow cache skip 2021-04-12 14:25:22 -05:00
Edmund Miller
180ea5b422
ci: Fix nextflow cache order 2021-04-12 14:24:33 -05:00
Edmund Miller
f8f9155b45
ci: Fix pip skip 2021-04-12 14:22:38 -05:00
Edmund Miller
ec3a2172a6
ci: Remove duplicate python setups 2021-04-12 14:20:21 -05:00
Harshil Patel
c99ab09f8d
Add kraken2 pigz multi-tool container for compressing output fastq files (#434)
* Add kraken2 pigz multi-tool container for compressing output fastq files

* Add untar to pytest config

* Add untar process to kraken2 tests

* Remove unneeded tags
2021-04-12 18:47:34 +02:00
Anthony Underwood
df8910de4e
Iqtree (#435)
* Resolve suggests after PR review

* add newline to functions

* need variable interpolation using double quotes; remove unnecessary tag

* add a more resilient link to raw github files

* remove trailing slash

* Update software/iqtree/main.nf

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>
2021-04-12 17:01:26 +01:00
Jose Espinosa-Carrasco
3ac21ff0dc
Add abacas module (#431)
* Add abacas module

* Add test for abacas module

* Add Harshil to authorship

* Updating test with the data uploaded to nf-core/datasets

* Apply suggestions from code review

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>
2021-04-12 15:37:08 +01:00
Kevin Menden
0b402ffda8
Move test data to nf-core/test-datasets (#432)
* initial 'modules create' of minia

* fixed tests

* finished meta.yml

* fixed filters.yml

* resolved issues in pytest_software.yml

* add newline

* Update software/minia/main.nf

* fixing a bunch of module tests

* remove vscode

* fixed minia

* move test data directory to nf-core/test-datasets

* bump multiqc version

* remove the test data

* updated test data link

* update README

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>
2021-04-12 12:32:39 +01:00
Jose Espinosa-Carrasco
2c43c39ccc
Add pycoqc module (#424)
* Add pycoqc module

* Adding pycoqc module tests

* Update pycoqc wilth new functions.nf

* Update tests to check for json report content
2021-04-12 10:52:14 +01:00
Anthony Underwood
575df10781
add new iqtree module (#427)
* add new iqtree module

* Resolve suggests after PR review

* add newline to functions
2021-04-12 09:45:56 +01:00
Harshil Patel
65a3422686
Add default publish_dir for index processes (#428) 2021-04-10 20:49:09 +01:00
Anthony Underwood
212177d479
output constant sites as a val so it can be passed into iqtree (#429)
* output constant sites as a val as well as a file so it can be passed into iqtree

* Using an env variable because that's far safer!

* Update software/snpsites/main.nf

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>
2021-04-10 18:49:35 +01:00
Thanh Lee
ec15bae344
🏋️‍♀️ new submodule mash/sketch🕺 (#426)
* new submodule mash/sketch

* fixed submodule naming

* OK, tag is diff to keyword

* OK  another round 🤣

* removed TODO comments

* updated as per review comments 🙆‍♂️

* updated functions.nf 😁

* Update software/mash/sketch/main.nf

* Update main.nf

Removed blank line at the 12th

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>
2021-04-10 16:24:23 +01:00
Harshil Patel
dce27b8102
Update functions.nf to be more flexible for publishing by meta keys (#423)
* Update functions.nf

* Replace saveAs line in module main script

* Add spacing for ECLint
2021-04-09 17:23:56 +01:00
Harshil Patel
5e18e36895
Update and check tests are running for all modules (#420)
* Fixes for PR 371

* Fix tags

* Add md5sum

* Add md5sums for stringtie

* Fix tests for modules where subtool = build

* Fix pytest_software name conflicts

* Change _ to / in test.yml tags

* Nope...that didnt work

* Fix sequenzautils/bam2seqz tests
2021-04-09 13:47:05 +01:00
Thanh Lee
5a59e61052
new module: rasusa (#413)
* new module: rasusa

* Removed blank line in software/rasusa/main

* updated code as per reviewcomments

* removed blank line as failed for lint

* updated as per review comments

* Apply suggestions from code review

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>
2021-04-09 13:10:32 +01:00
Anthony Underwood
ca776e76a2
add rapidnj module (#421)
* add rapidnj module

* remove trailing whitespace

* Apply suggestions from code review

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>
2021-04-09 13:04:54 +01:00
Florian Wuennemann
0f53c3b96b
Added kallistobustools/ref (#408)
* Added kallistobustools/ref. Local tests all passing with Docker. Linting passed. Test data currently in /tests/data/delete_me

* Removed trailing whitespace line 29

* Moved workflow from meta to options.

* Update main.nf

* Forgot to remove previous testing input channel for workflow.

* Apply suggestions from code review

Applied changes suggested by @drpatelh

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* Added gtf to meta.yml.

* Apply suggestions from code review

Adding @drpatelh suggested changes.

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* Moved workflow to input value. Fixed tests.

* Update tests/software/kallistobustools/ref/test.yml

* Apply suggestions from code review

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>
2021-04-09 09:41:41 +01:00
Yuk Kei Wan
16e8d21477
Nanoplot and sequencing_summary.txt for Nanopore test data (#364)
* add nanoplot

* add Nanopore 100 read subset bam and fastq

* add nanoplot module and sequencing_summary.txt

* Update pytest_software.yml

* Update main.nf

* test directory path

* testing one output file

* Update main.nf

* fix typo

* remove path to test outputs (it worked locally)

* use test_data.config in test

* add meta.yml

* allowing either summary.txt or fastq.gz inputs

* fix linting and test.yml

* test whether github check can catch the output

* add summary.txt test output paths

* check Nanoplot-report.html output
2021-04-09 08:31:38 +01:00
Anthony Underwood
6927f1d086
New Snpsites module (#416)
* new gubbins module

* new gubbins module

* new gubbins module

* Update software/gubbins/main.nf

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* Update software/gubbins/main.nf

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* Update software/gubbins/main.nf

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* Update software/gubbins/meta.yml

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* new gubbins module

* new gubbins module

* new gubbins module

* new gubbins module

* new gubbins module

* new gubbins module

* new gubbins module

* Update tests/config/test_data.config

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* Update tests/software/gubbins/main.nf

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* new gubbins module

* new gubbins module

* new snpsites module

* new snpsites module

* new snpsites module

* new snpsites module

* adding fasttree module

* correct trailing whitespace

* using sarscov2 as a test dir

* use sars-cov-2 alignment

* remove old test alignment

* new snpsites module

* new snpsites module

* new snpsites module

* updated test file names

* new snpsites module

* revert to gubbins test on upstream

* add new lines

* renove whitespace

* Apply suggestions from code review

Co-authored-by: avantonder <avt@sanger.ac.uk>
Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>
Co-authored-by: avantonder <ajv37@cam.ac.uk>
2021-04-09 08:00:33 +01:00
Harshil Patel
f34892c1af
Test PR for nf-core modules lint (#414)
* Update functions.nf for publish_by_id

* Pass a list of publish_by_id instead of a string

* Remove NF version

* Rename code linting file

* Run separate workflow for nf-core modules lint

* Adjust nf-core update comment

* Comment out linting from pytest-workflow.yml

* Remove commented out linting code from pytest-workflow.yml

* Adjust spacing

* Adjust spacing again

* Move NF version to job level for linting

* Add CAPSULE_LOG none env when installing NF

* Remove NXF_ANSI_LOG env for linting

* Revert changes
2021-04-09 07:58:43 +01:00
Anthony Underwood
63b3975292
Update gubbins module to use new files (#417)
* new gubbins module

* new gubbins module

* new gubbins module

* Update software/gubbins/main.nf

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* Update software/gubbins/main.nf

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* Update software/gubbins/main.nf

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* Update software/gubbins/meta.yml

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* new gubbins module

* new gubbins module

* new gubbins module

* new gubbins module

* new gubbins module

* new gubbins module

* new gubbins module

* Update tests/config/test_data.config

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* Update tests/software/gubbins/main.nf

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* new gubbins module

* new gubbins module

* new snpsites module

* new snpsites module

* new snpsites module

* new snpsites module

* adding fasttree module

* correct trailing whitespace

* using sarscov2 as a test dir

* use sars-cov-2 alignment

* remove old test alignment

* new snpsites module

* new snpsites module

* new snpsites module

* updated test file names

* new snpsites module

* remove snpsites from gubbins branch

* remove redundant test_fas alignment

* update md5 sums

Co-authored-by: avantonder <avt@sanger.ac.uk>
Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>
Co-authored-by: avantonder <ajv37@cam.ac.uk>
2021-04-09 07:54:11 +01:00
Jose Espinosa-Carrasco
f90dde0d88
Add plasmidid module (#410)
* Adding plasmidid module

* Adding test for plasmidid module

* Update plasmidid version to 1.6.4

* Adding contigs.fasta file

* Update tests

* Adding output files on test.yml
2021-04-08 22:44:30 +01:00
Anthony Underwood
be390a25e5
adding fasttree module (#412)
* adding fasttree module

* correct trailing whitespace

* using sarscov2 as a test dir

* remove TODO

* update test data naming

* further test data naming updates

* remove options in favour of $options.args

* ensure non standard exit codes don't cause an issue

* update md5sum
2021-04-08 18:15:23 +01:00
Edmund Miller
a3684d9594
Lint modules ci (#389)
* ci: Add modules lint step

Moved it ahead of the nextflow install so ideally it'll fail before we
bother doing any more setup

* ci: _ => /

* Update tests/config/pytest_software.yml

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>
2021-04-08 09:10:52 +01:00
avantonder
710ab76b90
new module: gubbins (#377)
* new gubbins module

* new gubbins module

* new gubbins module

* Update software/gubbins/main.nf

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* Update software/gubbins/main.nf

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* Update software/gubbins/main.nf

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* Update software/gubbins/meta.yml

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* new gubbins module

* new gubbins module

* new gubbins module

* new gubbins module

* new gubbins module

* new gubbins module

* new gubbins module

* Update tests/config/test_data.config

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* Update tests/software/gubbins/main.nf

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* new gubbins module

* new gubbins module

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>
2021-04-07 16:31:24 +01:00
Harshil Patel
7c2f10f591
Fix tabix/bgzip version command (#407) 2021-04-07 08:39:53 +01:00
Harshil Patel
242fdb2f73
Version bumps and minor module updates (#406)
* Version bumps and minor module updates

* Fix Pangolin tests

* Fix SPAdes tests

* stageAs @phue
2021-04-06 13:38:41 +01:00
Patrick Hüther
3b1dcc9cc0
MethylDackel: fix version scraping (#401)
* methyldackel: fix version scraping

* fix output file path
2021-04-06 10:59:33 +01:00
Patrick Hüther
6c70d65ae6
bismark/report: allow missing input data (#400)
* bismark/report: allow missing data

* bismark/summary: improve matching of process output
2021-04-06 10:59:00 +01:00
Patrick Hüther
4a1571317d
update bwameth container build to match conda version (#402) 2021-04-06 10:45:14 +01:00
Jose Espinosa-Carrasco
f8e428d690
Restructuring spades tests whith new test data sets + fixing spades tests (#396)
* Restructuring with new test data sets + fixing tests

* Remove checkings for warning files

* Remove md5 check for test.gene_clusters.fa

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>
2021-04-01 20:31:23 +01:00
Robert A. Petit III
c9256616b9
update tests for new config (#384)
* update tests for new config

* fix quast, update more

* more updates!

* more tests updated

* fix tests, added tabix gff3.gz

* Delete main.nf

Removing SPAdes from PR to avoid merge conflicts with https://github.com/nf-core/modules/pull/396

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>
2021-04-01 20:22:06 +01:00
Nicholas Toda
f126d980d7
Add tests for subread #106 (#393)
* inital commit

* added meta.yaml info

* add initial logic for featurecounts test

* add args and change SE/PE to strandedness for featurecounts test

* added tests to pytest

* added test.yml

* removed GTF flag in options

* corrected test meta params

* meta yaml corrected tool info

* update test.yml

* fix lint errors meta.yml

Co-authored-by: Nicholas TODA <nicholas.toda@mnhn.fr>
2021-04-01 20:02:36 +01:00
Ravneet Bhuller
c5c59d44a1
PR for sequenzautils/bam2seqz (#395)
* added files

* edited files

* removed file

* README.md edited

Co-authored-by: kaurravneet4123 <kaurravneet4123@yahoo.com@users.noreply.github.com>
2021-04-01 07:08:27 +02:00
sruthipsuresh
983ba000c1
New modules: Fgbio callmolecularconsensusreads and sortbam (#352)
* Added fgbio callmolecularconsensusreads and sortbam modules

* Fixed naming issue in meta.yml

* fix: test.yml and config lint

* Revert "fix: test.yml and config lint"

This reverts commit 0453bc3a8dc3dab6997442a4349ee2241adcc380, which caused the sortbam tests to fail.

* style: Fix test names

* style: Remove trailing whitespace

* fixed test.yml

* fix: test data in sortbam

* fix: data format

* fix: test data for callmolecularconsensusreads

* Corrected with updated test data

* Apply suggestions from code review

Applied changes from code review, mainly syntactical changes

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

Co-authored-by: Sruthi Suresh <sps180004@ganymede.utdallas.edu>
Co-authored-by: Edmund Miller <edmund.a.miller@protonmail.com>
Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>
2021-03-28 20:38:50 +01:00
JJ
e50a525715
gatk4 markduplicates (#356)
* new module gatk4/markduplicates

* add tests

* add gatk4_markduplicates entry in pytest_software.yml

* Update software/gatk4/markduplicates/main.nf

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* Update software/gatk4/markduplicates/main.nf

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* Update software/gatk4/markduplicates/main.nf

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* Update software/gatk4/markduplicates/main.nf

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* Update tests/software/gatk4/markduplicates/main.nf

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* Update tests/software/gatk4/markduplicates/main.nf

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* Apply suggestions from code review

* Fix EC lint

* Update md5sum

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>
2021-03-26 23:25:40 +00:00
suzannejin
989fb7d5b7
modify test path - module gatk4 + added new module gatk4/haplotypecaller (#382)
* new module: samtools/fastq

* solve conflict: pytest_software.yml

* solve linting conflicts

* solved EditorConfig linting problem

* Module samtools/fastq:
	* output compressed fastq.gz file(s)
	* add if conditionals for single/paired reads

* samtools/fastq: modified test.yml

* samtools/fastq: modified main.nf to avoid duplicated part of the script section

* fix README.md

* modify test path gatk4

* fix config

* Add new module gatk4/haplotypecaller

* solve check issues

* fix test.yml file

* fix test.yml gz.tbi

* Update software/gatk4/haplotypecaller/main.nf

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* Update software/gatk4/haplotypecaller/main.nf

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* Update software/gatk4/haplotypecaller/main.nf

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* Update software/gatk4/haplotypecaller/meta.yml

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* Update software/gatk4/haplotypecaller/meta.yml

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* Update tests/software/gatk4/haplotypecaller/main.nf

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* Apply suggestions from code review

Co-authored-by: suzannejin <suzanne.jin@crg.eu>
Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>
2021-03-26 12:46:46 +01:00
Nicholas Toda
e526eae472
Add tests for hisat2 (#366)
* initial commit hisat2/build

* initial commit hisat2/build

* changed names for hisat2

* fixed directory structure and args

* added splice site test data

* added splice site inputs

* replaced list with individual args

* fixed removed commas

* added test yml file

* updated hisat2 conda version

* added meta.yml

* added meta.yml description

* added meta.yml inputs

* added meta.yml outputs

* update conda version for hisat2

* removed trailing whitespace meta.yml

* fixed version number for containers

* added test data to test config

* updated for new test logic

* fix pytest issue?

* fix pytest issue

* fixed wrong tool in meta.yaml

* updated tets.yaml name

* handle build bug for testing

* handle build bug for testing in yaml

* moved test folder to fix build bug

* use old hisat2 version to avoid conda giving inconsistent md5sum

* initial commit

* removed temp file

* added meta yaml

* add to pytest

* added tests

* added test yml

* add align meta yaml

* add hisat2 align to pytest

* remove need for splice data by calling process

* add hisat2 align se test

* add hisat2 align pe test

* update names hisat2 align

* update software pytest for using mutiple modules

* remove splice site test data since using module instead

* remove splice site from config since using module instead

* fixed extra brace

* added hisat2 align test.yml

* removed md5sum for bam files

* updated build md5sums

* Apply suggestions from code review

Co-authored-by: Nicholas TODA <nicholas.toda@mnhn.fr>
Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>
2021-03-25 21:08:46 +00:00
kevbrick
fead37d57a
Add module: nf-core hackathon #207 : new module: msisensor/msi (#343)
* Add module: nf-core hackathon #207 : new module: msisensor/msi

* Add module: nf-core hackathon #207 : new module: msisensor/msi

* Fix 4-spacing issues (caught in PR linting)

* Code review fixes & update configs

* Code review: remove stray echo

* Code review: Add msisensor modules

* Slashes to underscores to get tests to run on github

* Update software/msisensor/scan/main.nf

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* Update software/msisensor/scan/main.nf

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* Update software/msisensor/msi/main.nf

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* Update software/msisensor/msi/main.nf

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* Add all outputs to meta.ymls

* Fixes from code review

* Fixes from code review

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>
2021-03-25 16:46:00 -04:00
Batool
f90b8ecb24
Fix the test path salmon/index and quant after switching to config data (#385)
* fix the test path in main.nf for salmon/index and quant

* fix typo

* Apply suggestions from code review

* Apply suggestions from code review

* Apply suggestions from code review

Mannnn, hopefully I finally got it right :)

* replaced /salmon/salmon/ with /index/salmon/

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>
2021-03-25 17:03:25 +00:00
Edmund Miller
6e4b23a1ca
ci: Upload work directory on failure (#388)
Closes #374
2021-03-25 09:34:19 +00:00
FriederikeHanssen
555f1710e0
Update test paths in bwa mappers (#387)
* Update test paths in bwa mappers

* Fix indentation

* indices pass lcoally now

* no idea how they could ever pass before, Tests pass locally no

* Update samtools and bwamem2 versions

* Correct mulled containers + md5
2021-03-25 09:24:21 +00:00
Kevin Menden
6973df628f
Fixing vcftools and bismark tests (#383)
* fixed vcftools

* fixed genomepreparation, methylationextractor

* fixed deduplicate
2021-03-25 09:12:08 +00:00
Jose Espinosa-Carrasco
13bd67ed8a
Fix some module test after adapting test config approach (#379)
* Fix paths for bowtie2/build_test

* Fix paths for bowtie2/align

* Fix paths for bwameth/index

* Fix paths for bwameth/align

* Fix paths for multiqc tests
2021-03-24 18:29:41 +00:00
Gregor Sturm
2dba72dd14
Fix a bunch of failing tests after switching to test config (#378)
* Update test for trimgalore

* Fix picard markduplicate test

* Fix tests for picard mergesamfiles

* Fix checksum for markduplicates

* Fix multiplemetrics and wgsmetrics

* Fix checksum for mergesamfiles
2021-03-24 18:28:54 +00:00
Jose Espinosa-Carrasco
17fbdf96cb
Fix some module tests after switching to config data (#386)
* Adding tar.gz kraken2 db to test data

* Update test path files for untar module

* Update test path files for kraken2/run module

* Update test path files for cat/fastq module
2021-03-24 18:28:07 +00:00
pericsson
1e4fa57139
Update restructured paths (#380)
* dsh filterbed path updated

* dsh splitbed path updated

* adapterremoval path updated
2021-03-24 18:26:54 +00:00