Commit graph

1325 commits

Author SHA1 Message Date
Kevin Menden
5e86245388
updated paths to test data (#478)
* updated paths to test data

* Update test_data.config

changed file names
2021-05-03 07:13:07 +01:00
Yuk Kei Wan
6ad50f8ec4
Add stringtie merge module (from nanoseq modules) (#475)
* add stringtie merge module

* add md5sum and path for stringtie.merged.gtf

* fix errors

* try fixing stringtie check error

* add tag

* remove unreproducible md5sum

* address PR suggestions

* hopefully fix linting error
2021-05-03 07:18:51 +02:00
Charles Plessy
16d20a7cc4
New last/lastdb module to index sequences before alignment. (#476)
* New last/lastdb module to index sequences before alignment.

The `lastdb` command creates a sequence index for the LAST aligner
(https://gitlab.com/mcfrith/last). Input can be in FASTA or FASTQ
format, and compression is handled automagically.  DNA or protein
sequences can be indexed.

The sequence index is a collection of files sharing the same basename.
This module sets the basename to the sample identifier (`$meta.id`) and
creates the index in a directory always called `lastdb`.  The module's
output channel then conveys a copy of the metadata and the path to the
`lastdb` directory.

Other modules will follow (see Issue #464).  The LAST aligner can align
proteins to proteins, DNA to DNA and can translate DNA align to
proteins.

* Remove trailing whitespace.

* Apply suggestions from code review

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* Update as suggested in PR.

* Attempt to pass linting.

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>
2021-05-02 11:36:31 +01:00
Anthony Underwood
f9433639cf
Update README to include some git best practices (#415)
* Update README to include some git best practices

* correct linting errors

* extra info about returning to master and deleting the branch

* use rebase

* stress importance of rebase

* Update README to include some git best practices

* correct linting errors

* extra info about returning to master and deleting the branch

* Changed position of git commands

* move later git commands down the action list
2021-04-30 17:27:06 +01:00
Harshil Patel
466ab67808
Fixes for nanoseq modules (#479)
* Fix minimap2 index module

* Fix minimap2 index tests

* Fix graphmap2 index module

* Fix graphmap2 module

* Fix ECLint

* Fix bedtools bamtobed module

* Fix tests for bedtools bamtobed module

* Add tag for graphmap2 align module

* Fix EClint

* Fix qcat module

* Add md5sum for graphmap2/align module

* Remove non-started test data file

* Remove md5sum for graphmap2 align
2021-04-30 15:57:43 +01:00
Yuk Kei Wan
05f479f03a
add qcat module (from nanoseq modules) (#469)
* add qcat module

* remove md5sum(nom-reproducible)
2021-04-30 13:20:56 +01:00
Yuk Kei Wan
3f804ee667
add bedtools bamtobed module (from nanoseq modules) (#466)
* add bedtools bamtobed module

* fix erros

* fix linting problem
2021-04-30 13:20:31 +01:00
Yuk Kei Wan
a8720463ac
add graphmap index and align modules (from nanoseq modules) (#468)
* add graphmap index module

* add graphmap2/index

* add graohmap2 align module

* remove graphmap2 align md5sum
2021-04-30 13:18:58 +01:00
Yuk Kei Wan
05b067e907
add minimap2 index module (#467) 2021-04-30 13:18:11 +01:00
Kevin Menden
bbf8626b28
Bugfix (#477)
* initial 'modules create' of minia

* fixed tests

* finished meta.yml

* fixed filters.yml

* resolved issues in pytest_software.yml

* add newline

* Update software/minia/main.nf

* fixing a bunch of module tests

* remove vscode

* fixed minia

* remove the test data again

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>
2021-04-30 07:32:10 +02:00
Florian Wuennemann
88dda738ac
Added kallistobustools/count (#409)
* Basic kb-python count functionality for scRNA-seq quantification working.

* Added tests and test data for workflow kite.

* Removed trailing whitespace

* Changed output channels to tuples with meta

Based on suggestions by @KevinMenden.

* Moved workflow and technology to input variables. Currently create test-yaml file script failes with cryptic message.

* Update software/kallistobustools/count/main.nf

@KevinMenden fixed wrong path definition

Co-authored-by: Kevin Menden <kevin.menden@live.com>

* Increased version of kb-python

* Updated tests with raw links.

* Fixed subtool referencing: kallistobustools/count

* Added newline

* Update software/kallistobustools/count/main.nf

Co-authored-by: Kevin Menden <kevin.menden@live.com>
2021-04-30 07:27:17 +02:00
Anthony Underwood
6a31737cb8
Raxmlng (#474)
* raxml-ng is compute intensive - upgrade process label to high

* ensure raxmlng uses --all when bootstrapping

* remove block that should be taken of by the options passed in

* update tests
2021-04-29 08:20:05 +01:00
FriederikeHanssen
9ce4427275
Add gvcf index files (#472) 2021-04-28 20:23:10 +01:00
Anthony Underwood
9b0aa3e239
raxml-ng is compute intensive - upgrade process label to high (#473) 2021-04-28 20:21:44 +01:00
Florian Wuennemann
a5d0cf3686
Update kallistobustools/ref module (#465)
* Bump version and format references to use raw params.test_data

* Apply suggestions from code review

Co-authored-by: Kevin Menden <kevin.menden@live.com>

* Updated tags

Missed on in last commit.

Co-authored-by: Kevin Menden <kevin.menden@live.com>
2021-04-28 14:54:40 +02:00
Daniel Lundin
d7a3286a9a
New module to use hmmalign from HMMER to align sequences (#470)
* Ignore vim tmp files

* Added hmmalign module, not yet tests

* Test output

* Replaced functions.nf for hmmalign with upstream

* Update software/hmmer/hmmalign/main.nf

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* Update software/hmmer/hmmalign/main.nf

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* Update software/hmmer/hmmalign/meta.yml

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* Update tests/software/hmmer/hmmalign/main.nf

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* Update tests/software/hmmer/hmmalign/main.nf

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* Update tests/software/hmmer/hmmalign/test.yml

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* Update tests/config/pytest_software.yml

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* Update software/hmmer/hmmalign/main.nf

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>
2021-04-28 11:21:24 +01:00
Jose Espinosa-Carrasco
d63ff4ba1b
Add artic guppyplex (#455)
* Adding artic guppyplex module

* Adding guppyplex tests

* Fix tests

* Correcting typo

* Fix lint

* Fix test

* Missing description

* Missing descriptions

* Update functions to last version as suggested

* Bump newest version of nanoplot
2021-04-27 15:57:34 +01:00
Maxime Garcia
789a799e41
feat: remove social preview image to use GitHub OpenGraph (#461) 2021-04-26 11:59:12 +01:00
Harshil Patel
9ea7f50963
Bump plasmidid version (#460)
* Bump plasmidid version

* Fix tests
2021-04-26 12:40:38 +02:00
FriederikeHanssen
ae154b8c3f
Add human data paths (#458)
* Add new human data and fix sarscov paths

* Fix filename typo

* Apply code review

* replace index with to match sarscov data

* lower case

* indent everythin

* Adapt sarscov keys to new naming convention

* Update test_data.config

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>
2021-04-19 15:30:43 +01:00
Kevin Menden
f7e3b8260c
change process.time for tests to 2h (#452) 2021-04-16 13:08:03 +01:00
Harshil Patel
d1c6082a66
Update modules required for rnaseq pipeline (#449)
* Update HISAT2 build module

* Bump preseq version

* Fix tests

* Add meta.yml for preseq to fix linting

* Auto-detect --genomeSAindexNbases for smaller genomes

* Add placeholder to use human data for the tests

* Add CSI output option to samtools/index

* Fix samtools/index tests
2021-04-16 08:56:47 +01:00
Harshil Patel
defaca4f1b
Add ucsc/bedclip module (#450)
* Add ucsc/bedclip module

* Fix tests

* Fix nf-core lint
2021-04-15 22:04:59 +02:00
Anthony Underwood
e2d64bd7ec
minor typo (#451) 2021-04-15 19:45:23 +01:00
Jose Espinosa-Carrasco
1e033bbf02
Fixing abacas meta.yml file (#447)
* Fixing abacas meta.yml file

* Fix lint test
2021-04-15 11:17:06 +01:00
Anthony Underwood
2ed9b6ae28
Raxmlng (#443)
* new raxml module

* new raxml module

* pass in args for bootstrap and add test for support file

* remove unnecessary tag

* ensure tags meet guidleines

* Apply suggestions from code review

* Update to latest functions file

Co-authored-by: avantonder <avt@sanger.ac.uk>
Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>
2021-04-14 08:38:59 +01:00
Jose Espinosa-Carrasco
750bd8c3e3
Finish deeptools modules (#442)
* Adding bigWig and deeptools computeMatrix files to config

* Adding meta.yml for deeptools modules

* Add test for deeptools modules

* Fixing and reordering tags

* Fixing conda test that worked in local...

* Apply suggestions from code review

* Changing bigwig file pattern to include bigwig extension

* Saving after last change is a good practice

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>
2021-04-13 21:48:43 +01:00
Kevin Menden
043a7d1e3c
remove deprecated test tags (#440)
* remove deprecated test tags

* fix bowtie, gatk4/applybsqr

* fix gatk4 baserecalibrator

* fixed shovill

* fixed yara/mapper

* fixed kallistobustools/ref paths
2021-04-13 18:03:09 +01:00
Jose Espinosa-Carrasco
a9fcbd93cc
Move assembly test files from genome to illumina (#441)
* FIx plasmidid tests for new contigs.fasta file

* Fixing two md5sum hashes

* Update test path in config for illumina assembly files

* Update modules using assembly files

* Correctly setting path of assembly files

* Update tests/config/test_data.config

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>
2021-04-13 12:52:11 +02:00
Jose Espinosa-Carrasco
26fdebc8de
FIx plasmidid tests for new contigs.fasta file (#438)
* FIx plasmidid tests for new contigs.fasta file

* Fixing two md5sum hashes
2021-04-13 08:49:44 +01:00
Kevin Menden
1d874bb0d0
Finish rseqc modules (#439)
* initial 'modules create' of minia

* fixed tests

* finished meta.yml

* fixed filters.yml

* resolved issues in pytest_software.yml

* add newline

* Update software/minia/main.nf

* fixing a bunch of module tests

* remove vscode

* fixed minia

* added rseqc/bamstat tests

* added tests/meta.yml for rseqc/inferexperiment

* added test/meta.yml for rseqc/inner_distances

* added meta.yml and tests/main.nf for junctionannotation (test not running)

* added test/meta.yml for rseqc/readdistribution

* finished test/meta.yml for rseqc/readduplication

* added entries to pytest_software.yml

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>
2021-04-13 08:49:32 +01:00
Thanh Lee
c736817598
🧸 Updated rasusa (#437)
* changed genome size input position

* fixed...😊
2021-04-12 21:47:55 +01:00
Harshil Patel
c99ab09f8d
Add kraken2 pigz multi-tool container for compressing output fastq files (#434)
* Add kraken2 pigz multi-tool container for compressing output fastq files

* Add untar to pytest config

* Add untar process to kraken2 tests

* Remove unneeded tags
2021-04-12 18:47:34 +02:00
Anthony Underwood
df8910de4e
Iqtree (#435)
* Resolve suggests after PR review

* add newline to functions

* need variable interpolation using double quotes; remove unnecessary tag

* add a more resilient link to raw github files

* remove trailing slash

* Update software/iqtree/main.nf

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>
2021-04-12 17:01:26 +01:00
Jose Espinosa-Carrasco
3ac21ff0dc
Add abacas module (#431)
* Add abacas module

* Add test for abacas module

* Add Harshil to authorship

* Updating test with the data uploaded to nf-core/datasets

* Apply suggestions from code review

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>
2021-04-12 15:37:08 +01:00
Kevin Menden
0b402ffda8
Move test data to nf-core/test-datasets (#432)
* initial 'modules create' of minia

* fixed tests

* finished meta.yml

* fixed filters.yml

* resolved issues in pytest_software.yml

* add newline

* Update software/minia/main.nf

* fixing a bunch of module tests

* remove vscode

* fixed minia

* move test data directory to nf-core/test-datasets

* bump multiqc version

* remove the test data

* updated test data link

* update README

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>
2021-04-12 12:32:39 +01:00
Jose Espinosa-Carrasco
2c43c39ccc
Add pycoqc module (#424)
* Add pycoqc module

* Adding pycoqc module tests

* Update pycoqc wilth new functions.nf

* Update tests to check for json report content
2021-04-12 10:52:14 +01:00
Anthony Underwood
575df10781
add new iqtree module (#427)
* add new iqtree module

* Resolve suggests after PR review

* add newline to functions
2021-04-12 09:45:56 +01:00
Harshil Patel
65a3422686
Add default publish_dir for index processes (#428) 2021-04-10 20:49:09 +01:00
Anthony Underwood
212177d479
output constant sites as a val so it can be passed into iqtree (#429)
* output constant sites as a val as well as a file so it can be passed into iqtree

* Using an env variable because that's far safer!

* Update software/snpsites/main.nf

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>
2021-04-10 18:49:35 +01:00
Thanh Lee
ec15bae344
🏋️‍♀️ new submodule mash/sketch🕺 (#426)
* new submodule mash/sketch

* fixed submodule naming

* OK, tag is diff to keyword

* OK  another round 🤣

* removed TODO comments

* updated as per review comments 🙆‍♂️

* updated functions.nf 😁

* Update software/mash/sketch/main.nf

* Update main.nf

Removed blank line at the 12th

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>
2021-04-10 16:24:23 +01:00
Harshil Patel
dce27b8102
Update functions.nf to be more flexible for publishing by meta keys (#423)
* Update functions.nf

* Replace saveAs line in module main script

* Add spacing for ECLint
2021-04-09 17:23:56 +01:00
Harshil Patel
5e18e36895
Update and check tests are running for all modules (#420)
* Fixes for PR 371

* Fix tags

* Add md5sum

* Add md5sums for stringtie

* Fix tests for modules where subtool = build

* Fix pytest_software name conflicts

* Change _ to / in test.yml tags

* Nope...that didnt work

* Fix sequenzautils/bam2seqz tests
2021-04-09 13:47:05 +01:00
Thanh Lee
5a59e61052
new module: rasusa (#413)
* new module: rasusa

* Removed blank line in software/rasusa/main

* updated code as per reviewcomments

* removed blank line as failed for lint

* updated as per review comments

* Apply suggestions from code review

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>
2021-04-09 13:10:32 +01:00
Anthony Underwood
ca776e76a2
add rapidnj module (#421)
* add rapidnj module

* remove trailing whitespace

* Apply suggestions from code review

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>
2021-04-09 13:04:54 +01:00
Florian Wuennemann
0f53c3b96b
Added kallistobustools/ref (#408)
* Added kallistobustools/ref. Local tests all passing with Docker. Linting passed. Test data currently in /tests/data/delete_me

* Removed trailing whitespace line 29

* Moved workflow from meta to options.

* Update main.nf

* Forgot to remove previous testing input channel for workflow.

* Apply suggestions from code review

Applied changes suggested by @drpatelh

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* Added gtf to meta.yml.

* Apply suggestions from code review

Adding @drpatelh suggested changes.

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* Moved workflow to input value. Fixed tests.

* Update tests/software/kallistobustools/ref/test.yml

* Apply suggestions from code review

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>
2021-04-09 09:41:41 +01:00
Yuk Kei Wan
16e8d21477
Nanoplot and sequencing_summary.txt for Nanopore test data (#364)
* add nanoplot

* add Nanopore 100 read subset bam and fastq

* add nanoplot module and sequencing_summary.txt

* Update pytest_software.yml

* Update main.nf

* test directory path

* testing one output file

* Update main.nf

* fix typo

* remove path to test outputs (it worked locally)

* use test_data.config in test

* add meta.yml

* allowing either summary.txt or fastq.gz inputs

* fix linting and test.yml

* test whether github check can catch the output

* add summary.txt test output paths

* check Nanoplot-report.html output
2021-04-09 08:31:38 +01:00
Anthony Underwood
6927f1d086
New Snpsites module (#416)
* new gubbins module

* new gubbins module

* new gubbins module

* Update software/gubbins/main.nf

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* Update software/gubbins/main.nf

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* Update software/gubbins/main.nf

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* Update software/gubbins/meta.yml

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* new gubbins module

* new gubbins module

* new gubbins module

* new gubbins module

* new gubbins module

* new gubbins module

* new gubbins module

* Update tests/config/test_data.config

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* Update tests/software/gubbins/main.nf

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* new gubbins module

* new gubbins module

* new snpsites module

* new snpsites module

* new snpsites module

* new snpsites module

* adding fasttree module

* correct trailing whitespace

* using sarscov2 as a test dir

* use sars-cov-2 alignment

* remove old test alignment

* new snpsites module

* new snpsites module

* new snpsites module

* updated test file names

* new snpsites module

* revert to gubbins test on upstream

* add new lines

* renove whitespace

* Apply suggestions from code review

Co-authored-by: avantonder <avt@sanger.ac.uk>
Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>
Co-authored-by: avantonder <ajv37@cam.ac.uk>
2021-04-09 08:00:33 +01:00
Harshil Patel
f34892c1af
Test PR for nf-core modules lint (#414)
* Update functions.nf for publish_by_id

* Pass a list of publish_by_id instead of a string

* Remove NF version

* Rename code linting file

* Run separate workflow for nf-core modules lint

* Adjust nf-core update comment

* Comment out linting from pytest-workflow.yml

* Remove commented out linting code from pytest-workflow.yml

* Adjust spacing

* Adjust spacing again

* Move NF version to job level for linting

* Add CAPSULE_LOG none env when installing NF

* Remove NXF_ANSI_LOG env for linting

* Revert changes
2021-04-09 07:58:43 +01:00
Anthony Underwood
63b3975292
Update gubbins module to use new files (#417)
* new gubbins module

* new gubbins module

* new gubbins module

* Update software/gubbins/main.nf

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* Update software/gubbins/main.nf

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* Update software/gubbins/main.nf

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* Update software/gubbins/meta.yml

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* new gubbins module

* new gubbins module

* new gubbins module

* new gubbins module

* new gubbins module

* new gubbins module

* new gubbins module

* Update tests/config/test_data.config

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* Update tests/software/gubbins/main.nf

Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>

* new gubbins module

* new gubbins module

* new snpsites module

* new snpsites module

* new snpsites module

* new snpsites module

* adding fasttree module

* correct trailing whitespace

* using sarscov2 as a test dir

* use sars-cov-2 alignment

* remove old test alignment

* new snpsites module

* new snpsites module

* new snpsites module

* updated test file names

* new snpsites module

* remove snpsites from gubbins branch

* remove redundant test_fas alignment

* update md5 sums

Co-authored-by: avantonder <avt@sanger.ac.uk>
Co-authored-by: Harshil Patel <drpatelh@users.noreply.github.com>
Co-authored-by: avantonder <ajv37@cam.ac.uk>
2021-04-09 07:54:11 +01:00