millironx/nf-configs
1
0
Fork 0
mirror of https://github.com/MillironX/nf-configs.git synced 2024-11-22 16:29:55 +00:00
Code Issues Releases Packages Activity

Merge pull request #43 from apeltzer/master

Browse source 
BINAC SMP / Short / Long Updates
This commit is contained in:
Alexander Peltzer 2019-10-28 13:09:56 +01:00 committed by GitHub
commit 7951805fbf
No known key found for this signature in database
GPG key ID: 4AEE18F83AFDEB23
2 changed files with 21 additions and 18 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

5
conf/binac.config
View file

@ -13,13 +13,14 @@ process {
beforeScript = 'module load devel/singularity/3.0.3' beforeScript = 'module load devel/singularity/3.0.3'
executor = 'pbs' executor = 'pbs'
queue = 'short' queue = 'short'
process.queue = { task.memory > 128.GB ? 'smp': task.time <= 20m ? 'tiny' : task.time <= 48.h ? 'short' : task.time <= 168.h ? 'long'}
} }
params { params {
igenomes_base = '/nfsmounts/igenomes' igenomes_base = '/nfsmounts/igenomes'
max_memory = 128.GB max_memory = 1024.GB
max_cpus = 28 max_cpus = 28
max_time = 48.h max_time = 168.h
} }
weblog{ weblog{

28
docs/pasteur.md
View file

@ -4,33 +4,35 @@ All nf-core pipelines have been successfully configured for use on the tars clus
To use, run the pipeline with `-profile pasteur`. This will download and launch the [`pasteur.config`](../conf/pasteur.config) which has been pre-configured with a setup suitable for the Pasteur cluster. Using this profile, a docker image containing all of the required software will be downloaded, and converted to a Singularity image before execution of the pipeline. To use, run the pipeline with `-profile pasteur`. This will download and launch the [`pasteur.config`](../conf/pasteur.config) which has been pre-configured with a setup suitable for the Pasteur cluster. Using this profile, a docker image containing all of the required software will be downloaded, and converted to a Singularity image before execution of the pipeline.
## Running the workflow on the Pasteur cluster ## Running the workflow on the Pasteur cluster
Nextflow is not installed by default on the Pasteur cluster. Nextflow is not installed by default on the Pasteur cluster.
- Install Nextflow : [here](https://www.nextflow.io/docs/latest/getstarted.html#)
- Install Nextflow : [here](https://www.nextflow.io/docs/latest/getstarted.html#)
Nextflow manages each process as a separate job that is submitted to the cluster by using the sbatch command. Nextflow manages each process as a separate job that is submitted to the cluster by using the sbatch command.
Nextflow shouldn't run directly on the submission node but on a compute node. Nextflow shouldn't run directly on the submission node but on a compute node.
The compute nodes don't have access to internet so you need to run it offline. The compute nodes don't have access to internet so you need to run it offline.
To do that: To do that:
1. Create a virtualenv to install nf-core 1. Create a virtualenv to install nf-core
```bash
module purge ```bash
module load Python/3.6.0 module purge
module load java module load Python/3.6.0
module load singularity module load java
cd /path/to/nf-core/workflows module load singularity
virtualenv .venv -p python3 cd /path/to/nf-core/workflows
. .venv/bin/activate virtualenv .venv -p python3
``` . .venv/bin/activate
```
2. Install nf-core: [here](https://nf-co.re/tools#installation) 2. Install nf-core: [here](https://nf-co.re/tools#installation)
3. Get nf-core pipeline and container: [here](https://nf-co.re/tools#downloading-pipelines-for-offline-use) 3. Get nf-core pipeline and container: [here](https://nf-co.re/tools#downloading-pipelines-for-offline-use)
4. Get the nf-core Pasteur profile: [here](https://github.com/nf-core/rnaseq/blob/master/docs/usage.md#--custom_config_base) 4. Get the nf-core Pasteur profile: [here](https://github.com/nf-core/configs#offline-usage)
5. Run nextflow on a compute node: 5. Run nextflow on a compute node:
```bash ```bash
# create a terminal # create a terminal
tmux tmux