1
0
Fork 0
mirror of https://github.com/MillironX/nf-configs.git synced 2024-11-11 04:23:10 +00:00
nf-configs/docs/pasteur.md

59 lines
2 KiB
Markdown
Raw Normal View History

2019-07-30 13:15:30 +00:00
# nf-core/configs: Institut Pasteur Configuration
All nf-core pipelines have been successfully configured for use on the tars cluster at the Institut Pasteur.
To use, run the pipeline with `-profile pasteur`. This will download and launch the [`pasteur.config`](../conf/pasteur.config) which has been pre-configured with a setup suitable for the Pasteur cluster. Using this profile, a docker image containing all of the required software will be downloaded, and converted to a Singularity image before execution of the pipeline.
## Running the workflow on the Pasteur cluster
2019-07-30 14:12:30 +00:00
Nextflow is not installed by default on the Pasteur cluster.
2019-07-30 13:15:30 +00:00
2019-07-30 16:53:00 +00:00
- Install Nextflow : [here](https://www.nextflow.io/docs/latest/getstarted.html#)
2019-07-30 13:15:30 +00:00
2019-07-30 14:12:30 +00:00
Nextflow manages each process as a separate job that is submitted to the cluster by using the sbatch command.
2019-07-30 13:15:30 +00:00
Nextflow shouldn't run directly on the submission node but on a compute node.
2019-07-30 14:12:30 +00:00
The compute nodes don't have access to internet so you need to run it offline.
To do that:
2019-07-30 16:53:00 +00:00
2019-07-30 14:12:30 +00:00
1. Create a virtualenv to install nf-core
2019-07-30 16:53:00 +00:00
```bash
module purge
module load Python/3.6.0
module load java
module load singularity
cd /path/to/nf-core/workflows
virtualenv .venv -p python3
. .venv/bin/activate
```
2019-07-30 13:15:30 +00:00
2. Install nf-core: [here](https://nf-co.re/tools#installation)
3. Get nf-core pipeline and container: [here](https://nf-co.re/tools#downloading-pipelines-for-offline-use)
2019-07-30 16:53:00 +00:00
4. Get the nf-core Pasteur profile: [here](https://github.com/nf-core/configs#offline-usage)
5. Run nextflow on a compute node:
2019-07-30 13:15:30 +00:00
```bash
# create a terminal
2019-07-30 16:53:00 +00:00
tmux
2019-07-30 13:15:30 +00:00
# Get a compute node
salloc
# Load the dependencies if not done before
module purge
module load java
module load singularity
# Run nextflow workflow
nextflow run \\
2019-07-30 13:17:25 +00:00
/path/to/pipeline-dir/from/step/3/workflow \\
2019-07-30 16:53:00 +00:00
-resume
2019-07-30 13:15:30 +00:00
-profile pasteur \\
-with-singularity /path/to/pipeline-dir/from/step/3/singularity-images/singularity.img \\
--email my-email@pasteur.fr \\
--custom_config_base /path/to/configs/from/step/4/ \\
-c my-specific.config
...
```