Hi everyone, I'm trying to run a fork of nf-core r...
# configs
v
Hi everyone, I'm trying to run a fork of nf-core rna-seq pipeline on AWS (I modified some steps for my analysis), but even if the jobs are runnable on AWS, they failed immediately with this error:
Copy code
Command error:
  bash: /home/ec2-user/miniconda/bin/aws: No such file or directory
  bash: line 1: /home/ec2-user/miniconda/bin/aws: No such file or directory
Before, I added the aws config in my nextflow.config as follows:
Copy code
aws {
        params {
            config_profile_description = 'AWSBATCH Cloud Profile'
            config_profile_url = 'https://aws.amazon.com/batch/'
            awsregion = 'eu-west-3'
            awscli = '/home/ec2-user/miniconda/bin/aws'
        }

        timeline {
            overwrite = true
        }
        report {
            overwrite = true
        }
        trace {
            overwrite = true
        }
        dag {
            overwrite = true
        }

        process.executor = 'awsbatch'
        process.queue = my-aws-queue
        aws.region = params.awsregion
        aws.batch.cliPath = params.awscli
    }
And then the command used is:
Copy code
nextflow run main.nf -profile aws,docker --outdir /home/test/out/ --input /home/bin/rnaseq/test/metadata/infile_test.csv --fasta /home/bin/rnaseq/test/data/myfasta.fa.gz  --gtf /home/bin/rnaseq/test/datamygtf.gtf.gz -bucket-dir s3://gwfcore-aviwell-bucket/work/ --stop_at_quantif
What did I miss ? I'm new on AWS and the configuration is still unclear to me ... Thank you by advance
p
Does the aws utility exist in your AMI at that path? It looks like an issue with it not being in place (but it's somewhat confusing as for Batch I'd rather expect an error when trying to bind it into the container, still, check that it's in place).