Aastha Pal
06/23/2024, 4:32 PM------------------------------------------------------
ERROR ~ ERROR: Validation of pipeline parameters failed!
-- Check '.nextflow.log' file for details
The following invalid input values have been detected:
* --library: string [input_seq_updated.csv] does not match pattern ^\S+\.(tsv|txt)$ (input_seq_updated.csv)
-- Check script '/hpc/home/ap764/.nextflow/assets/nf-core/crisprseq/./workflows/../subworkflows/local/utils_nfcore_crisprseq_pipeline/../../nf-core/utils_nfvalidation_plugin/main.nf' at line: 57 or see '.nextflow.log' file for more details
Any advice?
Thank you so much!Júlia Mir
06/25/2024, 7:33 AM--library is expecting a tab separated file instead of a csvAastha Pal
06/25/2024, 7:52 PMLaurence Kuhlburger
06/26/2024, 6:02 AMAastha Pal
07/08/2024, 3:46 PMAastha Pal
07/08/2024, 3:50 PMLaurence Kuhlburger
07/08/2024, 3:52 PMLaurence Kuhlburger
07/08/2024, 3:53 PMAastha Pal
07/13/2024, 10:19 PM-[nf-core/crisprseq] Pipeline completed with errors-
ERROR ~ Error executing process > 'NFCORE_CRISPRSEQ:CRISPRSEQ_SCREENING:MAGECK_COUNT (Treatment,Treatment,Treatment)'
Caused by:
Process `NFCORE_CRISPRSEQ:CRISPRSEQ_SCREENING:MAGECK_COUNT (Treatment,Treatment,Treatment)` terminated with an error exit status (1)
Command executed:
mageck \
count \
\
-l input-seq.tsv \
-n count_table \
--sample-label Treatment,Treatment,Treatment \
--fastq POST-EGF-CDR-O_R1_001.fastq.gz POST-KCNM-CDR-O_R1_001.fastq.gz POST-PTPRZ-CDR-O_R1_001.fastq.gz --fastq-2 POST-EGF-CDR-O_R2_001.fastq.gz POST-KCNM-CDR-O_R2_001.fastq.gz POST-PTPRZ-CDR-O_R2_001.fastq.gz \
cat <<-END_VERSIONS > versions.yml
"NFCORE_CRISPRSEQ:CRISPRSEQ_SCREENING:MAGECK_COUNT":
mageck: $(mageck -v)
END_VERSIONS
Command exit status:
1
Command output:
(empty)
Command error:
WARNING @ Sat, 13 Jul 2024 18:16:00: Not enough field in line 975. Skip this record.
WARNING @ Sat, 13 Jul 2024 18:16:00: Not enough field in line 976. Skip this record.
WARNING @ Sat, 13 Jul 2024 18:16:00: Not enough field in line 977. Skip this record.
WARNING @ Sat, 13 Jul 2024 18:16:00: Not enough field in line 978. Skip this record.
WARNING @ Sat, 13 Jul 2024 18:16:00: Not enough field in line 979. Skip this record.
WARNING @ Sat, 13 Jul 2024 18:16:00: Not enough field in line 980. Skip this record.
WARNING @ Sat, 13 Jul 2024 18:16:00: Not enough field in line 981. Skip this record.
WARNING @ Sat, 13 Jul 2024 18:16:00: Not enough field in line 982. Skip this record.
WARNING @ Sat, 13 Jul 2024 18:16:00: Not enough field in line 983. Skip this record.
WARNING @ Sat, 13 Jul 2024 18:16:00: Not enough field in line 984. Skip this record.
WARNING @ Sat, 13 Jul 2024 18:16:00: Not enough field in line 985. Skip this record.
WARNING @ Sat, 13 Jul 2024 18:16:00: Not enough field in line 986. Skip this record.
WARNING @ Sat, 13 Jul 2024 18:16:00: Not enough field in line 987. Skip this record.
WARNING @ Sat, 13 Jul 2024 18:16:00: Not enough field in line 988. Skip this record.
WARNING @ Sat, 13 Jul 2024 18:16:00: Not enough field in line 989. Skip this record.
WARNING @ Sat, 13 Jul 2024 18:16:00: Not enough field in line 990. Skip this record.
WARNING @ Sat, 13 Jul 2024 18:16:00: Not enough field in line 991. Skip this record.
WARNING @ Sat, 13 Jul 2024 18:16:00: Not enough field in line 992. Skip this record.
WARNING @ Sat, 13 Jul 2024 18:16:00: Not enough field in line 993. Skip this record.
WARNING @ Sat, 13 Jul 2024 18:16:00: Not enough field in line 994. Skip this record.
WARNING @ Sat, 13 Jul 2024 18:16:00: Not enough field in line 995. Skip this record.
WARNING @ Sat, 13 Jul 2024 18:16:00: Not enough field in line 996. Skip this record.
WARNING @ Sat, 13 Jul 2024 18:16:00: Not enough field in line 997. Skip this record.
WARNING @ Sat, 13 Jul 2024 18:16:00: Not enough field in line 998. Skip this record.
WARNING @ Sat, 13 Jul 2024 18:16:00: Not enough field in line 999. Skip this record.
WARNING @ Sat, 13 Jul 2024 18:16:00: Not enough field in line 1000. Skip this record.
INFO @ Sat, 13 Jul 2024 18:16:00: Loading 0 predefined sgRNAs.
WARNING @ Sat, 13 Jul 2024 18:16:00: There are 0 sgRNAs with duplicated sequences.
INFO @ Sat, 13 Jul 2024 18:16:00: Parsing FASTQ file POST-EGF-CDR-O_R1_001.fastq.gz...
INFO @ Sat, 13 Jul 2024 18:16:00: Determining the trim-5 length of FASTQ file POST-EGF-CDR-O_R1_001.fastq.gz...
ERROR @ Sat, 13 Jul 2024 18:16:00: Library file must be provided to automatically determine the trim-5 length in fastq file.
Traceback (most recent call last):
File "/home/ap764/mageck/work/conda/mageck_count-9e339ecd7c467639652a31d371fad0a7/bin/mageck", line 66, in <module>
main();
^^^^^^
File "/home/ap764/mageck/work/conda/mageck_count-9e339ecd7c467639652a31d371fad0a7/bin/mageck", line 47, in main
mageckcount_main(args);
^^^^^^^^^^^^^^^^^^^^^^
File "/home/ap764/mageck/work/conda/mageck_count-9e339ecd7c467639652a31d371fad0a7/lib/python3.12/site-packages/mageck/mageckCount.py", line 559, in mageckcount_main
(allmappeddict,datastat)=mageckcount_processfastq(args,genedict,sgdict)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/ap764/mageck/work/conda/mageck_count-9e339ecd7c467639652a31d371fad0a7/lib/python3.12/site-packages/mageck/mageckCount.py", line 339, in mageckcount_processfastq
mageckcount_processonefile(filename,args,dict00,sgdict,datastat[filename], pairedfile, adjust=adjust)
File "/home/ap764/mageck/work/conda/mageck_count-9e339ecd7c467639652a31d371fad0a7/lib/python3.12/site-packages/mageck/mageckCountIO.py", line 253, in mageckcount_processonefile
candidate_trim5=mageckcount_trim5_auto(filename,args,genedict)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/ap764/mageck/work/conda/mageck_count-9e339ecd7c467639652a31d371fad0a7/lib/python3.12/site-packages/mageck/mageckCountIO.py", line 50, in mageckcount_trim5_auto
minlengthpool=min(lengthpool)
^^^^^^^^^^^^^^^
ValueError: min() iterable argument is empty
Work dir:
/home/ap764/mageck/work/04/8878ae9f726b4509619b3e7fc25c11
Tip: you can replicate the issue by changing to the process work dir and entering the command `bash .command.run`
-- Check '.nextflow.log' file for details
ERROR ~ Pipeline failed. Please refer to troubleshooting docs: <https://nf-co.re/docs/usage/troubleshooting>
-- Check '.nextflow.log' file for detailsAastha Pal
07/13/2024, 10:27 PMAastha Pal
07/13/2024, 10:35 PMAastha Pal
07/13/2024, 10:44 PMAastha Pal
07/15/2024, 6:03 PMLaurence Kuhlburger
07/15/2024, 6:18 PMAastha Pal
07/15/2024, 6:26 PMLaurence Kuhlburger
07/15/2024, 7:22 PMAastha Pal
07/15/2024, 7:24 PMLaurence Kuhlburger
07/15/2024, 7:24 PMAastha Pal
07/15/2024, 7:25 PMLaurence Kuhlburger
07/15/2024, 7:25 PMAastha Pal
07/15/2024, 7:26 PMAastha Pal
07/15/2024, 7:26 PMnextflow run nf-core/crisprseq --input samplesheet_w_control.csv --mle_design_matrix design_matrix.txt --library input-seq.tsv --contrasts contrast_file.csv --analysis screening --outdir /home/ap764/mageck/output -profile condaAastha Pal
07/15/2024, 7:26 PMLaurence Kuhlburger
07/15/2024, 7:27 PMAastha Pal
07/15/2024, 7:27 PMAastha Pal
07/15/2024, 7:47 PM[7d/f66e50] NFCORE_CRISPRSEQ:CRISPRSEQ_SCREENING:FASTQC (POST-PTPRZ-CDR-O) [100%] 5 of 5 ✔
[46/1cf936] NFC…_CRISPRSEQ:CRISPRSEQ_SCREENING:MAGECK_COUNT (control,control,treated,treated,treated) [100%] 1 of 1 ✔
[25/f697f3] NFCORE_CRISPRSEQ:CRISPRSEQ_SCREENING:BAGEL2_FC (null_POST-RFP-CDR-O,PRE-CDR-O) [ 0%] 0 of 1
[- ] NFCORE_CRISPRSEQ:CRISPRSEQ_SCREENING:BAGEL2_BF -
[- ] NFCORE_CRISPRSEQ:CRISPRSEQ_SCREENING:BAGEL2_PR -
[- ] NFCORE_CRISPRSEQ:CRISPRSEQ_SCREENING:BAGEL2_GRAPH -
[- ] NFCORE_CRISPRSEQ:CRISPRSEQ_SCREENING:MAGECK_MLE_MATRIX -
[- ] NFCORE_CRISPRSEQ:CRISPRSEQ_SCREENING:MAGECK_FLUTEMLE -
[66/745eb8] NFCORE_CRISPRSEQ:CRISPRSEQ_SCREENING:MATRICESCREATION (1) [100%] 1 of 1 ✔
[- ] NFCORE_CRISPRSEQ:CRISPRSEQ_SCREENING:MAGECK_MLE -
[- ] NFCORE_CRISPRSEQ:CRISPRSEQ_SCREENING:MAGECK_FLUTEMLE_CONTRASTS -
[- ] NFCORE_CRISPRSEQ:CRISPRSEQ_SCREENING:VENNDIAGRAM -
[- ] NFCORE_CRISPRSEQ:CRISPRSEQ_SCREENING:MULTIQC -
Creating env using conda: python=3.11.4 pandas=2.0.3 numpy=1.25.1 scikit-learn=1.3.0 click=8.1.6 [cache /home/ap764/mageck/work/conda/env-3dafdc33abfc69f10b50917558512649]
Creating env using conda: /home/ap764/.nextflow/assets/nf-core/crisprseq/./workflows/../modules/nf-core/mageck/mle/environment.yml [cache /home/ap764/mageck/work/conda/mageck_mle-59d5356fd26262b57cdb016b49dfae0f]
ERROR ~ Error executing process > 'NFCORE_CRISPRSEQ:CRISPRSEQ_SCREENING:BAGEL2_FC (null_POST-RFP-CDR-O,PRE-CDR-O)'
Caused by:
Process `NFCORE_CRISPRSEQ:CRISPRSEQ_SCREENING:BAGEL2_FC (null_POST-RFP-CDR-O,PRE-CDR-O)` terminated with an error exit status (1)
Command executed:
BAGEL.py fc -i count_table.count.txt -o null_vs_POST-RFP-CDR-O,PRE-CDR-O -c POST-RFP-CDR-O,PRE-CDR-O
cat <<-END_VERSIONS > versions.yml
"NFCORE_CRISPRSEQ:CRISPRSEQ_SCREENING:BAGEL2_FC":
python: $(python --version | sed 's/Python //g')
BAGEL2: $( BAGEL.py version | grep -o 'Version: [0-9.]*' | awk '{print $2}' | grep -v '^$')
END_VERSIONS
Command exit status:
1
Command output:
(empty)
Command error:
Traceback (most recent call last):
File "/home/ap764/.nextflow/assets/nf-core/crisprseq/bin/BAGEL.py", line 274, in calculate_fold_change
ctrl_sum = reads[ctrl_labels].sum(axis=1)
~~~~~^^^^^^^^^^^^^
File "/home/ap764/mageck/work/conda/env-3dafdc33abfc69f10b50917558512649/lib/python3.11/site-packages/pandas/core/frame.py", line 3767, in __getitem__
indexer = self.columns._get_indexer_strict(key, "columns")[1]
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/ap764/mageck/work/conda/env-3dafdc33abfc69f10b50917558512649/lib/python3.11/site-packages/pandas/core/indexes/base.py", line 5877, in _get_indexer_strict
self._raise_if_missing(keyarr, indexer, axis_name)
File "/home/ap764/mageck/work/conda/env-3dafdc33abfc69f10b50917558512649/lib/python3.11/site-packages/pandas/core/indexes/base.py", line 5938, in _raise_if_missing
raise KeyError(f"None of [{key}] are in the [{axis_name}]")
KeyError: "None of [Index(['POST-RFP-CDR-O', 'PRE-CDR-O'], dtype='object')] are in the [columns]"
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/home/ap764/.nextflow/assets/nf-core/crisprseq/bin/BAGEL.py", line 1269, in <module>
bagel()
File "/home/ap764/mageck/work/conda/env-3dafdc33abfc69f10b50917558512649/lib/python3.11/site-packages/click/core.py", line 1157, in __call__
return self.main(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^Laurence Kuhlburger
07/15/2024, 7:48 PMAastha Pal
07/15/2024, 7:49 PMLaurence Kuhlburger
07/15/2024, 7:51 PMAastha Pal
07/15/2024, 7:52 PMAastha Pal
07/15/2024, 7:53 PMAastha Pal
07/15/2024, 7:54 PMExecution cancelled -- Finishing pending tasks before exit
-[nf-core/crisprseq] Pipeline completed with errors-
ERROR ~ Error executing process > 'NFCORE_CRISPRSEQ:CRISPRSEQ_SCREENING:MAGECK_MLE_MATRIX (design_matrix)'
Caused by:
Process `NFCORE_CRISPRSEQ:CRISPRSEQ_SCREENING:MAGECK_MLE_MATRIX (design_matrix)` terminated with an error exit status (255)
Command executed:
mageck \
mle \
\
--threads 6 \
-k count_table.count.txt \
-n design_matrix \
-d design_matrix.txt
cat <<-END_VERSIONS > versions.yml
"NFCORE_CRISPRSEQ:CRISPRSEQ_SCREENING:MAGECK_MLE_MATRIX":
mageck: $(mageck -v)
END_VERSIONS
Command exit status:
255
Command output:
(empty)
Command error:
INFO @ Mon, 15 Jul 2024 15:51:22: Parameters: /home/ap764/mageck/work/conda/mageck_mle-59d5356fd26262b57cdb016b49dfae0f/bin/mageck mle --threads 6 -k count_table.count.txt -n design_matrix -d design_matrix.txt
INFO @ Mon, 15 Jul 2024 15:51:22: Cannot parse design matrix as a string; try to parse it as a file name ...
INFO @ Mon, 15 Jul 2024 15:51:22: Design matrix:
INFO @ Mon, 15 Jul 2024 15:51:22: [[1. 0. 0. 0.]
INFO @ Mon, 15 Jul 2024 15:51:22: [1. 1. 0. 0.]
INFO @ Mon, 15 Jul 2024 15:51:22: [1. 0. 1. 0.]
INFO @ Mon, 15 Jul 2024 15:51:22: [1. 0. 0. 1.]]
INFO @ Mon, 15 Jul 2024 15:51:22: Beta labels:baseline,EGF,KCNM,PTPRZ
INFO @ Mon, 15 Jul 2024 15:51:22: Included samples:POST-RFP-CDR-O,POST-EGF-CDR-O,POST-KCNM-CDR-O,POST-PTPRZ-CDR-O
INFO @ Mon, 15 Jul 2024 15:51:22: Loaded samples:POST-RFP-CDR-O;POST-EGF-CDR-O;POST-KCNM-CDR-O;POST-PTPRZ-CDR-O
ERROR @ Mon, 15 Jul 2024 15:51:22: Sample POST-RFP-CDR-O cannot be found on the original read count table count_table.count.txt
Work dir:
/home/ap764/mageck/work/df/814bd11a8670a417abf2fa6565a3ec
Tip: when you have fixed the problem you can continue the execution adding the option `-resume` to the run command line
-- Check '.nextflow.log' file for details
ERROR ~ Pipeline failed. Please refer to troubleshooting docs: <https://nf-co.re/docs/usage/troubleshooting>
-- Check '.nextflow.log' file for detailsLaurence Kuhlburger
07/15/2024, 7:54 PMAastha Pal
07/15/2024, 7:56 PMLaurence Kuhlburger
07/15/2024, 7:57 PMAastha Pal
07/15/2024, 8:05 PM==> script output <==
stdout: /home/ap764/mageck/work/conda/env-74aabf46ab426ccf38987b58bfc08654/share/depmap-1.12.0/"depmap_1.12.0.tar.gz": OK
Error: package or namespace load failed for 'depmap':
.onLoad failed in loadNamespace() for 'depmap', details:
call: (function (cond)
error: error in evaluating the argument 'x' in selecting a method for function 'query': Failed to collect lazy table.
Caused by error in `db_collect()`:
! Arguments in `...` must be used.
✖ Problematic argument:
• ..1 = Inf
ℹ Did you misspell an argument name?
Error: loading failed
Execution halted
stderr: ++ dirname -- /home/ap764/mageck/work/conda/env-74aabf46ab426ccf38987b58bfc08654/bin/installBiocDataPackage.sh
+ SCRIPT_DIR=/home/ap764/mageck/work/conda/env-74aabf46ab426ccf38987b58bfc08654/bin/../share/bioconductor-data-packages
+ json=/home/ap764/mageck/work/conda/env-74aabf46ab426ccf38987b58bfc08654/bin/../share/bioconductor-data-packages/dataURLs.json
++ yq '."depmap-1.12.0".fn' /home/ap764/mageck/work/conda/env-74aabf46ab426ccf38987b58bfc08654/bin/../share/bioconductor-data-packages/dataURLs.json
+ FN='"depmap_1.12.0.tar.gz"'
+ IFS=
+ read -r value
++ yq '."depmap-1.12.0".urls[]' /home/ap764/mageck/work/conda/env-74aabf46ab426ccf38987b58bfc08654/bin/../share/bioconductor-data-packages/dataURLs.json
+ URLS+=($value)
+ IFS=
+ read -r value
+ URLS+=($value)
+ IFS=
+ read -r value
+ URLS+=($value)
+ IFS=
+ read -r value
++ yq '."depmap-1.12.0".md5' /home/ap764/mageck/work/conda/env-74aabf46ab426ccf38987b58bfc08654/bin/../share/bioconductor-data-packages/dataURLs.json
+ MD5='"24fcff71d7af3a08bf179f7c7d016024"'
+ STAGING=/home/ap764/mageck/work/conda/env-74aabf46ab426ccf38987b58bfc08654/share/depmap-1.12.0
+ mkdir -p /home/ap764/mageck/work/conda/env-74aabf46ab426ccf38987b58bfc08654/share/depmap-1.12.0
+ TARBALL='/home/ap764/mageck/work/conda/env-74aabf46ab426ccf38987b58bfc08654/share/depmap-1.12.0/"depmap_1.12.0.tar.gz"'
+ SUCCESS=0
+ for URL in ${URLS[@]}
++ echo '"<https://bioconductor.org/packages/3.16/data/experiment/src/contrib/depmap_1.12.0.tar.gz>"'
++ tr -d '"'
+ URL=<https://bioconductor.org/packages/3.16/data/experiment/src/contrib/depmap_1.12.0.tar.gz>
++ echo '"24fcff71d7af3a08bf179f7c7d016024"'
++ tr -d '"'
+ MD5=24fcff71d7af3a08bf179f7c7d016024
+ curl -L <https://bioconductor.org/packages/3.16/data/experiment/src/contrib/depmap_1.12.0.tar.gz>
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0
0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0
100 406 100 406 0 0 4227 0 --:--:-- --:--:-- --:--:-- 4229
100 1349k 100 1349k 0 0 3999k 0 --:--:-- --:--:-- --:--:-- 3999k
+ [[ 0 == 0 ]]
++ uname -s
+ [[ Linux == \L\i\n\u\x ]]
+ md5sum -c
+ SUCCESS=1
+ break
+ [[ 1 != 1 ]]
+ R CMD INSTALL --library=/home/ap764/mageck/work/conda/env-74aabf46ab426ccf38987b58bfc08654/lib/R/library '/home/ap764/mageck/work/conda/env-74aabf46ab426ccf38987b58bfc08654/share/depmap-1.12.0/"depmap_1.12.0.tar.gz"'
* installing *source* package 'depmap' ...
** using staged installation
** R
** inst
** byte-compile and prepare package for lazy loading
** help
*** installing help indices
** building package indices
** installing vignettes
** testing if installed package can be loaded from temporary location
ERROR: loading failed
* removing '/home/ap764/mageck/work/conda/env-74aabf46ab426ccf38987b58bfc08654/lib/R/library/depmap'
return code: 1
kwargs:
{}
Traceback (most recent call last):
File "/home/ap764/miniconda3/lib/python3.12/site-packages/conda/exception_handler.py", line 17, in __call__
return func(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^
File "/home/ap764/miniconda3/lib/python3.12/site-packages/conda/cli/main.py", line 83, in main_subshell
exit_code = do_call(args, parser)
^^^^^^^^^^^^^^^^^^^^^
File "/home/ap764/miniconda3/lib/python3.12/site-packages/conda/cli/conda_argparse.py", line 199, in do_call
result = getattr(module, func_name)(args, parser)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/ap764/miniconda3/lib/python3.12/site-packages/conda/notices/core.py", line 131, in wrapper
return func(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^
File "/home/ap764/miniconda3/lib/python3.12/site-packages/conda/cli/main_create.py", line 125, in execute
return install(args, parser, "create")
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/ap764/miniconda3/lib/python3.12/site-packages/conda/cli/install.py", line 450, in install
handle_txn(unlink_link_transaction, prefix, args, newenv)
File "/home/ap764/miniconda3/lib/python3.12/site-packages/conda/cli/install.py", line 483, in handle_txn
unlink_link_transaction.execute()
File "/home/ap764/miniconda3/lib/python3.12/site-packages/conda/core/link.py", line 353, in execute
self._execute(
File "/home/ap764/miniconda3/lib/python3.12/site-packages/conda/core/link.py", line 969, in _execute
raise CondaMultiError(
conda.CondaMultiErrorclass: LinkError
message:
post-link script failed for package bioconda::bioconductor-depmap-1.12.0-r42hdfd78af_0
location of failed script: /home/ap764/mageck/work/conda/env-74aabf46ab426ccf38987b58bfc08654/bin/.bioconductor-depmap-post-link.sh
==> script messages <==
<None>
==> script output <==
stdout: /home/ap764/mageck/work/conda/env-74aabf46ab426ccf38987b58bfc08654/share/depmap-1.12.0/"depmap_1.12.0.tar.gz": OK
Error: package or namespace load failed for 'depmap':
.onLoad failed in loadNamespace() for 'depmap', details:
call: (function (cond)
error: error in evaluating the argument 'x' in selecting a method for function 'query': Failed to collect lazy table.
Caused by error in `db_collect()`:
! Arguments in `...` must be used.
✖ Problematic argument:
• ..1 = Inf
ℹ Did you misspell an argument name?
Error: loading failed
Execution halted
stderr: ++ dirname -- /home/ap764/mageck/work/conda/env-74aabf46ab426ccf38987b58bfc08654/bin/installBiocDataPackage.sh
+ SCRIPT_DIR=/home/ap764/mageck/work/conda/env-74aabf46ab426ccf38987b58bfc08654/bin/../share/bioconductor-data-packages
+ json=/home/ap764/mageck/work/conda/env-74aabf46ab426ccf38987b58bfc08654/bin/../share/bioconductor-data-packages/dataURLs.json
++ yq '."depmap-1.12.0".fn' /home/ap764/mageck/work/conda/env-74aabf46ab426ccf38987b58bfc08654/bin/../share/bioconductor-data-packages/dataURLs.json
+ FN='"depmap_1.12.0.tar.gz"'
+ IFS=
+ read -r value
++ yq '."depmap-1.12.0".urls[]' /home/ap764/mageck/work/conda/env-74aabf46ab426ccf38987b58bfc08654/bin/../share/bioconductor-data-packages/dataURLs.json
+ URLS+=($value)
+ IFS=
+ read -r value
+ URLS+=($value)
+ IFS=
+ read -r value
+ URLS+=($value)
+ IFS=
+ read -r value
++ yq '."depmap-1.12.0".md5' /home/ap764/magecLaurence Kuhlburger
07/16/2024, 5:54 AMnextflow run nf-core/crisprseq -r dev ?Aastha Pal
07/16/2024, 5:14 PMAastha Pal
07/19/2024, 2:53 AMf <- file(version_file_path, "w")
executor > local (8)
[95/42860c] NFCORE_CRISPRSEQ:CRISPRSEQ_SCREENING:FASTQC (POST-KCNM-CDR-O) [100%] 5 of 5 ✔
[77/d07e46] NFC…AGECK_COUNT (POST-RFP-CDR-O,PRE-CDR-O,POST-EGF-CDR-O,POST-KCNM-CDR-O,POST-PTPRZ-CDR-O) [100%] 1 of 1 ✔
[b9/8f70e6] NFCORE_CRISPRSEQ:CRISPRSEQ_SCREENING:MAGECK_MLE_MATRIX (design_matrix) [100%] 1 of 1 ✔
[df/1527fb] NFCORE_CRISPRSEQ:CRISPRSEQ_SCREENING:MAGECK_FLUTEMLE (design_matrix) [100%] 1 of 1, failed: 1 ✘
[- ] NFCORE_CRISPRSEQ:CRISPRSEQ_SCREENING:MULTIQC -
Execution cancelled -- Finishing pending tasks before exit
-[nf-core/crisprseq] Pipeline completed with errors-
ERROR ~ Error executing process > 'NFCORE_CRISPRSEQ:CRISPRSEQ_SCREENING:MAGECK_FLUTEMLE (design_matrix)'
Caused by:
Process `NFCORE_CRISPRSEQ:CRISPRSEQ_SCREENING:MAGECK_FLUTEMLE (design_matrix)` terminated with an error exit status (127)
Command executed [/home/ap764/.nextflow/assets/nf-core/crisprseq/templates/template_fluteMLE.R]:
#!/usr/bin/env Rscript
#### author: Laurence Kuhlburger
#### Released under the MIT license. See git repository (<https://github.com/nf-core/crisprseq>) for full license text.
####
#### graphs mageck MLE
library(MAGeCKFlute)
library(clusterProfiler)
library(ggplot2)
library(pathview)
options(ggrepel.max.overlaps = Inf)
mle <- read.table("design_matrix.gene_summary.txt", header = TRUE, sep = " ", stringsAsFactors = FALSE)
if("design_matrix" == "day0") {
beta_strings <- grep("\\.beta", colnames(mle), value = TRUE)
before_beta <- sub("\\.beta.*", "", beta_strings)
unique_strings <- unique(before_beta)
for(i in unique_strings) {
tryCatch(
{
FluteMLE(mle, treatname= i, proj=i, <http://pathview.top|pathview.top>=5)
},
error=function(e) {
print(paste("Could not run FluteMLE with project",i))
}
)
}
} else {
beta_strings <- grep("\\.beta", colnames(mle), value = TRUE)
before_beta <- sub("\\.beta.*", "", beta_strings)
unique_strings <- unique(before_beta)
for(i in unique_strings) {
tryCatch(
{
FluteMLE(mle, treatname= i, proj=i, , <http://pathview.top|pathview.top>=5)
},
error=function(e) {
print(paste("Could not run FluteMLE with project",i))
}
)
}
}
version_file_path <- "versions.yml"
version_flute <- paste(unlist(packageVersion("MAGeCKFlute")), collapse = ".")
version_ggplot <- paste(unlist(packageVersion("ggplot2")), collapse = ".")
version_clusterprofiler <- paste(unlist(packageVersion("clusterProfiler")), collapse = ".")
version_pathview <- paste(unlist(packageVersion("pathview")), collapse = ".")
f <- file(version_file_path, "w")
writeLines('"NFCORE_CRISPRSEQ:CRISPRSEQ_SCREENING:MAGECK_FLUTEMLE":', f)
writeLines(" MAGeCKFlute: ", f, sep = "")
writeLines(version_flute, f)
writeLines(" ggplot2: ", f, sep = "")
writeLines(version_ggplot, f)
writeLines(" clusterProfiler: ", f, sep = "")
writeLines(version_clusterprofiler, f)
writeLines(" pathview: ", f, sep = "")
writeLines(version_pathview, f)
close(f)
Command exit status:
127
Command output:
(empty)
Command error:
/usr/bin/env: 'Rscript': No such file or directory
Work dir:
/home/ap764/mageck/work/df/1527fbc5bc1b14f4e37e4b4e79eaf6
Tip: view the complete command output by changing to the process work dir and entering the command `cat .command.out`
-- Check '.nextflow.log' file for details
ERROR ~ Pipeline failed. Please refer to troubleshooting docs: <https://nf-co.re/docs/usage/troubleshooting>
-- Check '.nextflow.log' file for detailsAastha Pal
07/19/2024, 2:53 AMnextflow run nf-core/crisprseq -r dev --input samplesheet_w_control.csv --mle_design_matrix design_matrix.txt --library final_input_sgrna.tsv --analysis screening --outdir /home/ap764/mageck/output_final -profile condaJúlia Mir
07/19/2024, 6:25 AM.nextflow.log file? Somehow the conda container is not workingAastha Pal
07/19/2024, 4:29 PMAastha Pal
07/20/2024, 2:41 AMJúlia Mir
07/22/2024, 9:40 AM/home/ap764/mageck/work/conda/env-74aabf46ab426ccf38987b58bfc08654 ? This contains the cache of the mageckflute conda container. If you run the pipeline again it should generate the container from scratch, let's see if this works 🤞🏻Aastha Pal
07/22/2024, 7:07 PMNo, luck. I removed this. /home/ap764/mageck/work/conda/env-74aabf46ab426ccf38987b58bfc08654Aastha Pal
07/22/2024, 9:25 PMJúlia Mir
07/23/2024, 8:07 AMJúlia Mir
07/23/2024, 8:08 AMAastha Pal
07/24/2024, 12:26 AMAastha Pal
07/24/2024, 5:54 AMcommand used: nextflow run nf-core/crisprseq -r dev --input samplesheet_w_control.csv --mle_design_matrix design_matrix.txt --library final_input_sgrna.tsv --contrasts contrast_file.csv --analysis screening --outdir /home/ap764/mageck/output -profile conda
error:
[de/4e92ad] NFC…SPRSEQ_SCREENING:MAGECK_MLE (null_vs_POST-RFP-CDR-O,PRE-CDR-O) | 1 of 1, failed: 1 ✘
[- ] NFCORE_CRISPRSEQ:CRISPRSEQ_SCREENING:MAGECK_FLUTEMLE_CONTRASTS -
[- ] NFCORE_CRISPRSEQ:CRISPRSEQ_SCREENING:VENNDIAGRAM -
[- ] NFCORE_CRISPRSEQ:CRISPRSEQ_SCREENING:MULTIQC -
Execution cancelled -- Finishing pending tasks before exit
-[nf-core/crisprseq] Pipeline completed with errors-
ERROR ~ Error executing process > 'NFCORE_CRISPRSEQ:CRISPRSEQ_SCREENING:MAGECK_MLE (null_vs_POST-RFP-CDR-O,PRE-CDR-O)'
Caused by:
Process `NFCORE_CRISPRSEQ:CRISPRSEQ_SCREENING:MAGECK_MLE (null_vs_POST-RFP-CDR-O,PRE-CDR-O)` terminated with an error exit status (1)
Command executed:
mageck \
mle \
\
--threads 6 \
-k count_table.count.txt \
-n null_vs_POST-RFP-CDR-O,PRE-CDR-O \
-d null_vs_POST-RFP-CDR-O_PRE-CDR-O.txt
cat <<-END_VERSIONS > versions.yml
"NFCORE_CRISPRSEQ:CRISPRSEQ_SCREENING:MAGECK_MLE":
mageck: $(mageck -v)
END_VERSIONS
Command exit status:
1
Command output:
(empty)
Command error:
INFO @ Wed, 24 Jul 2024 01:30:31: Parameters: /home/ap764/mageck/work/conda/mageck_mle-59d5356fd26262b57cdb016b49dfae0f/bin/mageck mle --threads 6 -k count_table.count.txt -n null_vs_POST-RFP-CDR-O,PRE-CDR-O -d null_vs_POST-RFP-CDR-O_PRE-CDR-O.txt
INFO @ Wed, 24 Jul 2024 01:30:31: Cannot parse design matrix as a string; try to parse it as a file name ...
Traceback (most recent call last):
File "/home/ap764/mageck/work/conda/mageck_mle-59d5356fd26262b57cdb016b49dfae0f/bin/mageck", line 66, in <module>
main();
^^^^^^
File "/home/ap764/mageck/work/conda/mageck_mle-59d5356fd26262b57cdb016b49dfae0f/bin/mageck", line 43, in main
args=crisprseq_parseargs();
^^^^^^^^^^^^^^^^^^^^^
File "/home/ap764/mageck/work/conda/mageck_mle-59d5356fd26262b57cdb016b49dfae0f/lib/python3.12/site-packages/mageck/argsParser.py", line 258, in crisprseq_parseargs
mageckmle_main(parsedargs=args); # ignoring the script path, and the sub command
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/ap764/mageck/work/conda/mageck_mle-59d5356fd26262b57cdb016b49dfae0f/lib/python3.12/site-packages/mageck/mlemageck.py", line 41, in mageckmle_main
args=mageckmle_postargs(args)
^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/ap764/mageck/work/conda/mageck_mle-59d5356fd26262b57cdb016b49dfae0f/lib/python3.12/site-packages/mageck/mleargparse.py", line 53, in mageckmle_postargs
(desmat,sampleid,betalabel)=parse_designmat(args.design_matrix)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/ap764/mageck/work/conda/mageck_mle-59d5356fd26262b57cdb016b49dfae0f/lib/python3.12/site-packages/mageck/mledesignmat.py", line 170, in parse_designmat
raise ValueError('parsing the design matrix from file '+designmatstr)
ValueError: parsing the design matrix from file null_vs_POST-RFP-CDR-O_PRE-CDR-O.txt
Work dir:
/home/ap764/mageck/work/de/4e92adf95086198c569ff496c019c1
Tip: when you have fixed the problem you can continue the execution adding the option `-resume` to the run command line
-- Check '.nextflow.log' file for details
ERROR ~ Pipeline failed. Please refer to troubleshooting docs: <https://nf-co.re/docs/usage/troubleshooting>
-- Check '.nextflow.log' file for detailsAastha Pal
07/24/2024, 5:57 AMLaurence Kuhlburger
07/24/2024, 6:09 AMAastha Pal
07/24/2024, 6:13 AMreference;treatment
POST-RFP-CDR-O,PRE-CDR-O;POST-EGF-CDR-O,POST-KCNM-CDR-O,POST-PTPRZ-CDR-OAastha Pal
07/24/2024, 6:13 AMAastha Pal
07/24/2024, 6:13 AMsample, fastq_1, fastq_2, condition
POST-RFP-CDR-O,/home/ap764/mageck/NGS_raw_data/POST-RFP-CDR-O_R1_001.fastq.gz,/home/ap764/mageck/NGS_raw_data/POST-RFP-CDR-O_R2_001.fastq.gz,POST-RFP-CDR-O
PRE-CDR-O,/home/ap764/mageck/NGS_raw_data/PRE-CDR-O_R1_001.fastq.gz,/home/ap764/mageck/NGS_raw_data/PRE-CDR-O_R2_001.fastq.gz,PRE-CDR-OAastha Pal
07/24/2024, 6:13 AMAastha Pal
07/24/2024, 6:16 AMGene sgRNA EGF|beta EGF|z EGF|p-value EGF|fdr EGF|wald-p-value EGF|wald-fdr KCNM|beta KCNM|z KCNM|p-value KCNM|fdr KCNM|wald-p-value KCNM|wald-fdr PTPRZ|beta PTPRZ|z PTPRZ|p-value PTPRZ|fdr PTPRZ|wald-p-value PTPRZ|wald-fdr
KCNMB2_301 1 -0.3552 -1.1478 0.65734 0.99681 0.25103 0.85176 0.12627 0.40803 0.58142 0.99595 0.68325 0.99949 -0.2262 -0.73095 0.76723 0.99677 0.46481 0.84276
KCNMB2_273 1 0.3396 0.35297 0.64735 0.99681 0.72411 0.87097 -0.062044 -0.064487 0.95305 0.99791 0.94858 0.99949 0.75664 0.7864 0.22777 0.9913 0.43163 0.84276Aastha Pal
07/24/2024, 6:17 AMLaurence Kuhlburger
07/24/2024, 6:20 AMAastha Pal
07/24/2024, 6:24 AMAastha Pal
07/24/2024, 6:25 AMLaurence Kuhlburger
07/24/2024, 6:26 AMAastha Pal
07/24/2024, 6:27 AMAastha Pal
07/24/2024, 6:27 AMLaurence Kuhlburger
07/24/2024, 6:28 AMAastha Pal
07/24/2024, 6:28 AMAastha Pal
07/24/2024, 6:28 AMLaurence Kuhlburger
07/24/2024, 6:29 AMAastha Pal
07/24/2024, 6:29 AMAastha Pal
07/24/2024, 6:30 AMAastha Pal
07/24/2024, 6:30 AMAastha Pal
07/24/2024, 6:32 AMAastha Pal
07/24/2024, 6:33 AMAastha Pal
07/24/2024, 6:33 AMAastha Pal
07/24/2024, 6:34 AMAastha Pal
07/24/2024, 6:37 AMLaurence Kuhlburger
07/24/2024, 6:40 AMSamples baseline POST-EGF-CDR-O.POST-KCNM-CDR-O.POST-PTPRZ-CDR-O_vs_POST-RFP-CDR-O.PRE-CDR-O
POST-RFP-CDR-O 1 0
PRE-CDR-O 1 0
POST-EGF-CDR-O 1 1
POST-KCNM-CDR-O 1 1
POST-PTPRZ-CDR-O 1 1
could you run
nextflow run nf-core/crisprseq -r dev --input samplesheet_w_control.csv --mle_design_matrix design_matrix.txt --library final_input_sgrna.tsv --analysis screening --outdir /home/ap764/mageck/output -profile conda
with design_matrix.txt being here above?Aastha Pal
07/24/2024, 6:46 AMSample baseline EGF KCNM PTPRZ
POST-RFP-CDR-O 1 0 0 0
POST-EGF-CDR-O 1 1 0 0
POST-KCNM-CDR-O 1 0 1 0
POST-PTPRZ-CDR-O 1 0 0 1Laurence Kuhlburger
07/24/2024, 6:47 AM--contrastst from your commandAastha Pal
07/24/2024, 6:49 AMnextflow run nf-core/crisprseq -r dev --input samplesheet_w_control.csv --mle_design_matrix design_matrix.txt --library final_input_sgrna.tsv --analysis screening --outdir /home/ap764/mageck/output -profile condaLaurence Kuhlburger
07/24/2024, 6:50 AMLaurence Kuhlburger
07/24/2024, 6:50 AMAastha Pal
07/24/2024, 6:50 AM/home/ap764/mageck/work/conda/env-74aabf46ab426ccf38987b58bfc08654Aastha Pal
07/24/2024, 6:51 AMLaurence Kuhlburger
07/24/2024, 6:51 AMAastha Pal
07/24/2024, 6:52 AMexecutor > local (8)
[90/f186a3] NFCORE_CRISPRSEQ:CRISPRSEQ_SCREENING:FASTQC (POST-KCNM-CDR-O) | 5 of 5 ✔
[ad/da22ac] NFC…R-O,PRE-CDR-O,POST-EGF-CDR-O,POST-KCNM-CDR-O,POST-PTPRZ-CDR-O) | 1 of 1 ✔
[7b/c72af1] NFC…RISPRSEQ:CRISPRSEQ_SCREENING:MAGECK_MLE_MATRIX (design_matrix) | 1 of 1 ✔
[8d/013eae] NFC…_CRISPRSEQ:CRISPRSEQ_SCREENING:MAGECK_FLUTEMLE (design_matrix) | 1 of 1, failed: 1 ✘
[- ] NFCORE_CRISPRSEQ:CRISPRSEQ_SCREENING:MULTIQC -
Execution cancelled -- Finishing pending tasks before exit
-[nf-core/crisprseq] Pipeline completed with errors-
ERROR ~ Error executing process > 'NFCORE_CRISPRSEQ:CRISPRSEQ_SCREENING:MAGECK_FLUTEMLE (design_matrix)'
Caused by:
Process `NFCORE_CRISPRSEQ:CRISPRSEQ_SCREENING:MAGECK_FLUTEMLE (design_matrix)` terminated with an error exit status (127)
Command executed [/home/ap764/.nextflow/assets/nf-core/crisprseq/templates/template_fluteMLE.R]:
#!/usr/bin/env Rscript
#### author: Laurence Kuhlburger
#### Released under the MIT license. See git repository (<https://github.com/nf-core/crisprseq>) for full license text.
####
#### graphs mageck MLE
library(MAGeCKFlute)
library(clusterProfiler)
library(ggplot2)
library(pathview)
options(ggrepel.max.overlaps = Inf)
mle <- read.table("design_matrix.gene_summary.txt", header = TRUE, sep = " ", stringsAsFactors = FALSE)
if("design_matrix" == "day0") {
beta_strings <- grep("\\.beta", colnames(mle), value = TRUE)
before_beta <- sub("\\.beta.*", "", beta_strings)
unique_strings <- unique(before_beta)
for(i in unique_strings) {
tryCatch(
{
FluteMLE(mle, treatname= i, proj=i, <http://pathview.top|pathview.top>=5)
},
error=function(e) {
print(paste("Could not run FluteMLE with project",i))
}
)
}
} else {
beta_strings <- grep("\\.beta", colnames(mle), value = TRUE)
before_beta <- sub("\\.beta.*", "", beta_strings)
unique_strings <- unique(before_beta)
for(i in unique_strings) {
tryCatch(
{
FluteMLE(mle, treatname= i, proj=i, , <http://pathview.top|pathview.top>=5)
},
error=function(e) {
print(paste("Could not run FluteMLE with project",i))
}
)
}
}
version_file_path <- "versions.yml"
version_flute <- paste(unlist(packageVersion("MAGeCKFlute")), collapse = ".")
version_ggplot <- paste(unlist(packageVersion("ggplot2")), collapse = ".")
version_clusterprofiler <- paste(unlist(packageVersion("clusterProfiler")), collapse = ".")
version_pathview <- paste(unlist(packageVersion("pathview")), collapse = ".")
f <- file(version_file_path, "w")
writeLines('"NFCORE_CRISPRSEQ:CRISPRSEQ_SCREENING:MAGECK_FLUTEMLE":', f)
writeLines(" MAGeCKFlute: ", f, sep = "")
writeLines(version_flute, f)
writeLines(" ggplot2: ", f, sep = "")
writeLines(version_ggplot, f)
writeLines(" clusterProfiler: ", f, sep = "")
writeLines(version_clusterprofiler, f)
writeLines(" pathview: ", f, sep = "")
writeLines(version_pathview, f)
close(f)
Command exit status:
127
Command output:
(empty)
Command error:
/usr/bin/env: 'Rscript': No such file or directory
Work dir:
/home/ap764/mageck/work/8d/013eae9d1032316baef01978a208a4
Tip: you can try to figure out what's wrong by changing to the process work dir and showing the script file named `.command.sh`
-- Check '.nextflow.log' file for details
ERROR ~ Pipeline failed. Please refer to troubleshooting docs: <https://nf-co.re/docs/usage/troubleshooting>
-- Check '.nextflow.log' file for detailsAastha Pal
07/24/2024, 6:52 AMLaurence Kuhlburger
07/24/2024, 6:54 AMAastha Pal
07/24/2024, 6:55 AMAastha Pal
07/24/2024, 6:56 AMLaurence Kuhlburger
07/24/2024, 6:56 AMAastha Pal
07/24/2024, 6:57 AMAastha Pal
07/24/2024, 7:06 AMLaurence Kuhlburger
07/24/2024, 7:28 AMAastha Pal
07/24/2024, 5:20 PMLaurence Kuhlburger
07/25/2024, 11:31 AMAastha Pal
07/25/2024, 3:18 PMLaurence Kuhlburger
07/25/2024, 3:19 PMAastha Pal
07/25/2024, 3:21 PMAastha Pal
07/25/2024, 3:21 PMLaurence Kuhlburger
07/25/2024, 7:29 PMAastha Pal
07/27/2024, 2:06 PMERROR ~ Error executing process > 'NFCORE_CRISPRSEQ:CRISPRSEQ_SCREENING:MAGECK_FLUTEMLE (design_matrix)'
Caused by:
Missing output file(s) `MAGeCKFlute_*/Enrichment/*` expected by process `NFCORE_CRISPRSEQ:CRISPRSEQ_SCREENING:MAGECK_FLUTEMLE (design_matrix)`Aastha Pal
07/27/2024, 2:07 PM[9b/df5628] process > NFCORE_CRISPRSEQ:CRISPRSEQ_SCREENING:FASTQC (POST-PTPRZ-CDR-O) [100%] 5 of 5 ✔
[9b/09170b] process > NFCORE_CRISPRSEQ:CRISPRSEQ_SCREENING:MAGECK_COUNT (POST-RFP-CDR-O,PRE-CDR-O,POST-EGF-CDR-O,POST-KCNM-CDR-O,POST-PTPRZ-CDR-O) [100%] 1 of 1 ✔
[89/06296f] process > NFCORE_CRISPRSEQ:CRISPRSEQ_SCREENING:MAGECK_MLE_MATRIX (design_matrix) [100%] 1 of 1 ✔
[81/f56ee0] process > NFCORE_CRISPRSEQ:CRISPRSEQ_SCREENING:MAGECK_FLUTEMLE (design_matrix) [100%] 1 of 1, failed: 1 ✘
[- ] process > NFCORE_CRISPRSEQ:CRISPRSEQ_SCREENING:MULTIQC [ 0%] 0 of 1
Execution cancelled -- Finishing pending tasks before exit
-[nf-core/crisprseq] Pipeline completed with errors-
ERROR ~ Error executing process > 'NFCORE_CRISPRSEQ:CRISPRSEQ_SCREENING:MAGECK_FLUTEMLE (design_matrix)'
Caused by:
Missing output file(s) `MAGeCKFlute_*/Enrichment/*` expected by process `NFCORE_CRISPRSEQ:CRISPRSEQ_SCREENING:MAGECK_FLUTEMLE (design_matrix)`
Command executed [/home/ap764/.nextflow/assets/nf-core/crisprseq/templates/template_fluteMLE.R]:Aastha Pal
07/27/2024, 2:08 PMAastha Pal
07/31/2024, 5:44 AMLaurence Kuhlburger
07/31/2024, 7:04 AMLaurence Kuhlburger
08/13/2024, 8:53 AMAastha Pal
08/18/2024, 9:47 PMLaurence Kuhlburger
08/19/2024, 6:45 AM-dev should work now, thanks for your patienceAastha Pal
08/19/2024, 3:40 PMLaurence Kuhlburger
08/20/2024, 6:57 AMLaurence Kuhlburger
08/29/2024, 1:39 PMAastha Pal
01/24/2025, 3:02 AMAastha Pal
01/24/2025, 3:02 AMAastha Pal
06/29/2025, 12:00 AM