After downloading the raw dbs, there is some setup...
# proteinfold_dev
t
After downloading the raw dbs, there is some setup in a sub workflow before they are usable
e
I think this is where things might go differently from default paths to parsing local db paths
t
Paths could go wrong here but I thought Jose did recently test this
e
If you already got the faintest idea where the code might be handling them differently, let me know.
j
could you send me a
tree
of your path to colabfold db?
e
on it
Copy code
├── colabfold_envdb                                                                                                                                                                           
│   ├── colabfold_envdb_202108_db                                                                                                                                                             
│   ├── colabfold_envdb_202108_db_aln                                                                                                                                                         
│   ├── colabfold_envdb_202108_db_aln.dbtype                                                                                                                                                  
│   ├── colabfold_envdb_202108_db_aln.index                                                                                                                                                   
│   ├── colabfold_envdb_202108_db.dbtype                                                                                                                                                      
│   ├── colabfold_envdb_202108_db.GPU_READY                                                                                                                                                   
│   ├── colabfold_envdb_202108_db_h                                                                                                                                                           
│   ├── colabfold_envdb_202108_db_h.dbtype                                                                                                                                                    
│   ├── colabfold_envdb_202108_db_h.index                                                                                                                                              
│   ├── colabfold_envdb_202108_db.index                                                                                                                                                
│   ├── colabfold_envdb_202108_db.lookup                                                                                                                                               
│   ├── colabfold_envdb_202108_db_seq                                                                                                                                                  
│   ├── colabfold_envdb_202108_db_seq.dbtype                                                                                                                                           
│   ├── colabfold_envdb_202108_db_seq_h                                                                                                                                                
│   ├── colabfold_envdb_202108_db_seq_h.dbtype                                                                                                                                         
│   ├── colabfold_envdb_202108_db_seq_h.index                                                                                                                                          
│   └── colabfold_envdb_202108_db_seq.index                                                                                                                                            
├── params                                                                                                                                                                             
│   ├── LICENSE                                                                                                                                                                        
│   ├── params_model_1_multimer_v3.npz                                                                                                                                                 
│   ├── params_model_1.npz                                                                                                                                                             
│   ├── params_model_2_multimer_v3.npz     
│   ├── params_model_2.npz            
│   ├── params_model_2_ptm.npz            
│   ├── params_model_3_multimer_v3.npz          
│   ├── params_model_3.npz                      
│   ├── params_model_4_multimer_v3.npz          
│   ├── params_model_4.npz                      
│   ├── params_model_5_multimer_v3.npz          
│   └── params_model_5.npz                      
└── uniref30_2302.db                            
    ├── uniref30_2302_db                        
    ├── uniref30_2302_db_aln                    
    ├── uniref30_2302_db_aln.dbtype             
    ├── uniref30_2302_db_aln.index              
    ├── uniref30_2302_db.dbtype                 
    ├── uniref30_2302_db.GPU_READY              
    ├── uniref30_2302_db_h                      
    ├── uniref30_2302_db_h.dbtype               
    ├── uniref30_2302_db_h.index                
    ├── uniref30_2302_db.index                  
    ├── uniref30_2302_db.lookup                 
    ├── uniref30_2302_db_mapping                
    ├── uniref30_2302_db_seq                    
    ├── uniref30_2302_db_seq.dbtype
    ├── uniref30_2302_db_seq_h                 
    ├── uniref30_2302_db_seq_h.dbtype          
    ├── uniref30_2302_db_seq_h.index           
    ├── uniref30_2302_db_seq.index             
    └── uniref30_2302_db_taxonomy
j
this is how the data is downloaded using the pipeline, isn’t it?
e
Yep
Exactly the same
j
the pipeline expects this instead:
Copy code
colabfold_db/params/alphafold_params_*
👍 1
this is the issue
t
The reason for the nesting was to make it fit more cleanly with all the other modes
Rather than dumping all params in to 1 directory
j
also, this way different set of parameters can be used
👍 1
e
But why would the module downloading these works, and then if you provide the same downloaded paths manually does not? Isn't this a bit not intuitive for the user? At least should be made clear at usage.md on what to change after downloading if you want to use the already downloaded files?
t
I think the I nconsistency is a bug
j
yes, maybe it is something we have to change, because when downloading the process are connected to work but then we changed the structure of the DBs, I have tested this separately, but not downloading and then running the pipeline with the downloaded files
e
And since the database is this huge...we don't want to frustrate the users, right? xD
t
I think it is good idea to change the setup process to mimic the expected structure 😁
🙏 1
e
Shall I create an issue?
j
Yes, please
e
j
Would you mind sending me the content of the work directory of the
COLABFOLD_BATCH
when you provided this?
If you don’t have it handy anymore don’t worry I can try to reproduce it
e
Because it was a symlink, it has now been updated to the latest correct version, even in the previous erroneous work folder. But I remember it was just params/alphafold_params_colab_2022-12-06 inside the params folder, but because it didnt exist, it produced the error
👍🏻 1
The rest of the folders were as intended
So from this:
Copy code
colabfold_alphafold2_params_tags = [
        "alphafold2_multimer_v1" : "alphafold_params_colab_2021-10-27",
        "alphafold2_multimer_v2" : "alphafold_params_colab_2022-03-02",
        "alphafold2_multimer_v3" : "alphafold_params_colab_2022-12-06",
        "alphafold2_ptm"         : "alphafold_params_2021-07-14"
    ]
It probably expects the exact name for the params subfolder
ANd now I am not sure if it's even the correct version I renamed xD
Or if I should have manually downloaded the correct version params for the multimer_v3 mode