https://ploomber.io/ logo
#ask-anything
Title
# ask-anything
j

Jess Mankewitz (they/she)

06/14/2022, 6:55 PM
Right now, I’m just building the entire pipeline on the server and then pulling the results after the model runs, but I think this is messing with the expected metadata in the local pipeline 🤔
e

Eduardo

06/14/2022, 6:56 PM
yes. ploomber stores metadata in hidden files. you can fix the issue by copying the metadata as well. Just copy all the
.metadata
files from the server to local and the metadata will work fine example:
Copy code
total 1640
drwxr-xr-x  12 Edu  staff     384 Jun 13 16:59 ./
drwxr-xr-x  23 Edu  staff     736 Jun 13 18:37 ../
-rw-r--r--   1 Edu  staff     368 Jun 13 16:59 .features.parquet.metadata
-rw-r--r--   1 Edu  staff     361 Jun 13 16:59 .get.parquet.metadata
-rw-r--r--   1 Edu  staff     315 Jun 13 16:59 .join.parquet.metadata
-rw-r--r--   1 Edu  staff     819 Jun 13 16:59 .model.pickle.metadata
-rw-r--r--   1 Edu  staff     819 Jun 13 16:59 .nb.html.metadata
-rw-r--r--   1 Edu  staff    2514 Jun 13 16:59 features.parquet
-rw-r--r--   1 Edu  staff    5627 Jun 13 16:59 get.parquet
-rw-r--r--   1 Edu  staff    7093 Jun 13 16:59 join.parquet
-rw-r--r--   1 Edu  staff  161274 Jun 13 16:59 model.pickle
-rw-r--r--   1 Edu  staff  595640 Jun 13 16:59 nb.html
each product in a pipeline has a corresponding
.metadata
file
2 Views