This message was deleted.
# ask-anything
s
This message was deleted.
e
is the problem that the loading csv file wont recognize the datetime columns? if so, you can use the parquet format
👍 1
<http://df.to|df.to>_parquet
h
And how should that look like in my
pipeline.yaml
file. The following is my current one:
Copy code
tasks:
  - source: load_data.py
    product: 
      nb: output/load_data.ipynb
      data: output/data.csv
      data_n: output/data_n.csv
      
  - source: find_features.py
    product: 
      nb: output/find_features.ipynb
e
Just replace the “.csv” for “.parquet” and store the data frames with “df.to_parquet”
And do “pip install pyarrow”
h
Ok, thanks! Will give it a try!
e
Sure. Let me know if that works!
h
Yeah, that did it! Thanks!
meerkat 1
e
awesome!