This message was deleted.

following your example are you looking to upload

my.log

? if so, where do you want to upload it?

S3 bucket. But the log are generated after I runned the pipeline.

ah. this is an interesting use case. you'd have to add code to manually upload the log file to S3, but since we already support S3 for uploading artifacts. it makes sense to support uploading the log as well. can you create an issue?

If you show me how I will gladly create an issue :) I can always create another pipeline to upload various log file created while running ETL pipeline and run that one when needed meanwhile. Uploading log to bucket would be for trackability and keeping record of performance. We can't never have too much data 🤘😅

sure, create the issue here: https://github.com/ploomber/ploomber/issues/new

created

thanks!