Airbyte is an open-source data integration engine that helps you consolidate your data in your data warehouses, lakes and databases.

Airbyte

So I just setup an Airbyte EC2 instance with 100GiB of storage setup on the root volume. With that, I'm concerned about log storage over time. Does Airbyte currently manage how long logs are stored in the `/tmp` currently or do these accrue with time and need to be cleaned out occasionally for long running EC2 instances?

We have already a logs clean setup on airbyte we clean it occassionally

Awesome. I have some fairly long running Airbyte jobs going right now and it looks to generate about 0.3 GB of logs per run. Do you know how often the logs cleaner runs? I'm trying to determine the size of the root volume that is needed if I'm running these jobs every 24 hours.

<@U01THGWF69Z> <@U01MMSDJGC9> , is there any documentation on how frequently the logs cleaner runs? Just looking to understand how much storage to allocate to an EC2 instance.

<@U01MMSDJGC9> let me know and I'll add this to our docs!

Hi all,

Just wanted to follow-up on this to see about the logs cleaner cadence. Hoping to avoid a storage overload in the EC2 instance.