my airbyte instance became unstable, looked into i...
# advice-data-ingestionr
Rocky Appiah
08/29/2022, 1:00 PMmy airbyte instance became unstable, looked into it and we ran out of disk space. airbyte_workspace is taking up almost 50 GB of disk
Rocky Appiah
08/29/2022, 1:41 PMI realize I can’t delete this volume, but how do I clean it up without destroying state for all my connections?
Currently the UI is unresponsive!
e
Eli Sigal
08/29/2022, 2:15 PMHi.
you need to expand the disk space or delete data from it to make the UI responsive - it is not responsive due to 100% (not really 100% but at max) of that is available
a
Anatole Callies
08/29/2022, 3:23 PMHey @Rocky Appiah,
Logs and Connectors use a lot of space. See here : https://airbytehq.slack.com/archives/C01MFR03D5W/p1643793523826299
How I solved it:
1. Streaming logs to an external tool
2. Have a job that erases old logs on a regular basis
3. Do not upgrade connectors that you don’t use
9 Views