airbyte diskspace filling up in 80gb ec2 where im ...
# ask-community-for-troubleshootingd
Dharshan Viswanathan
06/14/2022, 2:34 PMairbyte diskspace filling up in 80gb ec2 where im just doing 100 mb full refresh of table data each run happens every 15 minutes i think all the historical data is getting stored in the disk but thats just my assumption
m
Marcos Marx (Airbyte)
06/14/2022, 4:39 PMcan you run
sudo du -a / 2>/dev/null | sort -n -r | head -n 20d
Dharshan Viswanathan
06/14/2022, 11:54 PMsorry i removed the volume in the meantime below is the analyses command which i ran
Dharshan Viswanathan
06/14/2022, 11:55 PMnow
m
Marcos Marx (Airbyte)
06/15/2022, 12:36 PMmaybe something more digestible is
docker system dfd
Dharshan Viswanathan
06/15/2022, 10:23 PM[ec2-user@ip-10-1-29-121 airbyte]$ docker system df
TYPE TOTAL ACTIVE SIZE RECLAIMABLE
Images 12 8 3.11GB 1.565GB (50%)
Containers 8 6 401.6kB 44.35kB (11%)
Local Volumes 3 3 110.5GB 0B (0%)
Build Cache 0 0 0B 0B
Dharshan Viswanathan
06/15/2022, 10:23 PMLocal Volumes 3 3 110.5GB 0B (0%) is airbyte which is filling up
Dharshan Viswanathan
06/15/2022, 10:25 PMLocal Volumes space usage:
VOLUME NAME LINKS SIZE
airbyte_data 2 0B
airbyte_db 1 360.2MB
airbyte_workspace 3 110.1GB
m
Marcos Marx (Airbyte)
06/16/2022, 1:08 AMHow many syncs do you have? and how frequent are they running?
d
Dharshan Viswanathan
06/16/2022, 2:08 AMi have 4 syncs which runs every 15 minutes all are full refresh