https://linen.dev logo
Join Slack
Powered by
Question about logs — on an EC2 instance, I’m seei...
# ask-community-for-troubleshooting
z
Question about logs — on an EC2 instance, I’m seeing many directories in the 
airbyte_workspace
volume 
/data
. According to the docs this is where logs, configs, and I assume other things are stored. Is it safe to delete these after a period of time? I need to cleanup logs on a very large Airbyte instance (millions of directories in 
/data
) and would like to remove all directories older than 2 weeks, but do not want to remove data that will not be regenerated.
The primary confusion is in the catalog files, which contain credentials, stream config, etc. Are the credentials etc saved elsewhere?
m
What version are you @Zak Keener laetst version of Airbyte the product is moving file system to be stored in the airbyte-db
z
Hey Marcos 🙂 we’re using 
0.36.2-alpha
That sounds great — so that would remove the need for the files stored in the volume altogether?
m
yes, but not sure the correct versino this was removed. take a look in the dockerfile too see if there is any volume mapping yet
z
Ok, do you know which version that was released in?
Also, do you know if the creds that are stored in these files are saved elsewhere (assuming this is what’s now stored in the db)?
Trying to figure out which of these directories/files I can delete 😄
Our mappings:
Copy code
temporal:
    volumes:
      - ./temporal/dynamicconfig:/etc/temporal/config/dynamicconfig

server:
    volumes:
      - workspace:${WORKSPACE_ROOT}
      - data:${CONFIG_ROOT}
      - ${LOCAL_ROOT}:${LOCAL_ROOT}

scheduler:
    volumes:
      - /var/run/docker.sock:/var/run/docker.sock
      - workspace:${WORKSPACE_ROOT}
      - ${LOCAL_ROOT}:${LOCAL_ROOT}
      - data:${CONFIG_ROOT}
2 Views
Open in Slack
PreviousNext
Powered by