Clovis Masson
02/23/2022, 8:28 AM.yaml
files before re-uploading it.
Problem here is that these yaml files are getting bigger and bigger (especially JOBS.yaml
and ATTEMPTS.yaml
) and it's getting complicated to browse easily each to make my changes. What could be a solution to trim these files safely without causing side effects ? For instance, I would have deleted all inactive connection from files, as well as old job but I don't want to break or to loose my existing data sync.
Is there any existing tool/solution for cleaning / trimming these config files ?airbyte-db
pod and by updating directly rows from the different tables (I guess airbyte.attempts
, <http://airbyte.jobs|airbyte.jobs>
and airbyte.airbyte_configs
in my case) , this will have the same consequences as changing the .yaml
files from the exported config ?