https://linen.dev logo
#ask-community-for-troubleshooting
Title
# ask-community-for-troubleshooting
m

Maykon Lopes

09/26/2022, 11:47 AM
Hey all, does anyone know how or have a tip to clean tmp datasets created by airbyte in bigquery during sync?
s

Saj Dider (Airbyte)

09/26/2022, 2:45 PM
Hey @Maykon Lopes, take a look at this issue: https://github.com/airbytehq/airbyte/issues/7011
m

Maykon Lopes

09/26/2022, 4:59 PM
Thanks @Marcos Marx (Airbyte) @Saj Dider (Airbyte), Can I apply the script workaround to _raw and _scd tables?
s

Saj Dider (Airbyte)

09/26/2022, 5:14 PM
Yes, @Maykon Lopes you should be able to apply the workaround. (Edit: see Marcos’ message below!)
m

Marcos Marx (Airbyte)

09/26/2022, 5:15 PM
, Can I apply the script workaround to _raw and _scd tables?
You can delete raw tables but not the
_scd
if I’m not mistake. The
_scd
tables are incrementally added and are used to build the final table without duplicate records.
m

Maykon Lopes

09/26/2022, 9:53 PM
do you have a roadmap to include features like cleanup temporary tables after sync? (I think it could be an option/flag), another thing I saw in airbyte forum was to centralize all intermediate tables in one exclusive dataset.
Thanks for the heads up @Nataly Merezhuk (Airbyte)