Hey all, does anyone know how or have a tip to cle...
# ask-community-for-troubleshooting
m
Hey all, does anyone know how or have a tip to clean tmp datasets created by airbyte in bigquery during sync?
👀 1
🙏 1
✍️ 1
u
@Marcos Marx (Airbyte) turned this message into Zendesk ticket 2429 to ensure timely resolution!
s
Hey @Maykon Lopes, take a look at this issue: https://github.com/airbytehq/airbyte/issues/7011
m
Thanks @Marcos Marx (Airbyte) @Saj Dider (Airbyte), Can I apply the script workaround to _raw and _scd tables?
s
Yes, @Maykon Lopes you should be able to apply the workaround. (Edit: see Marcos’ message below!)
thanks 1
m
, Can I apply the script workaround to _raw and _scd tables?
You can delete raw tables but not the
_scd
if I’m not mistake. The
_scd
tables are incrementally added and are used to build the final table without duplicate records.
🙏 1
m
do you have a roadmap to include features like cleanup temporary tables after sync? (I think it could be an option/flag), another thing I saw in airbyte forum was to centralize all intermediate tables in one exclusive dataset.
u
We are working on a solution to cleanup temporary tables after sync, but do not have a concrete delivery date at this point in time.
m
Thanks for the heads up @Nataly Merezhuk (Airbyte)