Oh, only the data in final table is deleted. We would need a way to delete all data and tables, for a connection in a destination. Not a big deal, I can hard code it. But would be nice if Airbyte took care of it, since it knows the intermediate tables it created.
u
user
11/05/2021, 10:49 AM
Hi @Vijay, just in order to clarify, which destination are you talking about, is it Postgres?
g
George Claireaux (Airbyte)
11/05/2021, 2:18 PM
I tested on MySQL. Thanks @[DEPRECATED] Augustin Lafanechere !
u
user
11/05/2021, 2:42 PM
According to this documentation, resetting a connection won't indeed delete the created tables.
g
George Claireaux (Airbyte)
11/05/2021, 2:54 PM
The idea behind the reset button is that you can restart a sync from a blank state. I think Airbyte is not deleting the table because you might have other applications requiring the existence of this table, wether or not the connection is still active. Feel free to fill an issue on our repo for a feature request.
u
user
11/05/2021, 3:02 PM
Thanks for the doc link! It does make sense. Perhaps, Airbyte can clear the intermediate tables when a connection is deleted, while keeping the final table untouched. Mainly I want to avoid writing logic that will keep track of Airbyte intermediate tables like "_airbyte__raw" and "_scd". A new API to "destroy" connection tables could handle this.