Hey team,
I was trying to refresh the source schem...
# replication-troubleshootingr
Rishabh D
10/28/2022, 6:40 AMHey team,
I was trying to refresh the source schema while pulling Salesforce data but there is a data reset happening every time . Is there a way to avoid this as the re-sync takes much longer than expected ?
e
Eli Sigal
11/01/2022, 6:25 AMHi.
There is an open issue about this.
Regarding a workaround.
you need to use airbyte API.
update source with new logic ->> run the connection done.
s
Saj Dider (Airbyte)
11/01/2022, 4:01 PM@Rishabh D, were you able to run the connection again?
r
Rishabh D
11/03/2022, 6:32 AM@Saj Dider (Airbyte) Yes, thanks team
Rishabh D
11/03/2022, 6:37 AMI’ve a couple of questions:
1. After a source schema refresh, there is a full reset of data for all the entities present in the connection as well as it takes significant time and resource for a full refresh every time this happens. Is there a way to reset only that entity where the schema has changed ? Further since after schema change the data is populated only from that day onwards or a default value is added for that column , is there a way to reload the data only for that entity and from the day the schema changed?
2. Is there a functionality or future prospects to achieve the same to select only particular columns for an entity?
cc: @Akul Goel
s
Saj Dider (Airbyte)
11/09/2022, 6:02 PMHey @Rishabh D,
Sorry for the delay, we’re experiencing a large number of user questions and are trying our best to reply to everyone.
I don’t believe there is currently a way to reset only the entity where the schema has changed. This is something that we are aware has strong interest from our community.
2 Views