Hi Team, We are just getting started with airbyte...
# ask-community-for-troubleshooting
n
Hi Team, We are just getting started with airbyte by connecting amplitude (source) and redshift (destination). I keep a historical sync date as of a month back..but it is only syncing data since today. Would need help on how can we export historical data from Amplitude using airbyte
s
@Nitish Amnerkar can you share the log of your sync job?
n
Hi Shrif, I have shared you on DM.
s
@Nitish Amnerkar thanks for sharing. which streams are you seeing this issue with? do you have a sense of how many records you’d expect to see?
and you can confirm that there are records from a previous date in your amplitude instance?
n
Yes we have 10-20M records per day including historical data
please pardon my understanding..what is streams here?
streams in this case corresponds to endpoints in the APi
n
We are mainly interested in events data..
s
and you’re not seeing any event data in redshift?
n
we are seeing it but only for today's date.. we also wanted to export historical data as I have added the start date as 2021-01-01 in the connector settings
s
yup makes sense
let me try to repro
n
sure thanks
s
@Nitish Amnerkar just ran a sync from amplitude to redshift on the events stream and it looks correct, we are replicating events from the start date (I set may 20th as the date)
could you try configuring the sync mode on the events schema to be
incremental - append
and reset your schema?