hi!!
how can I put parameters for my data ingestion to S3. for example I need pull only new data every day and stored it in partitions on S3
I was able to create parameters but only when I create the source
d
Daniel Eduardo Portugal Revilla
01/27/2022, 7:12 PM
You need to implement IncrementalStream to only pull data incrementally, this depends from your source API. Also check the S3 destination pagehttps://docs.airbyte.com/integrations/destinations/s3 to check how the destination works with partitions