hi!! how can I put parameters for my data ingestio...
# connector-development
j
hi!! how can I put parameters for my data ingestion to S3. for example I need pull only new data every day and stored it in partitions on S3 I was able to create parameters but only when I create the source
d
You need to implement IncrementalStream to only pull data incrementally, this depends from your source API. Also check the S3 destination pagehttps://docs.airbyte.com/integrations/destinations/s3 to check how the destination works with partitions