Hey team, I'm try to create a connection with S3 a...
# help-connector-development
m
Hey team, I'm try to create a connection with S3 as a source. For the Pattern of files to replicate I need to pass the date when the sync runs. Something like myfolder/dt=${YEAR}-${MONTH}-${DAY}. Is that the right way to do it? Ultimately I want to pass a date provided by Airflow
k
A message from kapa.ai
Currently, the information extracts do not provide a way to dynamically set the date in the Pattern of files to replicate field for the S3 source. However, you can use placeholders like
{date}
,
{date:yyyy_MM}
,
{timestamp}
,
{timestamp:millis}
, and
{timestamp:micros}
in the S3 Filename pattern when setting up an S3 destination connector [source](https://docs.airbyte.com/integrations/destinations/s3#setup-guide). For your use case, you might need to adjust your file organization in the S3 bucket or consider using a different approach to achieve the desired behavior.