<@U04SE163WC8> for SFTP Bulk Connector version 1.0...
# replication-ask-ai
m
@kapa.ai for SFTP Bulk Connector version 1.0, how do you specify a specific file prefix with wild cards afterwards. I'd used the regular expression "TestTransactionsPROD.**" in the previous versions of the connector, but using a similar glob pattern (ex: "TestTransactionsPROD**") in version 1.0 doesn't return any files, as indicated by this error message: "No files were identified in the stream. This may be because there are no files in the specified container, or because your glob patterns did not match any files. Please verify that your source contains files last modified after the start_date and that your glob patterns are not overly strict"
k
To specify a specific file prefix with wildcards in the SFTP Bulk Connector version 1.0, you need to use the correct glob pattern. Based on the error message you provided, it seems that the pattern you are using might be too strict or not correctly formatted for the new version. In version 1.0.0 of the SFTP Bulk Connector, the migration to the File-Based CDK might have introduced changes in how glob patterns are interpreted. Here are some steps you can take to troubleshoot and resolve the issue: 1. Verify the Glob Pattern: Ensure that your glob pattern is correctly formatted. For example, if you want to match files that start with "TestTransactionsPROD" and have any characters following it, you should use the pattern
TestTransactionsPROD*
. 2. Check File Paths: Make sure that the files you are trying to match are indeed present in the specified directory on the SFTP server and that they match the glob pattern. 3. Review Configuration: Double-check your connector configuration to ensure that all other settings (such as the start date and file format) are correctly specified. Here is an example configuration snippet for the glob pattern:
Copy code
json {   "globs": ["TestTransactionsPROD*"] }
If you continue to experience issues, you might want to refer to the [SFTP Bulk Migration Guide](https://docs.airbyte.com/integrations/sources/sftp-bulk-migrations#upgrading-to-100) for additional details on changes introduced in version 1.0.0. For further assistance, you can also check the [SFTP Bulk Connector Changelog](https://docs.airbyte.com/integrations/sources/sftp-bulk#changelog) to see if there are any relevant updates or fixes that might address your issue. If none of these steps resolve the problem, consider opening a new issue on the [Airbyte GitHub repository](https://github.com/airbytehq/airbyte/issues) with detailed information about your configuration and the error message you are encountering. This will help the Airbyte team to provide more specific guidance. For more information, you can refer to the following sources: - [SFTP Bulk Migration Guide](https://docs.airbyte.com/integrations/sources/sftp-bulk-migrations#upgrading-to-100) - [SFTP Bulk Connector Changelog](https://docs.airbyte.com/integrations/sources/sftp-bulk#changelog)