I have uploaded artifacts (manifest,catalog,source...
# ingestion
r
I have uploaded artifacts (manifest,catalog,sources,results) from Dbt CLoud to Google Cloud Storage through Air flow. Is there any way to access each file in Google Cloud Storage from dbt ingestion on DataHub?
h
Hey @rough-activity-61346, dbt source supports reading files from s3 but not directly from Google cloud storage (GCS) at the moment. I suppose, it may work out of the box with gcs, since GCS interoperability api works with boto3 which is used for connecting to S3. Here is GCS doc with an example of how to configure boto3 . You can try updating
aws_connection
config accordingly. https://cloud.google.com/storage/docs/aws-simple-migration#storage-list-buckets-s3-python
r
@hundreds-photographer-13496 Thank you for answering my question.