Hi all, having trouble with initial setup with the...
# ask-community-for-troubleshooting
m
Hi all, having trouble with initial setup with the Salesforce connector. I was successfully able to load a smaller table (~5,000 rows, ~100 columns) from Salesforce to our Redshift instance, so can verify that the connection to Salesforce & Redshift were successful. However, when I try to sync one of our larger tables (~25,000 rows, ~600 columns), Airbyte says sync was successful but no rows were transmitted. I believe the error is on Salesforce's side as the SOQL query is too complex, as I received a similar error through another ETL service we are trialing and got it to work after reducing the number of fields (this link says 250 columns will likely not allow the query to run>). Is there any way to either 1.) reduce the number of fields that we are querying from Salesforce, or 2.) pull data from a custom report in Salesforce?
👀 1
h
Hey we have
streams_criteria
as an option in the source configuration settings is that not helping?
m
Thanks @Harshith (Airbyte) - I believe the streams_criteria field helps limit the amount of tables/objects that Airbyte sees. That option won't help reduce the number of columns queried in one table, will it?
h
Yeah you can then try multiple Connections. But yeah agree that won't help reduce number of columns. We don't still support that