hello - I’m trying to setup a connection between S...
# replication-troubleshootingc
Carolina Buckler
12/01/2022, 6:08 PMhello - I’m trying to setup a connection between Salesforce and Snowflake, but I am getting an error. Is there a permission or configuration I need to do to allow this?
Copy code
Error: common.error
Discovering schema failed
Max retries exceeded with url
Stream Account cannot be processed by REST or BULK API.m
Marcos Marx (Airbyte)
12/01/2022, 10:17 PMCan you share more information? What Airybte version, connector and OS are you using.
Marcos Marx (Airbyte)
12/01/2022, 10:18 PMMaybe use filter streams in Salesforce to use a subset of all streams.
c
Carolina Buckler
12/01/2022, 10:19 PMairbyte version
0.40.22m
Marcos Marx (Airbyte)
12/01/2022, 10:20 PMExample:
c
Carolina Buckler
12/01/2022, 10:20 PMI was able to connect to a different Salesforce environment, so it must be something in the Salesforce
Carolina Buckler
12/01/2022, 10:21 PMAlthough, with this setup the raw data gets in, but the transformation does not work
Carolina Buckler
12/01/2022, 10:22 PM Copy code
2022-12-01 22:14:41 ERROR i.a.w.g.DefaultNormalizationWorker(run):101 - Normalization Failed.Carolina Buckler
12/01/2022, 10:26 PMDoes a new schema need to be created for this to work? It seems like the sync is trying to create an additional schema in Snowflake with
_AIRBYTE_Carolina Buckler
12/02/2022, 5:34 PMand if I have the Account object, I get this error
2022-12-01 21:03:13 *ERROR* c.n.s.DateTimeValidator(tryParse):82 - Invalid date-time: Invalid timezone offset: +0000Carolina Buckler
12/02/2022, 5:35 PMSnowflake connector version
0.4.40Carolina Buckler
12/02/2022, 5:35 PMSalesforce source connector version
1.0.27Carolina Buckler
12/02/2022, 5:36 PM@Marcos Marx (Airbyte) ^ here’s my thread
m
Marcos Marx (Airbyte)
12/02/2022, 5:56 PMSorry Carolina, I still don’t understand clearly what is your issue. Can you be describe clearly what steps and what information you have?
c
Carolina Buckler
12/02/2022, 6:01 PMI have set up a connection between a Salesforce Sandbox environment and Snowflake. The data seems to load correctly in the
_AIRBYTE_RAW_*Carolina Buckler
12/02/2022, 6:03 PMI also receive an error in Snowflake because the sync tries to create a new schema with
_AIRBYTE_Carolina Buckler
12/02/2022, 6:06 PMScreen Shot 2022-12-02 at 1.06.15 PM.png
Carolina Buckler
12/02/2022, 6:07 PM_2022-12-02 17:44:39 -_ Additional Failure Information: 003001 (42501): SQL access control error:m
Marcos Marx (Airbyte)
12/02/2022, 6:22 PMCan you upload the compelte log file here?
c
Carolina Buckler
12/02/2022, 6:34 PMbb635edb_9de0_44f8_bdd0_04b85b33f14b_logs_14_txt.txt,bb635edb_9de0_44f8_bdd0_04b85b33f14b_logs_24_txt.txt
m
Marcos Marx (Airbyte)
12/02/2022, 6:44 PM Copy code
2022-12-01 21:02:49 [42mnormalization[0m > Encountered an error:
Database Error
003001 (42501): SQL access control error:
Insufficient privileges to operate on database 'DEMO_DB'c
Carolina Buckler
12/02/2022, 6:45 PMwhy is it trying to create a new schema?
m
Marcos Marx (Airbyte)
12/02/2022, 6:46 PMI think to store temporary data when doing the normalization
c
Carolina Buckler
12/02/2022, 6:46 PMthe specified schema that it has permission to is
DEMO_DB.AIRBYTE_SALESFORCE_QTC_DEVCarolina Buckler
12/02/2022, 6:47 PMis there a way to turn that off or use the existing schema?
m
Marcos Marx (Airbyte)
12/02/2022, 6:48 PMOnly if you use custom normalization to change the current behavior
c
Carolina Buckler
12/05/2022, 5:48 PMAre there standard custom transformations for typical sources like Salesforce?
u
user
12/05/2022, 5:55 PMNo, there isn't. You will copy the generated project and you can change it to achieve the result you want to.