Title
#advice-data-transformation
Antonia Villa

Antonia Villa

08/22/2022, 8:06 PM
Cross posting here as I am struggling to understand why dates are not being transformed correctly in the salesforce connector
8:25 PM
Looking through the JSON Schema for the salesforce connector, it appears that anything that appears with the definition of
{"anyOf":[{"type":"string","format":"date-time"}
does not translate to a date in BigQ. In the subsequent logs, there are warnings for all of these fields:
2022-08-22 18:09:55 [42mnormalization[0m > WARN: Unknown type for column CloseDate at Opportunity
2022-08-22 18:09:55 [42mnormalization[0m > WARN: Unknown type for column CreatedDate at Opportunity
2022-08-22 18:09:55 [42mnormalization[0m > WARN: Unknown type for column LastViewedDate at Opportunity
2022-08-22 18:09:55 [42mnormalization[0m > WARN: Unknown type for column SystemModstamp at Opportunity
2022-08-22 18:09:55 [42mnormalization[0m > WARN: Unknown type for column LastActivityDate at Opportunity
2022-08-22 18:09:55 [42mnormalization[0m > WARN: Unknown type for column LastModifiedDate at Opportunity
2022-08-22 18:09:55 [42mnormalization[0m > WARN: Unknown type for column Checkback_Date__c at Opportunity
2022-08-22 18:09:55 [42mnormalization[0m > WARN: Unknown type for column LastReferencedDate at Opportunity
2022-08-22 18:09:55 [42mnormalization[0m > WARN: Unknown type for column Contract_End_Date__c at Opportunity
2022-08-22 18:09:55 [42mnormalization[0m > WARN: Unknown type for column Contract_Start_Date__c at Opportunity
2022-08-22 18:09:55 [42mnormalization[0m > WARN: Unknown type for column POC_Expiration_Date__c at Opportunity
2022-08-22 18:09:55 [42mnormalization[0m > WARN: Unknown type for column Trade_Negotiation_Date__c at Opportunity
2022-08-22 18:09:55 [42mnormalization[0m > WARN: Unknown type for column Potential_Interest_Date__c at Opportunity
2022-08-22 18:09:55 [42mnormalization[0m > WARN: Unknown type for column Diagnosis_Discovery_Date__c at Opportunity
2022-08-22 18:09:55 [42mnormalization[0m > WARN: Unknown type for column Discovery_Meeting_Set_On__c at Opportunity
2022-08-22 18:09:55 [42mnormalization[0m > WARN: Unknown type for column Discovery_Meeting_Set_For__c at Opportunity
2022-08-22 18:09:55 [42mnormalization[0m > WARN: Unknown type for column Proof_of_Concept_End_Date__c at Opportunity
2022-08-22 18:09:55 [42mnormalization[0m > WARN: Unknown type for column Perscription_Proposal_Date__c at Opportunity
2022-08-22 18:09:55 [42mnormalization[0m > WARN: Unknown type for column Techincal_Demo_Review_Date__c at Opportunity
2022-08-22 18:09:55 [42mnormalization[0m > WARN: Unknown type for column Proof_of_Concept_Start_Date__c at Opportunity
2022-08-22 18:09:55 [42mnormalization[0m > WARN: Unknown type for column Last_Activity_Completed_Date__c at Opportunity