Hi everyone! We're trying to get a Databricks destination set up but keep running into an error. When testing the connection during setup, it runs fine, but then when we try to sync we get the following error. Any ideas?
line 132: _Failed to finalize copy to temp table due to: java.sql.SQLException: [Databricks][DatabricksJDBCDriver](500051) ERROR processing query/statement. Error Code: 0, SQL state: org.apache.hive.service.cli.HiveSQLException: Error running query: java.nio.file.AccessDeniedException: <s3path_>_: getFileStatus on <s3path>: com.amazonaws.services.s3.model.AmazonS3Exception: Forbidden; request: HEAD <s3path> {} Hadoop 3.3.4, aws-sdk-java/1.12.189 Linux/4.15.0-2081-aws-fips OpenJDK_64-Bit_Server_VM/25.345-b01 java/1.8.0_345 scala/2.12.14 vendor/Azul_Systems,Inc. cfg/retry-mode/legacy com.amazonaws.services.s3.model.GetObjectMetadataRequest; Request ID: 2H0AFD7D7CQW5RX0, Extended Request ID: lN/ALks7QIeuNNlDNtlrCyK15z8eHqSaRQDqYpDhdHjiXLf69cME9aPsUPegnOqKANGFC15VDOk=, Cloud Provider: AWS, Instance ID: <instanceID> (Service: Amazon S3; Status Code: 403; Error Code: 403 Forbidden; Request ID: 2H0AFD7D7CQW5RX0; S3 Extended Request ID: lN/ALks7QIeuNNlDNtlrCyK15z8eHqSaRQDqYpDhdHjiXLf69cME9aPsUPegnOqKANGFC15VDOk=; Proxy: null), S3 Extended Request ID: lN/ALks7QIeuNNlDNtlrCyK15z8eHqSaRQDqYpDhdHjiXLf69cME9aPsUPegnOqKANGFC15VDOk=:403 Forbidden