Just putting the question out there - is anyone us...
# replication-troubleshootingj
Jordan Fox
01/14/2023, 10:53 PMJust putting the question out there - is anyone using or working on Databricks SQL as a source connector yet? Is anyone else interested in Databricks SQL as a source?
➕ 1
n
Nataly Merezhuk (Airbyte)
01/17/2023, 5:00 PMHey Jordan! I am not aware of anyone working on this, but the best place to look would be GitHub. If there is no current issue open, I suggest you create one!
n
Nohelia Merino
04/12/2023, 8:45 PM@Jordan Fox did you create an issue for this, or how did you sort this out?
j
Jordan Fox
04/12/2023, 11:34 PMDatabricks came out with a SQL rest api so I slapped that into the gui rest connector builder and it works fine for my use case.
👍 1
Jordan Fox
05/27/2023, 10:34 PMI've revisited this and am handling it entirely differently now. Trino has connectors to most of the data sources I want and it also has a deltalake connector. I'm using airflow to orchestrate trino queries to load data into delta and am registering that deltalake location directly in unity catalog. I've taken airbyte almost entirely out of the loop but for rest connectors.
Jordan Fox
05/27/2023, 10:35 PMMy issue was edge cases around data replication. There were too many I couldn't handle with airbyte due to older, poorly designed table sources.
l
Lucas Segers
03/12/2024, 4:48 PMIssue: https://github.com/airbytehq/airbyte/issues/28161
PR: https://github.com/airbytehq/airbyte/pull/28163
seems that the PR was closed because of an internal refactor
j
Jordan Fox
03/15/2024, 4:56 PMYeah, it'd be great to have a connector direct to sql warehouse but the sql execution rest api works just fine.
5 Views