@kapa.ai Is there a way to read an Excel file from Sharepoint and load it in to a Databricks table

Thinking completed Yes, you can read an Excel file from Microsoft SharePoint and load it into a Databricks table using Airbyte by configuring the Microsoft SharePoint source connector and the Databricks Lakehouse destination connector. Step 1: Configure the Microsoft SharePoint Source Airbyte provides a file-based Microsoft SharePoint source connector that can parse files from SharePoint [metadata.yaml; source.py]: 1. In Airbyte, create a new Source and select Microsoft SharePoint. 2. Configure authentication using Microsoft Graph / Azure AD permissions (e.g.,

Files.Read.All

,

Sites.Read.All

) [source.py]. 3. Provide your SharePoint Site URL [Copy Raw Files Configuration]. 4. In the stream/file configuration: ◦ Specify the file pattern/path pointing to your Excel file(s). ◦ Set the file format to parse the Excel content so the data rows are extracted into records rather than transferred as raw binary files [Copy Raw Files Configuration; client.py]. Step 2: Configure the Databricks Lakehouse Destination Airbyte includes a certified Databricks Lakehouse destination connector [metadata.yaml]: 1. Ensure prerequisites are met in Databricks [Databricks Lakehouse]: ◦ A Databricks workspace with Unity Catalog enabled. ◦ An active SQL Warehouse or compute cluster. ◦ Permissions to create schemas, tables, and Unity Catalog Volumes (used for staging). 1. Gather connection parameters from your SQL Warehouse connection details [Databricks Lakehouse]: ◦ Server Hostname ◦ HTTP Path ◦ Port (default is

443

) ◦ Unity Catalog Name 1. Select an authentication method: ◦ OAuth2 (Service Principal client ID and secret, recommended) [Databricks Lakehouse]. ◦ Personal Access Token [Databricks Lakehouse]. 1. In Airbyte, create a new Destination, choose Databricks Lakehouse, enter the above details, and accept the JDBC/ODBC driver terms [Databricks Lakehouse; Step 3: Set Up a Databricks Lakehouse Destination]. Step 3: Create the Connection 1. Create a Connection linking your SharePoint source to your Databricks destination. 2. Select the stream generated from your Excel file configuration [Supported Streams]. 3. Choose your sync mode (such as Full Refresh | Overwrite or Incremental | Append) [Copy Raw Files Configuration]. 4. Run the sync. With destination version

4.0.0+

, data is loaded directly into final tables in your Unity Catalog without generating intermediate raw (

_airbyte_raw_*

) tables [Databricks Lakehouse]. 👍 0 button 👎 0 button ℹ️ Tip: Mention @kapa.ai in the thread for follow-ups or DM the app for 1-to-1 help.