Hi, I have a question. I'm running all these DBT(data build tools) jobs using Apache Spark as the compute framework. Is there anyway I can run the compute using the Daft framework while still building on DBT.

If you want to continue using the spark api's, We have an experimental spark-connect api you could try out.

I think I'd prefer using dbt to build the model but then run the compute on Daft. I was reading up on how some other use cases have implemented this, it seems like I can use DBT to build the models that are then orchestrated by Airflow to run as Daft jobs. Is there no direct way to run DBT jobs using Daft compute engine? @Cory Grinstead

we don't have any native connectors for DBT. This would likely need to be a community led effort as we don't have the bandwidth to support building & maintaining a dedicated DBT connector.

@Cory Grinstead: I'm guessing the recommended approach as of today would still be to use an external scheduler like Airflow. https://dist-data.slack.com/archives/C041NA2RBFD/p1754754887861459