Hi all. We want to use datahub to parse some sql commands using spark3.0. But I find that the latest code uses spark2.0. I want to know when will the project support spark3.0?

it should work with spark 3.0 as well and internally we use it with that

But I check the master code and find that it only support some sql commands using

InsertIntoHadoopFsRelationCommand.class, SaveIntoDataSourceCommand.class,
CreateDataSourceTableAsSelectCommand.class, CreateHiveTableAsSelectCommand.class, InsertIntoHiveTable.class

.We want to use datahub to analyze sql commands which use the class called 'BatchScanExec' exist in spark sql3. What should we do?

These.are currently not supported unfortunately 😞

Our team wants to do secondary development of the master code. But we find that the latest code use spark2.0. Do you have plan to make the master code support spark3.0?

Hi @ripe-electrician-13049, we’re still building out our roadmap for the upcoming releases, please submit a feature request here: https://feature-requests.datahubproject.io/