Hi all, I was trying to integrate spark with datahub by creating a spark session in notebook. While running spark read i’m getting below error. Can someone help with it?

daasDf = spark.read.format("csv").option("inferSchema", "true").option("header", "true").load("filename")

ERROR DatasetExtractor: class org.apache.spark.sql.catalyst.plans.logical.GlobalLimit is not supported yet. Please contact datahub team for further support.

Hi Rohit, I believe this is an ongoing feature request on Git- https://github.com/datahub-project/datahub/issues/5169 Could you comment there to let us know so we can prioritize it for upcoming releases?