df.write.mode(‘overwrite’).saveAsTable(‘sparktable’)

[9:06 AM] 22/03/10 09:05:18 ERROR Schema: Failed initialising database.
Unable to open a test connection to the given database. JDBC url = jdbc:derby:;databaseName=metastore_db;create=true, username = APP. Terminating connection pool (set lazyInit to true if you expect to start your database after your app). Original Exception: ------
java.sql.SQLException: Failed to start database 'metastore_db' with class loader org.apache.spark.sql.hive.client.IsolatedClientLoader$$anon$1@5c09afbc, see the next exception for details.
	at org.apache.derby.impl.jdbc.SQLExceptionFactory.getSQLException(Unknown Source)
	at org.apache.derby.impl.jdbc.SQLExceptionFactory.getSQLException(Unknown Source)
	at org.apache.derby.impl.jdbc.Util.seeNextException(Unknown Source)

@careful-pilot-86309 can you help Dipankar w/ the spark connector?

@careful-pilot-86309 I posted the error message on #ingestion

my guess is that, this error will be there without adding datahubsparklistener? Generally this happens when multiple processes are trying to read from same metastore_db. Can you try to delete metastore_db (it will be created automatically later) folder and check?