This message was deleted.

Hi Ruan Hui, may I know the version of your Hadoop cluster?

Thanks for the quick reply. sir. The hadoop cluster is our internal version based on hadoop 2.8.5, It is fully compatible with the community 2.8.5 version.

https://lists.apache.org/thread/q6l63glvnjntplh71568zg26s23hmym0 may be relevant

I think this is the problem. Really thanks for the reply. I wonder Is there anyway I can do to use index_hadoop task now ?

Any chance you can use SQL-based ingestion ?

I think this is the problem. Really thanks for the reply. I wonder Is there anyway I can do to use index_hadoop task now ?

Would it be possible for you to use the patch: https://github.com/apache/druid/pull/13138, if you need to run hadoop ingestion before 24.0.2 is available?

Thanks for your suggestion, @Brandon Tan But I’m afraid we won’t be able to use it. Anyway, thanks a lot.

You can also remove the MSQ extension from your config and that would fix this error as well. MSQ extension is included by default in 24.0.

Ok. Let me try it. Thanks a lot! 😄

hmm. can you confirm from the logs that MSQ extension is not getting loaded?

Sorry for not reply in time, got stuck by the work. Yes, I didn’t find MSQ in the logs. I guess it’s not getting loaded ?

i think you'll need to remove

druid-multi-stage-query

from the

druid.extensions.loadList

in your

common.runtime.properties

file

Hi @Gian Merlino Thanks for the kind reply. I did remove the MSQ from the list in common.runtime.properties, and I checked the log with multi-stage-query as the keyword to ensure that I removed, but it looks like this doesn’t solve the problem. So we downgraded to the version 0.23.0.😄 Thanks.

ok, good to hear you fixed it but sorry you had to downgrade! we'll fix this for future releases

It’s fine, never mind. Thanks all for the amazing work.👍