hadoop noob here, just wondering, was impyla considered as a alternative to pyhive? it can pull the meta data for both kudu and hive tables (assuming Hive Metastore integration is enabled) as compared to pyhive, which can only get hive tables
g
gray-shoe-75895
07/07/2021, 5:18 PM
Impyla and pyhive have some overlap in functionality, but we ended up using (a fork of) pyhive in our own implementation since it supports http-based thrift transports, which I believe impyla doesn’t have
b
better-orange-49102
07/08/2021, 1:07 AM
not familiar with thrift, but i was trying to ingest kudu tables, so am trying out impyla. Only there's a downside in that i am unable to distinguish between hive and kudu tables when querying the Hive Metastore.
g
gray-shoe-75895
07/08/2021, 1:20 AM
Hmm I’m not too familiar with it myself - don’t really know about that issue