Also I had to install thrift (`pip install thrift`...
# ingestion
i
Also I had to install thrift (
pip install thrift
) in my python environment to get this far
Got this to work, needed to specify additional custom properties:
Copy code
---
source:
  type: hive
  config:
    username: hive
    password: hive
    host_port: localhost:10000
    options:
      connect_args:
        auth: CUSTOM
I don't think this
options
map object is documented in the READMEs, nor how to use-it. Took me while to find it. The
connect_args
is specific to hive. Also needed to install the following pip dependencies:
Copy code
pip install pyhive
pip install thrift
pip install sasl,
pip install thrift_sasl
Sasl requires
python-dev libsasl2-dev gcc
libraries if not installed in the machine.
g
Yep I'll add some extra docs to the readme about the options map
It seems like thrift is a dependency of
PyHive[hive]
, which we use for hive connections - I will make the extra package install more clear as well