Hey everyone, I'm struggling a bit with using the...
# ingestion
a
Hey everyone, I'm struggling a bit with using the Oracle Ingestions together with the datahub quickstart setup. Do I need to install the cx_oracle package and Oracle Client on the host machine or into one of the docker containers? Tried to install and setup oracle-instantclient-basic-21.5.0.0.0-1.x86_64.rpm following the documentation on the host but getting:
Copy code
Cannot locate a 64-bit Oracle Client library: "libclntsh.so: cannot open shared '
           'object file: No such file or directory"
Thanks for your help
o
Hi! Have you installed the oracle ingestion plugin for the DataHub CLI? This thread may also be helpful: https://datahubspace.slack.com/archives/CUMUWQU66/p1646126546591469
a
Hey Ryan, thanks for your answer! Yes I have installed the plugin and already read the former thread but the steps inside didn't work for me. Is it correct to do all these steps on the host machine or in one of the docker containers started by datahub quickstart?
o
It should be on whichever machine you are running the ingestion script on as that is the one connecting to the Oracle instance directly
a
Hey Ryan, I got it working with using the CLI ingestion, I was using the UI ingestions before. But after some back and forth I got it working with the UI, too. To leave the path of success for any other struggling with the same issue: • After understandig that the error is linked to the UI Ingestion I saw that the datahub-actions container is responsible for doing the UI Ingestion • To run following commands as root user inside the container you need to login via:
Copy code
docker exec -u 0 -it datahub-datahub-actions-1 bin/bash
• Afterwards I installed the cx_Oracle package and the oracle client:
Copy code
python3 -m pip install cx_oracle
apt-get install libaio1
mkdir /opt/oracle
cd /opt/oracle
wget <https://download.oracle.com/otn_software/linux/instantclient/215000/instantclient-basic-linux.x64-21.5.0.0.0dbru.zip>
unzip instantclient-basic-linux.x64-21.5.0.0.0dbru.zip
sh -c "echo /opt/oracle/instantclient_21_5 > /etc/ld.so.conf.d/oracle-instantclient.conf"
ldconfig
-> UI Ingestion with Oracle worked Side note: Doing this manually will remove the client everytime you restart the datahub quickstart
šŸ™Œ 1
šŸ‘ 1
o
Nice! Glad you got it working. Yeah this is something we should add to that docker build: https://github.com/datahub-project/datahub/issues/4486