https://datahubproject.io logo
Join Slack
Powered by
Hi guys, any plans to ingest views with the Oracle...
# ingestion
f
Hi guys, any plans to ingest views with the Oracle connector. At this stage it's only picking up tables.
b
No active plans. But we can add this to a backlog of requests cc. @gray-shoe-75895
l
@faint-hair-91313 is this a blocker for you or can you wait till we get to it after we process other items on the backlog?
f
Not a blocker, but would really be appreciated by our users. Materialized views, too.
l
sounds good. will keep you posted
c
Hey @faint-hair-91313! I’m checking this out right now and had a couple of questions about your installation to help us figure out what’s up: 1. What version of DataHub CLI are you running? 2. Have you set 
include_views:True
in your ingestion config? (it’s off by default)
f
I am using v0.8.1. Aaa didn't know about that ... I will try it
👍 1
Right, so tried it out, but seems to be out of place.
Copy code
$ datahub --debug ingest -c ingest_dwh_metadata.yml
[2021-06-21 08:48:41,261] INFO     {datahub.entrypoints:68} - Using config: {'source': {'type': 'oracle', 'config': {'username': 'oditmp', 'password': '', 'host_port': '<http://alpha6.muac.corp.eurocontrol.int|alpha6.muac.corp.eurocontrol.int>', 'schema_pattern': {'allow': ['^(exn|edw|sbx|inf).*']}, 'include_views': True}}, 'sink': {'type': 'datahub-rest', 'config': {'server': '<http://localhost:8080>'}}}
1 validation error for OracleConfig
include_views
  extra fields not permitted (type=value_error.extra)
Tried with v0.8.3. Same error.
c
Looking into this right now! In the meantime, could you try running without the field? 
include_views
is 
True
by default in the latest release.
@gray-shoe-75895 any clue why the validation is complaining here?
g
@faint-hair-91313 what does 
datahub version
report?
f
Ok, I am getting used to this. It was 0.8.1, upgraded to 0.8.3 and got it working! 👍
🎉 1
b
W00T
Open in Slack
PreviousNext
Powered by