Hello, everyone! I'm getting a message "An unknown...
# troubleshoot
h
Hello, everyone! I'm getting a message "An unknown error occured. (code 500)" when I'm browsing through charts:
/browse/chart/tableau
. I've got 2 charts there and I can find them via search, but not through browsing. Where to look for this error description? I've tried searching docker logs but no luck yet
g
Hey @handsome-belgium-11927! How are you ingesting the tableau data?
My guess would be that this is related to how its browsepath was ingested.
h
I've tested this one via curl:
Copy code
curl '<http://localhost:8080/entities?action=ingest>' -X POST --data '{
    "entity":{
       "value":{
          "com.linkedin.metadata.snapshot.ChartSnapshot":{
             "urn":"urn:li:chart:(tableau,baz1)",
             "aspects":[
                {
                   "com.linkedin.chart.ChartInfo":{
                      "title":"Baz Chart 1",
                      "description":"Baz Chart 1",
                      "lastModified":{
                         "created":{
                            "time":0,
                            "actor":"urn:li:corpuser:jdoe"
                         },
                         "lastModified":{
                            "time":0,
                            "actor":"urn:li:corpuser:datahub"
                         }
                      }
                   }
                }
             ]
          }
       }
    }
 }'
And after that ingested my own data:
Copy code
{'entity': {'value': {'com.linkedin.metadata.snapshot.ChartSnapshot': {'urn': 'urn:li:chart:(tableau,test_chart)', 'aspects': [{'com.linkedin.chart.ChartInfo': {'title': 'Test Chart Name', 'description': 'A', 'inputs': [{'string': 'urn:li:dataset:(urn:li:dataPlatform:exasol,main.test3,PROD)'}], 'lastModified': {'created': {'time': 0, 'actor': 'urn:li:corpuser:datahub'}, 'lastModified': {'time': 0, 'actor': 'urn:li:corpuser:datahub'}}}}]}}}}
So I have two this charts ingested atm
I wonder if it matters that I've also got tableau datasets, not only charts
g
that shouldn't affect things...
did you create a tableau ingestion source?
or are you just ingesting via constructing your own Snapshots?
h
Yes, I'm ingesting everything myself, constructing Snapshots via python ingestion framework, and it worked like a charm. Didn't have any problems until tried charts - I have to use curl to create lineage for charts (this part is still missing in python, or I could not find it πŸ˜… )
g
Could you try ingesting your BrowsePaths aspect?
like this for example?
h
Hmm, I was using https://datahubproject.io/docs/metadata-service/#create-a-chart , there is no 'Prod' for charts example, may be this is the problem? I'll try your suggestion tomorrow
Nvm, if I try to ingest with urn
urn:li:chart:(tableau,test_chart,PROD)
I get the 500 error. I'll continue investigating tomorrow
g
ah! I think i found it
this should fix it
as a short term fix: try adding
inputs: []
to your MCE
h
Yes, it works, thank you very much! πŸ™
g
nice!
btw, are you planning on creating a proper tableau source?
are you planning on just hand-crafting MCEs forever?
I ask because I think the community would greatly benefit from a tableau source
h
Our users want a lot of customization, so I'm ingesting everything by myself, without sources (also using ClickHouse and Exasol, not so popular DBMS's, so I had no choice). And Tableau is a real pain to be honest, downloading xml's and parsing them to get the required data, and it is far from accurate, very project specific, I'm not sure I can get it to anything good enough for community to share. And btw I can only code on python, I think that's the main problem πŸ˜…
g
that's perfect! all our ingestion sources are written in python πŸ˜„
understand you're ingesting everything by hand for now- if you ever come up with something you want to share we can tag it as "Incubating" until we work the kinks out
I also heard there may be a Datahub MVP program coming out soon to give swag to contributors 😏
h
Hmm. I've used python ingestion framework, but I thought it is based on some java code. Or may be my python is too bad yet, so I could not find the required code. Where is the python code for example for mysql source? πŸ€”
g
i gotcha!
as chart ingestion examples
h
Okay, thanks for the links, I'll try to understand the code
l
Hi @handsome-belgium-11927! Just a heads up that I just created #clickhouse-datahub-integration - we have some community members that are looking to build out & contribute a connector. It may not be relevant to you at this point, but just wanted to follow up! You’re welcome to join the channel & contribute however you’d like πŸ™‚
πŸ™Œ 1