https://datahubproject.io logo
Join Slack
Powered by
I know this is open source , but why does it have ...
# ingestion
h
I know this is open source , but why does it have so many bugs and no stable version . Besides, the support team does not provide timely support. ???
b
I’m not affiliated with DataHub/Acryl, but before accusing anyone, please take a look at the problem and try to identify by yourself first. Looking at the log, it’s pretty clear that there is a problem with your ES setup:
Copy code
Caused by: org.elasticsearch.ElasticsearchStatusException: Elasticsearch exception [type=search_phase_execution_exception, reason=all shards failed]
Could be due to multiple reasons, so you need to check it. Some resources to start could be this Stackoverflow.
However, I do agree that support seems to be lacking. If you take a look at other community (such as OpenMetadata support channel), they are very responsive. I also think this will become an important factor to choose which solution as well, so can the team please short it out? Some problems can be: • Too many channels, don’t know which one to post question? • Untimely response, do we have an SLA?
h
bro iam using quickstart
so this error may be because datahub not update the quickstart components
b
Could be, not really sure. The problem can be due to corrupted indexes. If this is only prototype level, maybe trying nuking (it’s bad but 🤷 )
Copy code
datahub docker nuke
https://datahubproject.io/docs/troubleshooting/quickstart#ive-messed-up-my-docker-setup-how-do-i-start-from-scratch
h
so tomorrow i will nuke again lol
b
Also, I believe the team is in the US, so probably no response until then sadpanda
m
docker ps
see if your elastic is up and healthy? Is it the first run or subsequent run? The first requires mysql elastic and kafka setup. Sometime, the setup takes longer than it should be, gms will fail. After you run quickstart, you should check if gms is healthy or not by run docker ps. If not, kill the containers and run again. And just a suggestion be polite here as well, a lot of people here support for nothing. No one wants to support you if you keep yelling. They do just because they like the community and the product and that is the spirit of open source community.
h
i don't understand what is the difference between first run and subsequent runs.All my services are healthy
i want to say that if i don't make it a big deal people will never get the attention they deserve.My question from last week and still nobody answer. Beside that the datahub's docs too few and not detailed
f
Hey @hundreds-airline-29192, I have some notes for you. 1. Take your time to read how to use Slack channel. https://datahubproject.io/docs/slack/#make-use-of-threads 2. When you tend to post any issues, pls make sure that you provide enough information. This helps us a lot to investigate what went wrong. 3. To be proactive. Most of your issues can be solved by yourself. Check the error logs, search for the similar answer. 4. STOP BLAMING OTHERS. Don’t act like a kid. No one wants to help you in consequence of your bad attitude.
m
Btw, looking at the docker status, maybe don't run with head version. Try to run 
datahub docker quickstart --version v0.10.2.3
h
so if i want to run with specify yaml file ?
m
You mean compose file? Or recipe?
h
compose file
m
--quickstart-compose-file
h
yes . I upgrade to 0.10.2.3 version , and i run datahub docker quickstart --quickstart-compose-file , so what wrong ?
why it not run with head version as u say
m
You have datahub cli version 10.2.3, but when you run datahub docker quickstart without the version, it will pull the images at head. It might contain bugs. By running quickstart --version it will pull a specific version
h
okay okay lets me try
m
Nuke it first then quickstart
h
okay okay
lets me check
@modern-artist-55754 Error response from daemon: manifest for acryldata/datahub-mysql-setup:v0.10.2.3 not found: manifest unknown: manifest unknown
m
Maybe just v0.10.2
h
@@
Open in Slack
PreviousNext
Powered by