Hi, looks like the quickstart guide has just chang...
# getting-started
g
Hi, looks like the quickstart guide has just changed to use the datahub CLI as opposed to the quickstart.sh script? However, if I try to use the datahub CLI I get 'no such command docker'. datahub --version returns acryl-datahub 0.8.1.1 datahub --help shows 'check' 'ingest' and 'version' but indeed no 'docker' command....
👀 1
b
@gray-shoe-75895 did we push latest to pip?
Let us look into this - you’re right that it just changed. Feel free to refer to the old QuickStart guide wherein you 1) git clone the repo 2) execute ‘docker/quickstart.sh’
g
@gifted-bird-57147 I just published acryl-datahub v0.8.1.2, which should have those quickstart commands
b
@gifted-bird-57147 Let us know if this works!
g
@big-carpet-38439 @gray-shoe-75895 can confirm working now. did a pip install --upgrade acryl-datahub which pulled 0.8.1.2 with the docker command included. thanks!
🎉 1
on a side note. It looks like the quickstart via datahub/python command uses a lot less resources on my machine than the original quickstart.sh script. (which is great of course) and it seems to stem from the fact that a couple containers are not running that are started when you use the quickstart.sh. most notably the kibana, datahub-mce-consumer and datahub-mae-consumer containers. However the setup seems fully functional? I can use 'datahub docker ingest-smaple-data' to import data and I can search for the imported data. So I kind of get that mce-consumer is not needed when the sample ingestion is via gms. But I don't understand why mae consumer is not needed? Isn't that the component that 'syncs' data between gms, mysql and elasticsearch?
g
Yep as part of the
datahub docker *
commands PR, we reduced the memory requirements of a couple containers and removed some that weren’t fully necessary (e.g. kibana). On top of that, we recently merged this PR https://github.com/linkedin/datahub/pull/2690 which enables {mce,mae}-consumers to be run within GMS, which is what quickstart now does
g
thanks for the clarification! it's sometimes hard to keep up with the changes. But I appreciated all the work being done!
b
Big simplifications! They will continue :)