DataHub #getting-started

Join Slack

big-carpet-38439

04/01/2021, 3:03 PM

Welcome 🙂

loud-island-88694

04/05/2021, 10:49 PM

Welcome @strong-family-12999

curved-crayon-1929

04/09/2021, 8:01 AM

Hi @busy-accountant-26554 U should be able to search columns with the latest Datahub version.

curved-crayon-1929

04/09/2021, 8:01 AM

image.png

busy-accountant-26554

04/09/2021, 8:36 AM

Awesome, thanks Nagendra!

gray-shoe-75895

04/12/2021, 6:38 PM

FYI - bintray is undergoing scheduled maintenance (https://status.bintray.com/), and so builds might be failing until 2pm PT today

🙌 1

mammoth-bear-12532

04/13/2021, 10:22 PM

<!here> Super excited that DataHub is featured on the ThoughtWorks tech radar as a top platform to Assess! Thanks to this awesome community for getting us here! 🚀💪 Please share broadly with your network! https://www.linkedin.com/posts/shirshankadas_datahub-technology-radar-thoughtworks-activity-6787857268022112256-Pl9Y

🙌 13

mammoth-bear-12532

04/16/2021, 10:41 PM

w00t! we hit 500! Welcome @chilly-holiday-80781 🙂

🙌 2

🎉 3

💯 7

little-megabyte-1074

04/19/2021, 4:13 PM

<!channel> On April 27-29, I’ll be facilitating a Design Sprint with @mammoth-bear-12532 and his team at Acryl Data, focused on building a rapid prototype to provide DataHub operators/admins insight into user activity within DataHub. Over the span of 3-4 days, we will be dedicating 100% of our focus to mapping out the problem at hand, designing a solution, building out a prototype, and sharing it with the DataHub community. While we have our own hypotheses of what type of user analytics would be meaningful, we are looking for 3-4 community members that have experience rolling out and/or owning DataHub to participate in 30min interviews on Tuesday, April 27th. We will ask you questions about your experience introducing the tool, growing your user base, and identifying where to focus your efforts to surface new capabilities to keep your users engaged. If you are interested in participating, please reach out to me and/or @mammoth-bear-12532 so we can get your session scheduled!

🎉 3

🚀 1

👍 10

mammoth-bear-12532

04/20/2021, 4:47 PM

<!here> 📣 Friday DataHub Town-hall Agenda finalized • When: Apr 23rd at 9am US PT 🕘 • Signup to get a calendar invite: here • Townhall Zoom: https://zoom.datahubproject.io • Agenda • Welcome - 5 mins • Project Updates by Shirshanka - 10 mins ◦ 0.7.1 Release and callouts (

dbt

by @acoustic-printer-83045) ◦ Product Analytics design sprint announcement (@little-megabyte-1074) • Use-Case: DataHub at DefinedCrowd by @incalculable-ocean-74010 - 15 mins • Deep Dive + Demo: Lineage! Airflow, Superset integration by @gray-shoe-75895 and @green-football-43791 - 10 mins • Use-Case: DataHub Hackathon at Depop by @dry-gigabyte-2025 - 10 mins • Observability Feedback share out - 5 mins • General Q&A and closing remarks - 5 mins

big-carpet-38439

04/20/2021, 9:17 PM

Welcome @silly-dusk-92062! 🎉

fancy-fireman-15263

04/23/2021, 5:03 PM

Wow! That new functionality is 🔥

🎉 3

mammoth-bear-12532

04/24/2021, 7:35 PM

Town-hall videos are up! • Full:

https://www.youtube.com/watch?v=dlFa4ubJ9ho▾

• DefinedCrowd:

https://www.youtube.com/watch?v=qz5Rpmw8I5E▾

• Lineage demo:

https://www.youtube.com/watch?v=3wiaqhb8UR0▾

• Depop:

https://www.youtube.com/watch?v=SmOMyFc-9J0▾

🙌 1

acoustic-printer-83045

04/26/2021, 4:17 AM

Copy code

➜  datahub git:(enhance-dbt-ingestion) ✗ ./docker/ingestion/ingestion.sh                                   
Pulling ingestion ... done
WARNING: Found orphan containers (zookeeper, schema-registry, datahub-gms, broker, kafka-setup, neo4j, kibana, schema-registry-ui, elasticsearch, elasticsearch-setup, datahub-mce-consumer, kafka-rest-proxy, datahub-mae-consumer, mysql, datahub-frontend-react, kafka-topics-ui) for this project. If you removed or renamed this service in your compose file, you can run this command with the --remove-orphans flag to clean it up.
Creating ingestion ... done
Attaching to ingestion
ingestion    | [2021-04-26 04:15:24,111] INFO     {datahub.entrypoints:68} - Using config: {'source': {'type': 'file', 'config': {'filename': '/bootstrap_mce.json'}}, 'sink': {'type': 'datahub-rest', 'config': {'server': '<http://datahub-gms:8080>'}}}
ingestion    | [2021-04-26 04:15:24,158] INFO     {datahub.ingestion.run.pipeline:44} - sink wrote workunit file:///bootstrap_mce.json:0
ingestion    | [2021-04-26 04:15:24,178] INFO     {datahub.ingestion.run.pipeline:44} - sink wrote workunit file:///bootstrap_mce.json:1
ingestion    | [2021-04-26 04:15:24,268] INFO     {datahub.ingestion.run.pipeline:44} - sink wrote workunit file:///bootstrap_mce.json:2
ingestion    | [2021-04-26 04:15:24,329] INFO     {datahub.ingestion.run.pipeline:44} - sink wrote workunit file:///bootstrap_mce.json:3
ingestion    | [2021-04-26 04:15:24,389] INFO     {datahub.ingestion.run.pipeline:44} - sink wrote workunit file:///bootstrap_mce.json:4
ingestion    | [2021-04-26 04:15:24,433] INFO     {datahub.ingestion.run.pipeline:44} - sink wrote workunit file:///bootstrap_mce.json:5
ingestion    | [2021-04-26 04:15:24,475] INFO     {datahub.ingestion.run.pipeline:44} - sink wrote workunit file:///bootstrap_mce.json:6
ingestion    | [2021-04-26 04:15:24,516] INFO     {datahub.ingestion.run.pipeline:44} - sink wrote workunit file:///bootstrap_mce.json:7
ingestion    | [2021-04-26 04:15:24,547] INFO     {datahub.ingestion.run.pipeline:44} - sink wrote workunit file:///bootstrap_mce.json:8
ingestion    | [2021-04-26 04:15:24,587] INFO     {datahub.ingestion.run.pipeline:44} - sink wrote workunit file:///bootstrap_mce.json:9
ingestion    | [2021-04-26 04:15:24,619] INFO     {datahub.ingestion.run.pipeline:44} - sink wrote workunit file:///bootstrap_mce.json:10
ingestion    | [2021-04-26 04:15:24,657] INFO     {datahub.ingestion.run.pipeline:44} - sink wrote workunit file:///bootstrap_mce.json:11
ingestion    | [2021-04-26 04:15:24,692] INFO     {datahub.ingestion.run.pipeline:44} - sink wrote workunit file:///bootstrap_mce.json:12
ingestion    | [2021-04-26 04:15:24,710] INFO     {datahub.ingestion.run.pipeline:44} - sink wrote workunit file:///bootstrap_mce.json:13
ingestion    | [2021-04-26 04:15:24,737] INFO     {datahub.ingestion.run.pipeline:44} - sink wrote workunit file:///bootstrap_mce.json:14
ingestion    | [2021-04-26 04:15:24,851] INFO     {datahub.ingestion.run.pipeline:44} - sink wrote workunit file:///bootstrap_mce.json:15
ingestion    | [2021-04-26 04:15:24,878] INFO     {datahub.ingestion.run.pipeline:44} - sink wrote workunit file:///bootstrap_mce.json:16
ingestion    | [2021-04-26 04:15:24,899] INFO     {datahub.ingestion.run.pipeline:44} - sink wrote workunit file:///bootstrap_mce.json:17
ingestion    | 
ingestion    | Source report:
ingestion    | {'failures': {},
ingestion    |  'warnings': {},
ingestion    |  'workunit_ids': ['file:///bootstrap_mce.json:0',
ingestion    |                   'file:///bootstrap_mce.json:1',
ingestion    |                   'file:///bootstrap_mce.json:2',
ingestion    |                   'file:///bootstrap_mce.json:3',
ingestion    |                   'file:///bootstrap_mce.json:4',
ingestion    |                   'file:///bootstrap_mce.json:5',
ingestion    |                   'file:///bootstrap_mce.json:6',
ingestion    |                   'file:///bootstrap_mce.json:7',
ingestion    |                   'file:///bootstrap_mce.json:8',
ingestion    |                   'file:///bootstrap_mce.json:9',
ingestion    |                   'file:///bootstrap_mce.json:10',
ingestion    |                   'file:///bootstrap_mce.json:11',
ingestion    |                   'file:///bootstrap_mce.json:12',
ingestion    |                   'file:///bootstrap_mce.json:13',
ingestion    |                   'file:///bootstrap_mce.json:14',
ingestion    |                   'file:///bootstrap_mce.json:15',
ingestion    |                   'file:///bootstrap_mce.json:16',
ingestion    |                   'file:///bootstrap_mce.json:17'],
ingestion    |  'workunits_produced': 18}
ingestion    | Sink report:
ingestion    | {'failures': [], 'records_written': 18, 'warnings': []}
ingestion    | 
ingestion    | Pipeline finished successfully
ingestion exited with code 0
➜  datahub git:(enhance-dbt-ingestion) ✗

mammoth-bear-12532

04/26/2021, 3:29 PM

<!here> The town-hall recordings are now available 🙂

early-lamp-41924

04/26/2021, 3:54 PM

Welcome @stale-jewelry-2440 @salmon-translator-27951!! 🎉

👋 2

early-lamp-41924

05/05/2021, 11:45 PM

<!here> Hi everyone!! To better support you in your DataHub journey, we would like to better understand where you are in the deployment process. Please take a minute or two to answer some questions here https://forms.gle/FA6UHE4xeezpZKna8 !!

mammoth-bear-12532

05/07/2021, 7:19 PM

<!here> Would be great to get feedback here. Helps us support you better.

mammoth-bear-12532

05/09/2021, 12:51 AM

Welcome @freezing-garage-64129 @billions-manchester-61599 👋

👋 1

green-football-43791

05/10/2021, 2:45 PM

Welcome @ripe-school-61733!

mammoth-bear-12532

05/10/2021, 8:14 PM

<!here> A bit delayed, but the April newsletter is here! Please share among your network! https://medium.com/datahub-project/linkedin-datahub-project-updates-2b0d26066b8f?source=friends_link&sk=686c47219ed294e0838ae3e2fe29084d

🎉 3

some-cricket-23089

05/11/2021, 5:39 AM

Hi All , I started to explore datahub on running docker containers from master branch. During the exploration i have some below question.

little-megabyte-1074

05/12/2021, 10:40 PM

https://datahubspace.slack.com/archives/CV2KB471C/p1618612869135200

little-megabyte-1074

05/12/2021, 10:41 PM

we surpassed 500 members 3.5wks ago - now at 600+! 🎉 🎉

👍 1

🚀 13

little-megabyte-1074

05/12/2021, 10:42 PM

📈

mammoth-bear-12532

05/18/2021, 8:10 PM

set the channel topic: For general discussion & questions about DataHub. For Metadata Day event, join #metadata-day-spring-21

mammoth-bear-12532

05/18/2021, 8:11 PM

Metadata Day Event Channel is #metadata-day-spring-21

mammoth-bear-12532

05/25/2021, 12:36 AM

<!here> 📣 May 27th Thursday Townhall is upon us! • When: May 27th at 9am US PT 🕘 (Note: Thursday this time due to long holiday weekend in US!) • Signup to get a calendar invite: here • Townhall Zoom: https://zoom.datahubproject.io Agenda • Welcome - 5 mins • Project Updates by Shirshanka - 10 mins ◦ 0.8.0 Release ◦ AWS Recipe by @early-lamp-41924 • Demo: Product Analytics design sprint (@little-megabyte-1074, @early-lamp-41924) - 10 mins • Use-Case: DataHub on GCP by @breezy-glass-7892 (Confluent) - 10 mins • Deep Dive: No Code Metadata Engine by @big-carpet-38439 - 20 mins • General Q&A and closing remarks - 5 mins

🎉 2

🙌 1

mammoth-bear-12532

05/27/2021, 3:34 PM

<!here> Reminder: happening in 30 mins!

👀 1

mammoth-bear-12532

05/27/2021, 3:58 PM

https://zoom.datahubproject.io