https://datahubproject.io logo
Join Slack
Powered by
# getting-started
  • c

    chilly-helmet-3109

    12/01/2022, 9:48 AM
    Hi all. I can deploy Datahub on a local k8s cluster with the default helm chart successfully, but there is only one pod of each component. I change replicaCount in GMS's values.yaml from 1 to 2, and now I get two GMS pods. However, it seems the ingestion traffic can't be distributed to the two pods. So I have two questions here: 1. Is there any additional configurations to enable multiple pods for Datahub components? 2. If I want to take advantage of k8s deployment, which component's pod I need to increase. Thanks!
    plus1 2
    a
    b
    • 3
    • 2
  • s

    swift-eye-81077

    12/01/2022, 12:33 PM
    Hello guys! I have a question regarding changing the password of the default datahub user: I've followed the steps present on:
    <https://datahubproject.io/docs/authentication/guides/add-users#helm>
    but I was only able to add another user, even after adding a datahub:password line at the user.props file the datahub user is still accessed by the default password. I'm running a local deployment of datahub on minikube. I saw that this part
    <https://datahubproject.io/docs/authentication/guides/add-users#changing-the-default-datahub-user>
    mentions that the default file is not overwritten, but it only mentions the docker deployment. So I'm a little lost on how I can change that on a Kubernetes deployment. Thanks!!
    b
    b
    +2
    • 5
    • 14
  • s

    salmon-state-96093

    12/02/2022, 8:05 PM
    Hi
    plus1 1
  • r

    rough-activity-61346

    12/05/2022, 1:04 AM
    I have deployed to GKE with helm install. Is there any way to output this log to Google Cloud Logging? datahub-gms: /tmp/datahub/logs/gms datahub-frontend: /tmp/datahub/logs/datahub-frontend
    teamwork 1
    i
    • 2
    • 2
  • h

    hallowed-fish-35859

    12/05/2022, 8:43 AM
    Hello! I am looking for some help in development from source. (Running with quickstart locally and ingest-sample-data were successful)
    Copy code
    1. I want to use a local db instead of a docker image db, what should I do?
    2. I want to customize it, is there any way? (<http://localhost:8080> - 404 / <http://localhost:3000> - empty page)
    Thanks!!
    a
    g
    • 3
    • 3
  • b

    bitter-apple-38248

    12/05/2022, 11:04 PM
    Hello, trying run the quickstart guide locally, but running into an issue where the provided credentials
    user: datahub / pass: datahub
    are not accepted (error logging in). I did see a warning at the end of docker quickstart stating
    Copy code
    Unable to run quickstart - the following issues were detected:
    - datahub-gms is running but not healthy
    Error logs in 🧵. I’m not sure if the issue is related to the failed login though.
    i
    • 2
    • 4
  • m

    microscopic-tailor-94417

    12/06/2022, 6:13 AM
    Hello everyone, is that possible to ingest DBSchema metadata into Datahub?
    a
    g
    • 3
    • 9
  • a

    acceptable-baker-8114

    12/06/2022, 11:33 AM
    Hello - is Datahub compatible with AWS OpenSearch service running OpenSearch 1.3 or should we be using AWS OpenSearch service running Elasticsearch 7.10?
    h
    • 2
    • 3
  • l

    lively-dawn-28392

    12/06/2022, 7:41 PM
    Hi everyone, quick question. On the DataHub demo, Analytics (top right) section, I see some charts. Are they powered by DH directly, or could they be iframed from existing dashboards like Superset? I’m aware of support for Superset connectors but can you directly iFrame charts and dashboards from external sources like Superset?
    b
    • 2
    • 6
  • m

    microscopic-machine-90437

    12/07/2022, 5:15 AM
    Hello Everyone, I'm trying to connect to Tablaeu Server, but getting SSL Certificate issue. Can someone help me with this?
    h
    g
    b
    • 4
    • 8
  • b

    bitter-waitress-17567

    12/07/2022, 5:40 PM
    Hi everyone. We are exploring Data hub as our metadata service. We have our datalake hosted on GCS bucket. I was through the data hub doc but could not find option to add GCS bucket as source. Has anyone implemented GCS bucket as source in Data hub
    b
    • 2
    • 4
  • b

    bitter-translator-92563

    12/08/2022, 8:04 AM
    Hi guys. Could anyone please give me a hint on how can I get the massive export of Glossary Terms or/and Entities related to physical model (Databases, Schemas, tables etc.) via API? Couple of examples that I'm trying to clarify 1. Is there a way to get (via API) all tables related to schema for a specific database OR all schemas related to specific database? 2. Is there an API method that can give me all the glossary terms that meet certain requirements?
    b
    • 2
    • 4
  • s

    swift-eye-81077

    12/08/2022, 11:39 AM
    Hello everyone, just a quick question. I've deleted this domain a couple days ago, back then it had a name, but after deleting it still remains on the initial page for DataHub, is there a way to remove it from there?
    ✅ 1
    b
    • 2
    • 5
  • r

    rapid-evening-51993

    12/08/2022, 8:29 PM
    Hello everyone, pleased to be here, I am creating a business glossary for my client's metadata in Ymal file format, which I intend to ingest later in the DataHub. I have been reading through DataHub documentations but did't find much w.r.t the YMAL file. Any suggestions or tips to get a head-start would be appreciated. Thank you.
    👀 1
    ✅ 1
    a
    b
    • 3
    • 13
  • b

    bitter-motherboard-67717

    12/09/2022, 2:57 AM
    Hello, does Datahub support non-expiring personal access token?
    b
    b
    • 3
    • 2
  • h

    hallowed-kilobyte-916

    12/09/2022, 12:08 PM
    Hi guys, I am running docker using the docker quickstart command. I get the following logs
    Copy code
    09:35:53.249 [main] ERROR c.l.g.f.entity.EbeanServerFactory:38 - Failed to connect to the server. Is it up? 
    ERROR ContextLoader Context initialization failed
    ✅ 1
    i
    • 2
    • 1
  • h

    hallowed-kilobyte-916

    12/09/2022, 12:09 PM
    This makes the datahub-gms container unhealthy and because of that, I cannot log in to the frontend
  • j

    jolly-morning-54582

    12/13/2022, 6:13 AM
    Hi everyone! May be someone can consult on the following: I want to add relations between glossary term 'client' and 'address' like 'city of residence'. How to do it in DataHub? 🤔
    plus1 1
    ✅ 1
    g
    s
    • 3
    • 3
  • f

    famous-kite-14798

    12/13/2022, 6:53 AM
    Hi, is it possible to show column level lineage or showing constraints in dbt source? We are using dbt on Google BigQuery, if yes how can we do?
    plus1 1
    ✅ 1
    d
    s
    • 3
    • 7
  • f

    full-kite-21373

    12/14/2022, 10:16 AM
    @incalculable-ocean-74010 We are trying to deploy datahub using https://github.com/acryldata/datahub-helm with master branch but in the pods we find v0.9.1 image is getting pulled instead of v0.9.3 (as mentioned in values.yml of Datahub helm chart).. Please, let us know for any alternative solution to it..?
    g
    i
    • 3
    • 22
  • l

    loud-caravan-23145

    12/14/2022, 3:16 PM
    Hi all! I'm ingesting metadata with
    dbt
    source, using
    Athena
    as platform. I'd like to profile the tables but if I use the Athena source, I get the same table repeated under different namespaces. Any thoughts? Thanks :)
    👀 1
    a
    m
    l
    • 4
    • 10
  • b

    bored-park-9687

    12/14/2022, 8:26 PM
    Hi all! General question, what is the DataHub team/community’s perspective on aligning with more focused standards in lineage space (OpenLineage in specific) within the larger constructs datahub suggests for cataloging/governance at large?
    m
    • 2
    • 3
  • m

    mysterious-lamp-91034

    12/15/2022, 12:06 AM
    .
    • 1
    • 2
  • h

    helpful-librarian-40144

    12/15/2022, 12:37 AM
    how to migrate data from elasticsearch to outside our own opensearch(not aws service)? is there any incompatible, I want to know is there some init script to init es that help me to init on opensearch?
    b
    • 2
    • 1
  • l

    limited-photographer-37166

    12/15/2022, 5:09 AM
    Hello, I found some previous questions around this topics, but no good answers. I ingested data from AWS glue, and ended up with ton of pipelines and tables, but no connection between them and no lineage. They are custom scripts, is that still a blocker (
    job must be created in Glue Studio with the "Generate classic script"
    ) ? Thanks for any help, we are investigating data lineage tools and this seems like a deal breaker for Datahub
    ✅ 1
    👀 2
    a
    • 2
    • 3
  • g

    great-monkey-52307

    12/15/2022, 6:58 AM
    Hello Can anyone let me know if we can use mssql server database as storage layer for Datahub deployment in AKS ?? I see example configuration for My SQL database in AWS RDS in the document https://datahubproject.io/docs/deploy/aws
    b
    • 2
    • 3
  • g

    gifted-bird-57147

    12/15/2022, 3:17 PM
    Hi all, I'm struggling with the GraphQL syntax to search for tables with a certain name
    Copy code
    search(input: { type: DATASET, query: "Halte", orFilters:{ ???
    searching for the string in the query returns also results for tables that include columns with given string. So I presume I need to set an 'orFilters' clause to limit searching to table names. But I can't figure out the syntax with what's currently described in the documentation.... Anybody has an example of such a filter?
    plus1 1
    b
    • 2
    • 1
  • b

    bland-lighter-26751

    12/15/2022, 5:10 PM
    Hello, I am setting up Datahub with Helm at the moment and am wondering if it works with Elasticsearch 8? I found a doc for using 7 but haven't seen anything about 8.
    b
    • 2
    • 2
  • l

    lively-dusk-19162

    12/15/2022, 8:28 PM
    Hello all, I am trying make datahub up and running.While running datahub docker quickstart , I am getting the following error as shown in below image. Could anyone please help me on this?
    b
    • 2
    • 2
  • w

    wonderful-book-58712

    12/15/2022, 9:16 PM
    A Basic question: The changes which we do in Datahub are they published back to the sources or it stays in Datahub for example if we modify column description in dbt will it go back to dbt
    b
    t
    a
    • 4
    • 7
1...495051...80Latest