https://datahubproject.io logo
Join Slack
Powered by
# getting-started
  • r

    ripe-alarm-85320

    06/03/2022, 9:56 PM
    Racking my brain team, Anyone have ANY idea why this Transformer wont update MongoDB entities I have in datahub.
    Copy code
    transformers:
      - type: "simple_add_dataset_tags"
        config:
          tag_urns:
            - "urn:li:tag:mongo:cicd"
    m
    • 2
    • 7
  • b

    better-orange-49102

    06/06/2022, 12:53 AM
    Is there a recommended place to keep all the persistent actions running? If I were to use k8s and not docker-compose. Definitely not planning to keep it running on my computers' terminal 🙂
    b
    • 2
    • 1
  • f

    flat-shoe-26745

    06/06/2022, 5:53 AM
    Hi, everyone😃 I want to know the difference between platform and platform instance in elasticsearch. I find this comment “The instance of the platform that all assets produced by this recipe belong to”.
    b
    b
    • 3
    • 4
  • p

    powerful-account-82153

    06/06/2022, 6:36 AM
    Hi everyone, i deploy datahub according to the website instructions, but i encounter a problem like this (after run command :datahub docker quickstart): ERROR: Encountered errors while bringing up the project. ............ Unable to run quickstart - the following issues were detected: - schema-registry container is not present - datahub-gms container is not present - broker container is not present - kafka-setup container is not present - datahub-frontend-react container is not present - mysql is not running - zookeeper is not running --------------------------------------------------------- error log attached,please read the log. any advice and reply will be appreciated. 🙂
    tmpt89mblzy.log
    b
    • 2
    • 3
  • s

    salmon-rose-54694

    06/06/2022, 7:28 AM
    hi expert, How can i understand Contains and Inherits in glossary term?
    b
    d
    • 3
    • 2
  • a

    adorable-addition-82413

    06/06/2022, 2:22 PM
    Hello everyone, do we have any guide to deploy datahub in a production environment? Any production-ready guidelines and best practices?
    b
    • 2
    • 4
  • h

    helpful-librarian-40144

    06/07/2022, 2:52 AM
    hi everyone, how to enable https in datahub-frontend-react, currently we are using http protocol
    b
    • 2
    • 1
  • n

    nutritious-jackal-99119

    06/07/2022, 7:28 AM
    Hello - Can we use postgres instead of mysql for Datahub storage ? My company is asking us to use postgres .
    b
    b
    • 3
    • 3
  • f

    flat-shoe-26745

    06/07/2022, 7:32 AM
    hi, everyone, I would like the method
    test_connection
    accept optional parameter
    timeout
    😃
    b
    m
    • 3
    • 4
  • f

    flat-shoe-26745

    06/07/2022, 8:37 AM
    Hi everyone.The dataset with platform ‘file’ some has directory hierarchy, but some not .What’s the difference here
    b
    b
    g
    • 4
    • 9
  • n

    nutritious-jackal-99119

    06/07/2022, 9:29 AM
    Hello All, Is installing kafka registry mandatory ? If so, could you please point me out to corresponding helm chart ?
    b
    • 2
    • 6
  • h

    helpful-librarian-40144

    06/08/2022, 2:14 AM
    hi everyone ,how to config authorization to metadata restful api and graphiql API ,make sure that different user can access different API
    b
    • 2
    • 8
  • s

    salmon-rose-54694

    06/08/2022, 6:19 AM
    hi, Can I get to know the progress of Design & Discovery: Collaboration & Social Features?
    b
    r
    l
    • 4
    • 3
  • s

    square-hair-99480

    06/08/2022, 7:03 AM
    Hello friends, just starting with DatHub! I have a quick question and sorry if it is a naive one. Can I document a GraphQL schema in DataHub? I know we have many tools for that but I was curious if I could do it using DataHub too. I could not find anything in the metadata ingestion documentation.
    b
    • 2
    • 2
  • p

    powerful-iron-62101

    06/08/2022, 9:47 AM
    Hello everyone jinay here, I am facing trouble in enabling the lineage feature so how can I do that?
    d
    b
    • 3
    • 12
  • h

    hallowed-match-92222

    06/08/2022, 11:56 AM
    Hi Everyone, I am new to DataHub.. was wondering if anyone had backed DataHub with managed AWS services such as (Opensearch for Elasticsearch, Aurora MySQL, Neptune)?
    b
    • 2
    • 2
  • g

    gentle-camera-33498

    06/08/2022, 1:25 PM
    Hello everyone, I'm testing DataHub in a VM with 4vCPU and 16 Gb RAM. I want to share that I was having some performance issues (a lot of 500 status code errors), and I resolved them by setting the 'cpu_shares' to 2048 for elasticsearch and gms services on the docker-compose. I hope that it helps someone that is facing the same problems. References: https://docs.docker.com/config/containers/resource_constraints/#configure-the-default-cfs-scheduler
    b
    • 2
    • 1
  • m

    mammoth-bear-12532

    06/08/2022, 4:53 PM
    If you're just getting started with DataHub, this message is a must-read 🙂
    ❤️ 2
    thank you 2
  • s

    shy-ability-95880

    06/09/2022, 8:47 AM
    Hi, I'm just getting started with Datahub. I was trying to ingest some data from MySQL database and on the ingestion page is says succeeded. However, there were no option for lineage and other features. Is this because of an issue with the ingestion process that the data itself were not ingested? Sorry not too familiar with this yet.
    d
    b
    • 3
    • 3
  • p

    powerful-iron-62101

    06/09/2022, 10:00 AM
    Hello everyone, I wanted to ingest aws elasticsearch to datahub but i am not able to find it, so where can i get that
    d
    • 2
    • 2
  • s

    salmon-football-11785

    06/09/2022, 11:08 AM
    Hello there, i follow the instructions to Deploying to AWS, after login i getting a white screen and a lot Java errors on frontEnd pod
    b
    • 2
    • 2
  • p

    powerful-iron-62101

    06/09/2022, 12:06 PM
    Hello All, Have anyone tried to Authenticate user using AWS Cognito service?
    b
    • 2
    • 1
  • b

    bland-orange-13353

    06/09/2022, 1:13 PM
    This message was deleted.
  • g

    glamorous-easter-15952

    06/09/2022, 1:32 PM
    Hi everyone! what is the username and password for the demo datahubproject? Used datahub:datahub but doesn't seem to work
    b
    n
    b
    • 4
    • 10
  • f

    few-grass-66826

    06/09/2022, 5:51 PM
    Hello guys, can you pls point out some docs where I can find for what kind of actions datahub uses services like RDS, Elastic search and Kafka ?
    b
    • 2
    • 3
  • s

    salmon-rose-54694

    06/10/2022, 6:36 AM
    hi, is there a plan that create new glossary term on UI?
    b
    b
    • 3
    • 6
  • s

    steep-pizza-13640

    06/10/2022, 6:59 AM
    Hi Everyone, we are investigating, if datahub may run on RedHatOpenShift, because this is our company standard. Does anyone use Datahub on Openshift? Is there any experience? Kind Regards, Susann
    b
    • 2
    • 1
  • h

    high-ice-84066

    06/10/2022, 7:55 PM
    Hi Everyone! Is it possible to do in-application banner/login announcements?
    b
    l
    • 3
    • 2
  • m

    many-hairdresser-62442

    06/12/2022, 5:25 AM
    Hey guys, I have a question. Does it make sense to find a way to integrate dremio with datahub. Use case: there are datasets created at source and logged in datahub for reference, and additional data artefacts created in dremio which we'd also like to capture in datahub.
    l
    • 2
    • 2
  • c

    clean-needle-85470

    06/13/2022, 12:43 PM
    Hi, I'm starting with DataHub and need an advice. I have couple Iceberg tables that I'm creating Iceberg tables on S3 via DBT and Spark. I'm also accessing these tables via Trino engine. I have these tables in a database/catalog called 'warehouse' and two schemas: 'bronze' and 'silver'. I setup DataHub ingestions from Trino and DBT. The result is two separate sets of tables in DataHub. I'd like to somewhat merge the information from DBT (lineage) and Trino (schema). Is it possible? Or would you recommend me to only ingest the DBT?
    m
    • 2
    • 2
1...303132...80Latest