Hi I m on 0 8 45 amp encoutered this error when ingest dbt s

Question

Hi I m on 0 8 45 amp encoutered this error when ingest dbt source please give some help `datahub debug ingest c git dwh dev datahub yml` ` 2022 09 29 11 13 51 202 DEBUG datahub telemetry telemetry 210 Sending init Telemetry` ` 2022 09 29 11 13 52 261 DEBUG datahub telemetry telemetry 243 Sending Telemetry` ` 2022 09 29 11 13 52 726 INFO datahub cli ingest cli 182 DataHub CLI version 0 8 45` ` 2022 09 29 11 13 52 746 DEBUG datahub cli ingest cli 196 Using config source type dbt config manifest path git dwh dev target manifest json catalog path git dwh dev target catalog json test results path git dwh dev target run results json target platform postgres load schemas False meta mapping business owner match operation add owner config owner type user owner category BUSINESS OWNER data steward match operation add owner config owner type user owner category DATA STEWARD technical owner match operation add owner config owner type user owner category TECHNICAL OWNER has pii match True operation add tag config tag has pii data governance team owner match Finance operation add term config term Finance test source match operation add tag config tag $match query tag mapping tag match operation add tag config tag $match ` ` 2022 09 29 11 13 52 814 DEBUG datahub ingestion sink datahub rest 116 Setting env variables to override config` ` 2022 09 29 11 13 52 814 DEBUG datahub ingestion sink datahub rest 118 Setting gms config` ` 2022 09 29 11 13 52 814 DEBUG datahub ingestion run pipeline 174 Sink type datahub rest lt class datahub ingestion sink datahub rest DatahubRestSink gt configured` ` 2022 09 29 11 13 52 814 INFO datahub ingestion run pipeline 175 Sink configured successfully DataHubRestEmitter configured to talk to ` ` 2022 09 29 11 13 52 818 DEBUG datahub ingestion sink datahub rest 116 Setting env variables to override config` ` 2022 09 29 11 13 52 818 DEBUG datahub ingestion sink datahub rest 118 Setting gms config` ` 2022 09 29 11 13 52 818 DEBUG datahub ingestion reporting datahub ingestion run summary provider 120 Ingestion source urn = urn li dataHubIngestionSource cli 151c2b7711eb626e440af8c75a9082e9` ` 2022 09 29 11 13 52 819 DEBUG datahub emitter rest emitter 247 Attempting to emit to DataHub GMS using curl equivalent to ` `curl X POST H User Agent python requests 2 28 1 H Accept Encoding gzip deflate H Accept H Connection keep alive H X RestLi Protocol Version 2 0 0 H Content Type application json data proposal entityType dataHubIngestionSource entityUrn urn li dataHubIngestionSource cli 151c2b7711eb626e440af8c75a9082e9 changeType UPSERT aspectName dataHubIngestionSourceInfo aspect value name CLI dbt type dbt platform urn li dataPlatform unknown config recipe source type dbt config manifest path $ DBT PROJECT ROOT target manifest json catalog path $ DBT PROJECT ROOT target catalog json test results path $ DBT PROJECT ROOT target run results json target platform postgres load schemas false meta mapping business owner match operation add owner config owner type user owner category BUSINESS OWNER data steward match operation add owner config owner type user owner category DATA STEWARD technical owner match operation add owner config owner type user owner category TECHNICAL OWNER has pii match true operation add tag config tag has pii data governance team owner match Finance operation add term config term Finance test source match operation add tag config tag $match query tag mapping tag match operation add tag config tag $match version 0 8 45 executorId datahub cli contentType application json ` ` 2022 09 29 11 13 52 849 DEBUG datahub ingestion run pipeline 269 Reporter type datahub lt class datahub ingestion reporting datahub ingestion run summary provider DatahubIngestionRunSummaryProvider gt configured ` ` 2022 09 29 11 13 52 982 DEBUG datahub telemetry telemetry 243 Sending Telemetry` ` 2022 09 29 11 13 53 555 DEBUG datahub entrypoints 168 File home thinh datahub venv lib python3 10 site packages datahub ingestion run pipeline py line 196 in init ` `131 def init ` `132 self ` `133 config PipelineConfig ` `134 dry run bool = False ` `135 preview mode bool = False ` `136 preview workunits int = 10 ` `137 report to Optional str = None ` `138 no default report bool = False ` `139 ` ` ` `192 self record initialization failure e Failed to create source ` `193 return` `194` `195 try ` ` gt 196 self source Source = source class create ` `197 self config source dict get config self ctx` `File home thinh datahub venv lib python3 10 site packages datahub ingestion source dbt py line 1001 in create` `999 classmethod` `1000 def create cls config dict ctx ` ` gt 1001 config = DBTConfig parse obj config dict ` `1002 return cls config ctx dbt ` `File pydantic main py line 526 in pydantic main BaseModel parse obj` `File pydantic main py line 342 in pydantic main BaseModel init ` `ValidationError 1 validation error for DBTConfig` `load schemas` `extra fields not permitted type=value error extra ` `The above exception was the direct cause of the following exception ` `File home thinh datahub venv lib python3 10 site packages datahub cli ingest cli py line 197 in run` `111 def run ` `112 ctx click Context ` `113 config str ` `114 dry run bool ` `115 preview bool ` `116 strict warnings bool ` `117 preview workunits int ` `118 suppress error logs bool ` `119 test source connection bool ` `120 report to str ` `121 no default report bool ` `122 no spinner bool ` `123 gt None ` ` ` `193 test source connection report to pipeline config ` `194` `195 try ` `196 logger debug f Using config pipeline config ` ` gt 197 pipeline = Pipeline create ` `198 pipeline config ` `File home thinh datahub venv lib python3 10 site packages datahub ingestion run pipeline py line 317 in create` `306 def create ` `307 cls ` `308 config dict dict ` `309 dry run bool = False ` `310 preview mode bool = False ` `311 preview workunits int = 10 ` `312 report to Optional str = None ` `313 no default report bool = False ` `314 raw config Optional dict = None ` `315 gt Pipeline ` `316 config = PipelineConfig from dict config dict raw config ` ` gt 317 return cls ` `318 config ` `File home thinh datahub venv lib python3 10 site packages datahub ingestion run pipeline py line 202 in init ` `131 def init ` `132 self ` `133 config PipelineConfig ` `134 dry run bool = False ` `135 preview mode bool = False ` `136 preview workunits int = 10 ` `137 report to Optional str = None ` `138 no default report bool = False ` `139 ` ` ` `198 ` `199 logger debug f Source type source type source class configured ` `200 Source configured successfully ` `201 except Exception as e ` ` gt 202 self record initialization failure ` `203 e f Failed to configure source source type ` `File home thinh datahub venv lib python3 10 site packages datahub ingestion run pipeline py line 129 in record initialization failure` `128 def record initialization failure self e Exception msg str gt None ` ` gt 129 raise PipelineInitError msg from e` ` full traceback above ` `File home thinh datahub venv lib python3 10 site packages datahub cli ingest cli py line 197 in run` `pipeline = Pipeline create ` `File home thinh datahub venv lib python3 10 site packages datahub ingestion run pipeline py line 317 in create` `return cls ` `File home thinh datahub venv lib python3 10 site packages datahub ingestion run pipeline py line 202 in init ` `self record initialization failure ` `File home thinh datahub venv lib python3 10 site packages datahub ingestion run pipeline py line 129 in record initialization failure` `raise PipelineInitError msg from e` `PipelineInitError Failed to configure source dbt ` ` 2022 09 29 11 13 53 555 DEBUG datahub entrypoints 198 DataHub CLI version 0 8 45 at home thinh datahub venv lib python3 10 site packages datahub init py` ` 2022 09 29 11 13 53 556 DEBUG datahub entrypoints 201 Python version 3 10 6 main Aug 10 2022 11 40 04 GCC 11 3 0 at home thinh datahub venv bin python3 on Linux 5 15 0 48 generic x86 64 with glibc2 35` ` 2022 09 29 11 13 53 556 DEBUG datahub entrypoints 204 GMS config models patchCapable True versions linkedin datahub version v0 8 45 commit 21a8718b1093352bc1e3a566d2ce0297d2167434 managedIngestion defaultCliVersion 0 8 42 enabled True statefulIngestionCapable True supportsImpactAnalysis True telemetry enabledCli True enabledIngestion False datasetUrnNameCasing False retention true datahub serverType quickstart noCode true `

famous-florist-7218 · Answer

Hey Thinh please check your dbt config with the latest docs Seems like there are some conflicts ```ValidationError 1 validation error for DBTConfig load schemas extra fields not permitted type=value error extra ```

better-insurance-34701 · Answer

dbt run test runs fine with my models

better-insurance-34701 · Answer

it was imported ok with version 0 8 40

better-insurance-34701 · Answer

I don t know how to fix in this version

famous-florist-7218 · Answer

Could you please post your dbt config in here Just hide the sensitive info so I will take a look on it

mammoth-bear-12532 · Answer

mammoth-bear-12532 · Answer

```The dbt ingestion source s disable dbt node creation and load schema options have been removed They were no longer necessary due to the recently added sibling entities functionality ```

better-insurance-34701 · Answer

That solved my issue Appreciate all your help Thanks a lot

little-megabyte-1074 · Answer

Hi < better insurance 34701> Gentle reminder to please follow our Slack Guidelines amp post large blocks of code stacktrace in message threads it s a HUGE help for us to keep track of which questions still need attention across our various support channels teamwork

bland-orange-13353 · Answer

You can view our Slack Gluidelines here <https datahubproject io docs slack >