Hello Team, I am trying to ingest (UI) metadata fr...
# getting-started
m
Hello Team, I am trying to ingest (UI) metadata from bigquery ad getting error " extra fields not permitted (type=value_error.extra)'.\n". How can we solve this problem?
g
Verify your recipe against big query recipe from documentation, this error occurred if you have unknown field in recipe
m
source: type: bigquery config: project_id: project_id credential: private_key_id: '${PrivateKeyID}' private_key: '${PrivateKey}' client_email: xxxxxx client_id: '123456' project_id: project_id include_table_lineage: true include_view_lineage: true profiling: enabled: true stateful_ingestion: enabled: true upstream_lineage_in_report: true
This is the code created by UI, I really dont know what the problem is. Which field is unknown?
m
I have found that removing the
include_view_lineage: true
line removes this error
m
Thanks for your answer Ash, I will delete the line and try to ingest again.
m
cc @bulky-soccer-26729
h
@little-megabyte-1074 Is this known issue? When lineage checkbox enabled in UI(Ingestion->Source->BigQuery->Configure Recipe->Form->Advanced->Include Lineage), It adds both
include_table_lineage
&
include_view_lineage
config to
true
in YAML config but ingestion pipeline reports
include_view_lineage
as extra fields not permitted
b
hey everyone - making a fix for this for the bigauery UI form right now
b
I get the same error with Redshift.
b
gotcha. yeah I merged in a fix for this today! so for those that have the extra field on your recipe, simply removing it should do the trick. then if you upgrade to
head
or wait for our next release you won't see this happen again
m
Thanks for your answers. You are a great team 🙂