Hello Team, I am trying to ingest (UI) metadata from bigquery ad getting error " extra fields not permitted (type=value_error.extra)'.\n". How can we solve this problem?

Verify your recipe against big query recipe from documentation, this error occurred if you have unknown field in recipe

source: type: bigquery config: project_id: project_id credential: private_key_id: '${PrivateKeyID}' private_key: '${PrivateKey}' client_email: xxxxxx client_id: '123456' project_id: project_id include_table_lineage: true include_view_lineage: true profiling: enabled: true stateful_ingestion: enabled: true upstream_lineage_in_report: true

I have found that removing the

include_view_lineage: true

line removes this error

Thanks for your answer Ash, I will delete the line and try to ingest again.

cc @bulky-soccer-26729

@little-megabyte-1074 Is this known issue? When lineage checkbox enabled in UI(Ingestion->Source->BigQuery->Configure Recipe->Form->Advanced->Include Lineage), It adds both

include_table_lineage

&

include_view_lineage

config to

true

in YAML config but ingestion pipeline reports

include_view_lineage

as extra fields not permitted

hey everyone - making a fix for this for the bigauery UI form right now

I get the same error with Redshift.

gotcha. yeah I merged in a fix for this today! so for those that have the extra field on your recipe, simply removing it should do the trick. then if you upgrade to

head

or wait for our next release you won't see this happen again

Thanks for your answers. You are a great team 🙂