Hi! Anyone has current experience with the Notion ...
# replication-troubleshooting
g
Hi! Anyone has current experience with the Notion source? I was trying 1.0.1, and it pulls data fine, but if I enable basic normalisation, it fails, even on the stream reset stage (so my hunch is it’s configuration, rather than data issue?) The end is something like, but happy to get more logs out if useful.
Copy code
2023-02-09 13:15:05 normalization >   File "/usr/local/lib/python3.9/site-packages/normalization/transform_catalog/utils.py", line 121, in <genexpr>
2023-02-09 13:15:05 normalization >     data_type.WELL_KNOWN_TYPE_VAR_NAME in option[data_type.REF_TYPE_VAR_NAME] for option in properties[data_type.ONE_OF_VAR_NAME]
2023-02-09 13:15:05 normalization > KeyError: '$ref'
The
users
table normalises fine, it’s the
databases
or
pages
tables that breaks this way (I think both/either does). Any ideas?
✅ 1
Any ideas why the Notion connector seems to be breaking while normalizing databases and pages?
n
Hi, Gergely! Yes - I'd love to get the full logs as a file. Thanks!
j
Hey @Gergely Imreh I've solved it - you need to add the connection on the notion page you want the data pulled from. See this page and the paragraph: "After an internal integration is created in the workspace, it needs to be added to a page or database. Then, all users with access to the page can interact with the integration. Users don’t need to install the integration individually." FINALLY working #ReadTheDocs
g
@Jamie Chennells thanks for checking, the connector was added to the page, and it pulled data. It’s the “basic normalisation” phase that broke (if I don’t normalize, the raw was there fine). But I’ll check it again (and come back with logs), maybe I’ve missed something.
👍 1
Hey, I’ve checked further why the Notion connector fails on the Basic Normalization step, I’ve opened an issue on GitHub and attached the full logfile there. https://github.com/airbytehq/airbyte/issues/23326 After that looking around I found that the issue I have was related to https://github.com/airbytehq/airbyte/pull/22161 and https://github.com/airbytehq/airbyte/pull/22283 It’s not clear, though whether the changes has been published for the bigquery connector (when doing basic normalization)? I’m on a newer / latest version
1.2.14
and hitting this.
Ah, the fix might not have been in either source or destination connectors but in AirByte itself, bumped version to 0.41.0 that included https://github.com/airbytehq/airbyte/commit/b9609ab73eba856a7a9f1e0370739eb4429a263d and sync seems to be running correctly, seems great!