Anyone using the Google Search Console connector h...
# replication-troubleshootingw
wp
10/25/2022, 6:51 PMAnyone using the Google Search Console connector have issues with the streams being empty?
It seems like I am only getting data from 3 streams
Copy code
search_analytics_by_date
sites
sitemaps Copy code
search_analytics_all_fields
search_analytics_country
search_analytics_page
search_analytics_device
search_analytics_query Copy code
failures: [ ]s
Saj Dider (Airbyte)
10/26/2022, 5:51 PMHey @wp, thanks for the question. What version connector are you using? Are you using custom reports?
w
wp
10/26/2022, 5:55 PMit is using
google search console 0.1.17s
Saj Dider (Airbyte)
10/26/2022, 5:56 PMI notice you're using incremental append for the streams that are empty. Did you previously do a full refresh and is there new data?
w
wp
10/26/2022, 5:58 PMyea, the streams were reset before a sync
wp
10/26/2022, 5:59 PMfeel weird that if i am getting data for the 3 streams i don’t see why it would be empty for the others.
Copy code
search_analytics_by_date
sites
sitemapss
Saj Dider (Airbyte)
10/26/2022, 6:01 PMCan you share the sync logs by any chance?
w
wp
10/26/2022, 6:03 PMyea sure. This is from the run after the reset.
s
Saj Dider (Airbyte)
10/26/2022, 6:07 PMDo a full refresh for the streams that didn't return any data.
w
wp
10/26/2022, 6:08 PMyea i just did as well
wp
10/26/2022, 6:08 PMsame thing
wp
10/26/2022, 6:08 PMonly the same 3 streams were returning data
wp
10/26/2022, 6:09 PM21007c52_82e4_43b9_a359_2c4542be54a4_logs_245_txt.txt
wp
10/26/2022, 6:10 PMScreen Shot 2022-10-26 at 2.10.42 PM.png
s
Saj Dider (Airbyte)
10/26/2022, 6:12 PMDid these streams return data before? Or is this is the first time you're running into this problem? Did you recently upgrade?
Saj Dider (Airbyte)
10/26/2022, 6:12 PMI'm not really understanding why it's reading in 0 records for each of those streams
w
wp
10/26/2022, 6:14 PMthis is the first time i am running the connector. Just wondering why we aren’t getting anything from those stream as its not something configurable on search console.
s
Saj Dider (Airbyte)
10/26/2022, 6:17 PMIs there a way to verify that there are actually records that should be synced? It could be returning 0 records because there are in fact 0 records to extract from the source.
w
wp
10/26/2022, 6:20 PMI dont think there is a way….i assume the streams are just different filters of the same data. I was able to view similar data implied by the stream names on the search console UI
wp
10/26/2022, 6:37 PMyea seems like the other streams are just including additional dimensions. Since i am getting data on the date stream, I would think the other streams with additional dimension should have data as well. I can also view these data via filter (country, device, page etc) on the search console ui
s
Saj Dider (Airbyte)
11/01/2022, 3:06 PM@wp, I believe the connector was recently updated. Can you upgrade and see if the streams are returning properly?
w
wp
11/02/2022, 2:53 AMusing the updated connector 0.1.18 still not returning the streams with other dimensions, only the one with date. Attached is the log.
wp
11/02/2022, 3:17 AMtested it using regular big query destination instead of the big query denormalized destination and got the same count from the same streams
wp
11/02/2022, 6:50 PMI’ve tried custom report and am getting the same result as well. At this point i think it is probably a me issue.
s
Saj Dider (Airbyte)
11/03/2022, 3:35 PMThanks for the reply @wp, I’ll take a look at the logs you posted above. It could be a you issue but one last thing you can try is using a different destination other than bigquery (maybe file connector?) and see if you still get the same streams.
The fact that it’s a successful sync implies to me that there are genuinely no records for those streams but it could also be something going wrong with the destination.
w
wp
11/03/2022, 7:11 PMI figured out the issue and it was indeed a me problem.
The search console I was trying to use is set up as a domain property and for the
Website URL Propertysc-domain:<http://website.com|website.com>wp
11/03/2022, 7:13 PMHopefully the info could benefit others and to be included in the documentation.
Thanks again for the assist. I am all set on this issue.
👍 1
2 Views