has anyone gotten googlebot to correctly fetch gra...
# prisma-whats-newm
mel
06/04/2017, 7:46 PMhas anyone gotten googlebot to correctly fetch graph.cool content? even with a fully prerendered solution like prerender.cloud it executes the queries and returns the error
https://puu.sh/waR7e/d9fb0a1c85.png▾
h
huv1k
06/04/2017, 7:48 PM@mel do you serverside render or?
m
mel
06/04/2017, 7:50 PMyes a version of serverside rendering using http://prerender.cloud/ so it returns the rendered html with the javascript so the javascript executes again on the client
mel
06/04/2017, 7:53 PMIt works great with twitterbot, slackbot, etc but google is doing fancy things with its crawler…
h
huv1k
06/04/2017, 7:56 PMbecause twitter and slack dont crawl like google they only get tags
huv1k
06/04/2017, 7:57 PMcan you try proper server side rendering?
huv1k
06/04/2017, 7:57 PMbecause google block request so they crawl faster
huv1k
06/04/2017, 7:58 PMgoogle can understand some of JS but still lacks in some ways 🙂
m
mel
06/04/2017, 7:59 PMhmm it’s interesting because it seems to be able to fetch all the other endpoints just fine, just not the graph.cool endpoint…
s
sorenbs
06/04/2017, 8:32 PM
@mel - is this screenshot from google webmaster tools?
m
mel
06/04/2017, 8:32 PMyes it is
mel
06/04/2017, 8:33 PMfrom what im reading, it seems to be related to the robots.txt file at the api endpoint
mel
06/05/2017, 3:53 PM@sorenbs any idea what might be happening? is it something that can be fixed graph.cool side?
mel
06/07/2017, 5:32 PM@nilan maybe you can provide an update? 😬
n
nilan
06/07/2017, 5:49 PMI am not quite sure what is happening here. I quickly checked prerender.cloud with my own app, and the prerendering seems to work fine: https://service.prerender.cloud/http://learn-farsi.netlify.com
m
mel
06/07/2017, 10:11 PMSo this isn’t a prerender issue. The prerendering works great and all other bots (twitter, slack, etc) are doing well reading the pages. The issue is that googlebot get the page and then insists on running the js so that when it makes the network request it gets blocked from the graph.cool servers 😕
mel
06/14/2017, 12:57 AM@nilan have you tested your personal site on google webmaster tools? Specifically with the “fetch as google” tool? Sorry to keep bothering you with this …
2 Views