Are there URLs on this website that contain "/wordpress/"?
s
Sid
03/27/2022, 9:11 AM
I guess it’s blocking all URL’s that have the parent directory set to ‘wordpress’
👋 3
j
Jubin
03/28/2022, 8:09 AM
Thanks! I'm trying to get more information internally. Will get back once there's more clarity.
t
Tej
03/28/2022, 3:54 PM
@Jubin like @Sid said, the syntax here means it is blocking crawling of all urls with wordpress in it. In my assumption, it might be blocking shady things to happen with plugins inside wordpress OR old content/posts that were hosted with wordpress as root directory. once you get more info from team, we can help further I hope
j
Jubin
03/30/2022, 6:06 AM
Thanks @Tej. I don't have more info but this is the link: https://loginextsolutions.com/robots.txt
My only concern is to verify: Does the disallow wordpress line of code mean that google is not crawling the blog page since the blog is hosted on wordpress.
i
Ishaan Shakunt
03/30/2022, 1:10 PM
Nope. Your blog won't be affected by this.
✔️ 1
t
Tej
03/30/2022, 1:19 PM
yea @Jubin like Ishaan said, your blog pages seem to have blog in the url and no mention of wordpress directory so it should be good. be on the lookout for any crawl errors (in search console) for new blog posts just to be on top of the updates