I’m posting this after spending about an hour, each day, for the past few weeks scratching my head, wondering why Google wouldn’t index my companies blog.
If you’re using a wordpress and are discovering that your website is being crawled but not indexed, check that your META tags in the client side HTML are written correctly. It may seem trivial, but It’s often overlooked.
I had done everything – checked WordPress’s read settings, gone over all the FAQ’s, ReadMe’s, Forum Posts, Regularlly updated the sitemap, Fetched as Google and Filed a reconsideration request. Net result? Nada.
So what was the error?
<meta name="robots" content="none" /> <meta name="googlebot" content="none" />
These 2 lines of HTML, hidden in the mountain of other HEAD tags where stopping Google (and other search engines) from indexing the website. After removing the PHP which retrieved the settings from the theme (These settings didn’t seem to work anyway), I hard coded the tags manually by writing:
<meta name="robots" content="index,follow" /> <meta name="googlebot" content="index,follow" />
I’m 99.99999999999999999999999999999999% certain I should start seeing results in the next few days, after this change.
Oh and, DOH!
More to follow…