User-agent: Mediapartners-Google
Disallow:
User-agent: *
Disallow: /search
Sitemap: http://techlondon.blogspot.com/feeds/posts/default?orderby=updated
This has been done to prevent google and other search engines from indexing duplicate contents on the blogs. Main advantage of this is that it now tells all the major search engines that they should index latest 25 posts of that blog.
Sitemap: http://techlondon.blogspot.com/feeds/posts/default?orderby=updated
But what really bothers me is the line Disallow: /search .
Blogger beta does not provide much extendibility for search optimization of blogs Each and every page will have similar title which is concatenation of Blog's main title and Post Title, Label Title or Archive Title.
But there is a tweak for this which can be used to show Page specific titles
So for a Label page
like http://techlondon.blogspot.com/search/label/Google%20Adsense we can show Title of Page as Google Adsense Tips, Optimize Adsense, Make money using Adsense which is more specific than the current title Techlondon: Google Adsense.
Use the following code in header template to replace
<Title><data:blog.pageTitle/></Title>
with
<b:if cond='data:blog.url == data:blog.homepageUrl'>
<Title><data:blog.pageTitle/></Title>
<b:else/>
<b:if cond='data:blog.url == "http://techlondon.blogspot.com/search/label/Google%20Adsense"'>
<Title>Google Adsense Tips, Optimize Adsense, Make money using Adsense</Title>
<!-- Similarly you can add more label pages to this list -->
<b:else/>
<!-- for all other posts -->
<Title><data:blog.pageTitle/></Title>
</b:if>
</b:if>
If you are not with me, what exactly i am trying to say here is that i could actually make my blog more search engine friendly by telling more about my pages, and could easily get more users from search engines.
But this new sitemap feature which does not allow search agents to index any page on blog having URL that prefixes with http://techlondon.blogspot.com/search/ and it has made life more difficult for bloggers who were aware of this trick.
There is another alternative to this which can be used to increase your traffic, but i am unsure if my follow bloggers will understand what i am talking here.. but if i make some sense please post a comment and if response is good i will be more then happy to share other options which can do wonder for your traffic.
