Stay organized with collections
Save and categorize content based on your preferences.
Monday, April 27, 2009
We've been tracking the growth of
Sitemaps
on the web. It's been just 2 years since Google, Yahoo and Microsoft co-announced the
Sitemaps rule in robots.txt,
and it is already supported in many millions of websites including educational and
government
websites! At the WWW'09 conference in Madrid, Uri Schonfeld presented his summer internship work
studying Sitemaps from a coverage and freshness perspective. If you're interested in how some
popular websites are using Sitemaps, and how Sitemaps complement "classic" webcrawling, take a
look:
Sitemaps: Above and Beyond the Crawl of Duty
At Google, we care deeply about getting increased coverage and freshness of the content we index.
We are excited about open standards that help webmasters open up their content automatically to
search engines, so users can find relevant content for their searches.
[[["Easy to understand","easyToUnderstand","thumb-up"],["Solved my problem","solvedMyProblem","thumb-up"],["Other","otherUp","thumb-up"]],[["Missing the information I need","missingTheInformationINeed","thumb-down"],["Too complicated / too many steps","tooComplicatedTooManySteps","thumb-down"],["Out of date","outOfDate","thumb-down"],["Samples / code issue","samplesCodeIssue","thumb-down"],["Other","otherDown","thumb-down"]],[],[[["Google, Yahoo, and Microsoft announced the Sitemaps protocol two years ago, and it's now implemented on millions of websites."],["A study presented at WWW'09 conference analyzes how Sitemaps impact website coverage and content freshness."],["Google supports open standards like Sitemaps to enhance content coverage and freshness for better search results."],["Sitemaps complement traditional web crawling methods to make web content more accessible to search engines."]]],[]]
