Google simplifies site indexing
Google is offering webmasters a new, simple method of getting their sites indexed and linked to its search pages.
Sitemaps, which is a free service, lets companies automatically submit pages to Google. Previously, they would simply publish their sites and wait for Google to pick them up as part of its search index, or build up a number of linked sites and submit information to Google’s “Add URL” pages.
Now webmasters can inform Google about all their pages, state in what order they want them crawled, and ensure that new pages and updates are indexed faster.
To use Sitemaps, webmasters must submit information about their web pages in a structured XML site-list format. This is then added to Google’s Sitemap Generator, which in turn generates an XML sitemap. Google said this would let it build up a more comprehensive index of content, thus making it easier to provide more accurate search returns for users.
Participation in the programme is free, but there are no guarantees that volunteered sites will be included. Web sites that are included will not have their rankings changed as a result.
Although the Sitemap Generator will produce a script automatically, participants can still submit a Sitemap using an HTTP request if their sites will not fit this format. Details on how to submit details, together with information on using other formats, and where to download tools can be found at the web address below. Web pages that companies do not want crawled or indexed can be removed from the final Sitemap form.
However, using Sitemaps does require some technical ability. Webmasters must be able to upload files to their web server, which should be have Python 2.2, and run scripts.
Robert John Shepherd, editor of web site DVDreviewer.co.uk, said that his company had assessed the tool, but had no immediate plans to use it. “It seems an interesting idea for web sites that are having problems with content hidden deep in their site structure not getting indexed. Having been around so long, we are already regularly well indexed by Google,” he said.