In a rare instance of collaboration among otherwise fierce rivals, Google, Yahoo and Microsoft said that they would support a new Web standard that will allow millions of Web publishers to remove duplicate pages from their Web sites. As a result of the effort, search engines should be able to find and index more Web pages, making their search results more comprehensive.
The problem is the following: Many Web publishers, especially those that have voluminous sites, like e-commerce companies, have multiple URLs that all point to the same page. This confuses search engines, sometimes causing them to index the same page multiple times. As much as 20 percent of URLs on the Web may be duplicates, according to some estimates....All search engines have developed technologies to detect duplicates that are more or less effective. The so-called Canonical Link Tag, as the standard is known, should make it easier for both publishers and search engines to address the problem.
|
This is a great effort....we all should support this.
|