blekko

Grep the Web

vote for a grep | greps running soon | completed greps

Canonical vs No Canonical

Comparing webpages that use the rel="canonical" tag vs those that don't have it. There is no closing quote in case it's overloaded with more than 1 value.

grep pattern	Number of Urls	Number of Domains
rel="canonical -Minimum string for <link rel="canonical"> tag	424,617,843	2,027,361
rel='canonical -Single Quote version	125,359,433	3,756,276

List of top 100 domains in rank order:

rel="canonical
(Minimum string for <link rel="canonical"> tag)

URL	Site Rank
1. twitter.com	23,048
2. www.youtube.com	17,228
3. www.facebook.com	16,071
4. www.microsoft.com	15,371
5. maps.google.com	15,232
6. www.google.com	14,530
7. en.wikipedia.org	14,035
8. www.amazon.com	11,080
9. www.myspace.com	11,069
10. sourceforge.net	11,054
11. www.flickr.com	10,297
12. www.addthis.com	9,805
13. vimeo.com	9,448
14. www.linkedin.com	8,716
15. www.nytimes.com	7,926
16. www.imdb.com	7,651
17. sites.google.com	7,628
18. wordpress.org	7,614
19. news.bbc.co.uk	7,595
20. www.bbc.co.uk	7,330
21. www.w3.org	7,156
22. www.guardian.co.uk	7,145
23. itunes.apple.com	7,085
24. www.cnn.com	6,919
25. www.mapquest.com	6,903
26. www.gnu.org	6,753
27. www.pbs.org	6,600
28. www.cdc.gov	6,428
29. www.usatoday.com	6,420
30. feeds.feedburner.com	6,359
31. www.washingtonpost.com	6,162
32. online.wsj.com	5,914
33. www.ibm.com	5,546
34. code.google.com	5,535
35. www.telegraph.co.uk	5,508
36. www.wired.com	5,485
37. www.npr.org	5,444
38. mashable.com	5,356
39. www.slideshare.net	5,315
40. www.time.com	5,299
41. digg.com	5,289
42. www.scribd.com	5,283
43. www.reuters.com	5,237
44. www.weather.com	5,231
45. www.bloomberg.com	5,161
46. www.ncbi.nlm.nih.gov	5,140
47. ec.europa.eu	5,115
48. issuu.com	5,038
49. www.cisco.com	5,035
50. www.amazon.co.uk	5,035
51. www.un.org	4,937
52. www.forbes.com	4,928
53. nytimes.com	4,865
54. www.angelfire.com	4,860
55. www.businessweek.com	4,798
56. groups.google.com	4,751
57. abcnews.go.com	4,751
58. www.blogger.com	4,730
59. www.freewebs.com	4,727
60. www.msnbc.msn.com	4,723
61. www.php.net	4,673
62. www.foxnews.com	4,561
63. members.tripod.com	4,519
64. office.microsoft.com	4,480
65. europa.eu	4,471
66. www.latimes.com	4,425
67. msdn.microsoft.com	4,408
68. www.huffingtonpost.com	4,378
69. technorati.com	4,325
70. web.mit.edu	4,311
71. www.boston.com	4,282
72. support.microsoft.com	4,277
73. www.loc.gov	4,270
74. www.timesonline.co.uk	4,270
75. video.google.com	4,264
76. news.yahoo.com	4,254
77. arstechnica.com	4,242
78. docs.google.com	4,172
79. www.nlm.nih.gov	4,154
80. www.sfgate.com	4,092
81. www.hp.com	4,092
82. www.vimeo.com	4,082
83. github.com	4,078
84. homepage.mac.com	4,017
85. gizmodo.com	3,998
86. www.cbsnews.com	3,998
87. www.nationalgeographic.com	3,921
88. pbskids.org	3,916
89. www.opera.com	3,915
90. money.cnn.com	3,899
91. phobos.apple.com	3,894
92. news.cnet.com	3,886
93. forbes.com	3,878
94. addons.mozilla.org	3,857
95. www.lulu.com	3,850
96. finance.yahoo.com	3,845
97. web.mac.com	3,823
98. www.economist.com	3,815
99. www.last.fm	3,808
100. php.net	3,798

rel='canonical
(Single Quote version)

URL	Site Rank
1. www.google.com	14,530
2. creativecommons.org	8,492
3. www.addthis.com	8,370
4. wordpress.org	7,665
5. www.w3.org	7,156
6. www.pbs.org	6,600
7. feeds.feedburner.com	6,333
8. github.com	5,511
9. www.wired.com	5,485
10. mashable.com	5,356
11. www.npr.org	5,327
12. www.time.com	5,290
13. www.scribd.com	5,041
14. www.angelfire.com	4,803
15. www.slideshare.net	4,443
16. groups.google.com	4,384
17. www.loc.gov	4,362
18. techcrunch.com	4,088
19. www.sfgate.com	4,034
20. chronicle.com	3,998
21. www.lulu.com	3,850
22. www.ed.gov	3,748
23. www.blogger.com	3,705
24. www.cafepress.com	3,699
25. www.etsy.com	3,678
26. www.ustream.tv	3,490
27. www.randomhouse.com	3,329
28. homepage.mac.com	3,244
29. www.lonelyplanet.com	3,135
30. feeds2.feedburner.com	3,089
31. www.stanford.edu	3,083
32. www.britannica.com	2,842
33. mathforum.org	2,830
34. www.utexas.edu	2,762
35. googleblog.blogspot.com	2,754
36. www.indiana.edu	2,748
37. www.ibiblio.org	2,736
38. loc.gov	2,636
39. www.novell.com	2,572
40. www.addtoany.com	2,538
41. gigaom.com	2,522
42. www.dartmouth.edu	2,383
43. www.businesswire.com	2,360
44. boingboing.net	2,354
45. www.bu.edu	2,347
46. stackoverflow.com	2,339
47. www.bbb.org	2,259
48. www.yale.edu	2,247
49. www.fas.org	2,235
50. searchengineland.com	2,174
51. change.gov	2,160
52. www.stumbleupon.com	2,152
53. www.washington.edu	2,108
54. www.usc.edu	2,108
55. depts.washington.edu	2,092
56. venturebeat.com	2,080
57. www.alexa.com	2,075
58. thinkprogress.org	2,057
59. hosted.ap.org	2,034
60. www.unc.edu	2,028
61. www.history.com	2,016
62. current.com	1,966
63. www.uky.edu	1,963
64. www.cpanel.net	1,955
65. www.usgs.gov	1,935
66. www.smashingmagazine.com	1,925
67. sportsillustrated.cnn.com	1,915
68. www.livescience.com	1,915
69. icanhascheezburger.com	1,908
70. www.space.com	1,897
71. www.uvm.edu	1,873
72. members.cox.net	1,871
73. www.livestream.com	1,867
74. www.petfinder.com	1,864
75. vinaora.com	1,863
76. bits.blogs.nytimes.com	1,853
77. faculty.washington.edu	1,848
78. www.biblegateway.com	1,838
79. www.instructables.com	1,803
80. www.ucl.ac.uk	1,793
81. www.counterpunch.org	1,785
82. www.powells.com	1,771
83. thenextweb.com	1,764
84. www.ucalgary.ca	1,752
85. www.wikihow.com	1,740
86. www.librarything.com	1,720
87. www.in.gov	1,714
88. www.earthtimes.org	1,704
89. www.emusic.com	1,689
90. factcheck.org	1,688
91. www.ams.org	1,685
92. www.defra.gov.uk	1,676
93. userscripts.org	1,672
94. paidcontent.org	1,662
95. www.amnh.org	1,656
96. www.sonyericsson.com	1,655
97. www.ucmp.berkeley.edu	1,649
98. www.elpais.com	1,646
99. www.vanderbilt.edu	1,646
100. www.ncsu.edu	1,645

for the complete list email sales@blekko.com

CSV of top 500

blekko

Search Preference Settings

Grep the Web

Canonical vs No Canonical