blekko

Grep the Web

vote for a grep | greps running soon | completed greps

sites with an open search description

I'm looking to see how many sites are still implementing an Open Search description document. This piece of technology was all the rage a couple years ago but seems to be on the decline as of late. This grep looks for the link element used to declare the opensearch document. The document query you'd use for this element is this: "link[rel='search'][type='application/opensearchdescription+xml']"

grep pattern	Number of Urls	Number of Domains
rel=search	440,439	1,454
rel='search'	8,056,904	2,054
rel="search"	316,236,219	1,074,678

List of top 100 domains in rank order:

rel=search

URL	Site Rank
1. www.w3.org	5,631
2. www.angelfire.com	3,327
3. code.google.com	3,217
4. www.theregister.co.uk	2,614
5. blogs.msdn.com	1,997
6. www.columbia.edu	1,759
7. www.btinternet.com	1,609
8. www.brown.edu	1,544
9. www.eskimo.com	1,422
10. library.thinkquest.org	1,234
11. www.ncsu.edu	1,187
12. www.abdn.ac.uk	1,112
13. www.cs.berkeley.edu	1,093
14. www.lewrockwell.com	1,093
15. users.ox.ac.uk	1,038
16. www.duke.edu	1,036
17. members.ozemail.com.au	960
18. www.qub.ac.uk	928
19. mysite.verizon.net	894
20. www.uta.edu	861
21. www.techdirt.com	846
22. www.wellesley.edu	823
23. www.cs.auckland.ac.nz	774
24. www.uwec.edu	740
25. www.uni-muenster.de	727
26. diveintomark.org	724
27. www.baseball-reference.com	698
28. www.vogue.com	680
29. www.rootsweb.ancestry.com	591
30. freepages.genealogy.rootsweb.ancestry.com	584
31. www.labnol.org	560
32. www.genealogy.com	550
33. lists.w3.org	541
34. millercenter.org	538
35. mason.gmu.edu	532
36. www.leaguelineup.com	527
37. www.comp.lancs.ac.uk	519
38. www.channelregister.co.uk	495
39. people.bu.edu	495
40. userwww.sfsu.edu	489
41. hp.vector.co.jp	479
42. www-math.mit.edu	475
43. www.cs.technion.ac.il	456
44. agency.governmentjobs.com	432
45. www-rocq.inria.fr	421
46. www.mclink.it	418
47. www.yandex.ru	379
48. www.reghardware.com	376
49. www.spafinder.com	360
50. www.whatthebleep.com	330
51. www.geo.arizona.edu	329
52. www.cs.bgu.ac.il	326
53. www.cogsci.ed.ac.uk	325
54. www.washburn.edu	308
55. www.utc.fr	292
56. pinker.wjh.harvard.edu	275
57. www.utpjournals.com	274
58. newton.ex.ac.uk	256
59. www.faculty.fairfield.edu	244
60. puffin.creighton.edu	241
61. www.ne.se	240
62. home.centurytel.net	236
63. translatewiki.net	235
64. www.validome.org	226
65. www.ling.ohio-state.edu	221
66. www.tvrage.com	220
67. www.loni.ucla.edu	213
68. www.illuminati-news.com	213
69. www.bellarmine.edu	212
70. www.physics.utoronto.ca	210
71. blog.whatwg.org	209
72. www.calchamber.com	206
73. www.bcbsm.com	204
74. www.brucelawson.co.uk	203
75. musicremedy.com	196
76. www.z2systems.com	195
77. www.cybf.ca	194
78. html5.org	193
79. orwell.ru	192
80. awurl.com	191
81. www.prokerala.com	186
82. homepages.feis.herts.ac.uk	184
83. www.ltg.ed.ac.uk	182
84. www.bakeru.edu	177
85. members.toast.net	176
86. wiki.whatwg.org	170
87. www.toplien.fr	169
88. www.cs.miami.edu	169
89. www.jspwiki.org	168
90. www.vcall.com	166
91. www.yandex.com	166
92. homepage.hispeed.ch	165
93. amateurtraveler.com	164
94. www.anus.com	162
95. www.islandia.is	161
96. freepages.history.rootsweb.ancestry.com	160
97. www.me.gatech.edu	157
98. blog.html.it	156
99. bandaancha.eu	153
100. offog.org	153

rel='search'

URL	Site Rank
1. www.urbandictionary.com	2,015
2. www.nyse.com	1,218
3. www.cic.gc.ca	921
4. bugs.launchpad.net	884
5. www.allocine.fr	702
6. lmgtfy.com	696
7. www.eol.org	685
8. www.ic.gc.ca	646
9. www.dlink.com	636
10. www.woot.com	597
11. audioboo.fm	587
12. stocktwits.com	418
13. www.123rf.com	393
14. www.goodguide.com	379
15. www.mityc.es	367
16. www.abc.se	367
17. www.eitb.com	366
18. www.blippr.com	361
19. www.wordnik.com	355
20. au.lifestyle.yahoo.com	353
21. www.library.uq.edu.au	351
22. www.georgiasouthern.edu	348
23. www.tvrage.com	325
24. www.lightstalkers.org	313
25. www.flatworldknowledge.com	306
26. shirt.woot.com	291
27. eol.org	275
28. www.asc-csa.gc.ca	265
29. www.ovguide.com	258
30. www.shoes.com	252
31. cghub.com	250
32. library.creativecow.net	245
33. www.nmnathletics.com	244
34. home.teleport.com	242
35. tvrage.com	241
36. tupalo.com	234
37. www.youngminds.org.uk	233
38. hansard.millbanksystems.com	215
39. www.ogt.co.uk	213
40. forums.creativecow.net	211
41. www.famousfootwear.com	208
42. www.creativecow.net	199
43. euroalert.net	198
44. code4lib.org	196
45. www.ukclimbing.com	195
46. wheelmap.org	184
47. igem.org	175
48. www.actiweb.es	174
49. users.wpi.edu	173
50. www.mstateathletics.com	167
51. superogira.com	166
52. www.ree.es	165
53. 2010.igem.org	160
54. wine.woot.com	149
55. www.savetherhino.org	144
56. admin.xosn.com	144
57. www.ballroomdancers.com	144
58. www.moviepilot.de	141
59. learnable.com	134
60. www.vliz.be	133
61. pages.citebite.com	131
62. www.wordia.com	127
63. www.base.com	126
64. www.oooninja.com	126
65. www.lmgtfy.com	123
66. www.dec-ced.gc.ca	122
67. partsregistry.org	120
68. tel.local.ch	116
69. calagator.org	114
70. www.local.ch	112
71. wordia.com	109
72. www.naslovi.net	107
73. bethesignal.org	106
74. www.credentials.gc.ca	103
75. www.woodgreen.org.uk	102
76. rghost.net	102
77. www.2carpros.com	102
78. paperc.de	101
79. www.101cd.com	100
80. ucda.com	100
81. kids.woot.com	99
82. www.criticker.com	98
83. ung.igem.org	98
84. www.naturalizer.com	97
85. www.glasgowfilm.org	97
86. pericles.ipaustralia.gov.au	92
87. pipka.org	91
88. www.sepe.es	90
89. yellow.local.ch	90
90. sepecat.info	87
91. www.chas.org.uk	87
92. www.dvd.co.uk	85
93. www.haywood.edu	85
94. www.internetblackout.com.au	83
95. lightstalkers.org	83
96. www.trinigourmet.com	83
97. tkt.xosn.com	82
98. 2008.igem.org	80
99. flatworldknowledge.com	79
100. www.magistrix.de	76

rel="search"

URL	Site Rank
1. www.facebook.com	18,072
2. www.youtube.com	14,536
3. www.google.com	11,966
4. www.microsoft.com	11,867
5. en.wikipedia.org	11,561
6. slashdot.org	11,421
7. google.com	9,228
8. www.amazon.com	8,983
9. sourceforge.net	8,291
10. forum.bodybuilding.com	8,212
11. www.belaircamera.com	8,212
12. www.flixster.com	8,212
13. www.onlyshqip.com	8,212
14. www.silobreaker.com	8,212
15. www.techradar.com	8,212
16. www.welt.de	8,212
17. www.flickr.com	8,171
18. www.myspace.com	7,968
19. vimeo.com	7,889
20. wordpress.com	6,713
21. www.w3.org	5,631
22. feeds.feedburner.com	5,506
23. sites.google.com	5,404
24. www.gnu.org	5,380
25. www.imdb.com	5,220
26. www.cnn.com	5,079
27. www.washingtonpost.com	4,860
28. youtu.be	4,496
29. wordpress.org	4,471
30. ec.europa.eu	4,457
31. www.whitehouse.gov	4,329
32. code.google.com	4,250
33. openoffice.org	4,227
34. www.ncbi.nlm.nih.gov	4,149
35. github.com	4,113
36. www.slideshare.net	3,948
37. www.loc.gov	3,865
38. soundcloud.com	3,827
39. www.scribd.com	3,758
40. www.huffingtonpost.com	3,742
41. www.php.net	3,727
42. www.ibm.com	3,713
43. homepage.mac.com	3,606
44. support.microsoft.com	3,599
45. www.angelfire.com	3,566
46. photobucket.com	3,527
47. ezinearticles.com	3,506
48. www.ustream.tv	3,456
49. members.tripod.com	3,448
50. www.blogger.com	3,430
51. www.boston.com	3,421
52. addons.mozilla.org	3,396
53. chronicle.com	3,394
54. apps.facebook.com	3,367
55. techcrunch.com	3,366
56. web.mit.edu	3,348
57. www.cisco.com	3,348
58. msdn.microsoft.com	3,293
59. news.cnet.com	3,105
60. web.me.com	3,059
61. www.newscientist.com	3,058
62. www.freewebs.com	3,048
63. www.dailymail.co.uk	3,045
64. mail.google.com	3,005
65. www.marriott.com	3,001
66. edition.cnn.com	2,958
67. www.gutenberg.org	2,901
68. www.cia.gov	2,892
69. arstechnica.com	2,815
70. foursquare.com	2,759
71. www.engadget.com	2,729
72. www.fao.org	2,724
73. www.cafepress.com	2,690
74. www.fbi.gov	2,690
75. php.net	2,652
76. de.wikipedia.org	2,645
77. www.last.fm	2,643
78. www.dell.com	2,516
79. www.answers.com	2,486
80. www.python.org	2,469
81. www.spiegel.de	2,451
82. www.ibiblio.org	2,424
83. www.dailymotion.com	2,422
84. www.indiana.edu	2,416
85. www.ietf.org	2,415
86. www.cancer.org	2,387
87. home.earthlink.net	2,363
88. nces.ed.gov	2,358
89. www.stanford.edu	2,358
90. mathforum.org	2,358
91. sports.espn.go.com	2,357
92. feeds2.feedburner.com	2,352
93. home.comcast.net	2,347
94. fr.wikipedia.org	2,331
95. www.howstuffworks.com	2,317
96. translate.google.com	2,312
97. www.unicef.org	2,305
98. blogs.msdn.com	2,262
99. espn.go.com	2,238
100. www.acm.org	2,233

for the complete list email sales@blekko.com

CSV of top 500

blekko

Search Preference Settings

Grep the Web

sites with an open search description