Apr 24
Some kind of beta webcrawler from Yahoo has been hitting my site in weird ways. It crawled one page 41 times today so far, sometimes less than a minute apart. Uhhh? Yahoo? The user agent is Slurpy Verifier/1.0 and it is coming from 66.228.164.201/rdev25.yst.corp.yahoo.com.
- 24/Apr/2006:04:54:17
- 24/Apr/2006:04:55:20
- 24/Apr/2006:05:09:19
- 24/Apr/2006:05:10:12
- 24/Apr/2006:05:25:35
- 24/Apr/2006:05:26:51
- 24/Apr/2006:05:40:03
- 24/Apr/2006:05:53:00
- 24/Apr/2006:06:08:24
- 24/Apr/2006:06:23:49
- 24/Apr/2006:06:39:04
- 24/Apr/2006:06:55:50
- 24/Apr/2006:07:10:21
- 24/Apr/2006:07:26:04
- 24/Apr/2006:07:41:15
- 24/Apr/2006:07:57:16
- 24/Apr/2006:08:13:54
- 24/Apr/2006:08:25:44
- 24/Apr/2006:08:41:38
- 24/Apr/2006:08:56:35
- 24/Apr/2006:09:09:55
- 24/Apr/2006:09:25:36
- 24/Apr/2006:09:42:03
- 24/Apr/2006:09:57:09
- 24/Apr/2006:10:11:12
- 24/Apr/2006:10:25:53
- 24/Apr/2006:10:41:22
- 24/Apr/2006:10:56:33
- 24/Apr/2006:11:11:46
- 24/Apr/2006:11:25:46
- 24/Apr/2006:11:39:40
- 24/Apr/2006:11:55:19
- 24/Apr/2006:12:13:24
- 24/Apr/2006:12:25:08
- 24/Apr/2006:12:40:09
- 24/Apr/2006:12:53:50
- 24/Apr/2006:13:11:00
- 24/Apr/2006:13:24:19
- 24/Apr/2006:13:41:08
- 24/Apr/2006:13:53:56
- 24/Apr/2006:14:09:42
May 14th, 2006 at 8:18 pm
[...] This one is new to me. It looks likes a bot: no referring links, same IP address for each request (rdev25.yst.corp.yahoo.com), and, requesting only a single page off this blog. Others have observed identical behavior (see yeraze.com, The Hive Archive, and Ham Radio Blog). It hasn’t done anything particularly annoying (or useful, for that matter) so far, but we should keep an eye on it for future reference. [...]
September 11th, 2006 at 8:17 am
I saw this bot yesterday. Still don’t know what it does.
September 29th, 2006 at 4:24 pm
I saw this one today. Weird. Maybe someone should contact Yahoo customer support if they are that concerned??