Tag: WEBCRAWLER

I still remember the day fondly. I was 16 and I had just got my first broadband connection. 512 kilobits of pure DOWNLOAD! Ten times the bandwidth of my dial-up modem! Unlimited traffic! To this day I'm still amazed at how quickly I filled my 20GB hard drive with porn. But that's beyond the point -- back then, you had to either painstakingly Right Click > Save As on every image and video, or ...

Magellan, WebCrawler, Open Text. If you ever had any of those bookmarked, it was probably in the mid nineties, when they were among the cream of the web search crop. SearchEngineWatch is running a fun Where Are They Now? article on the search engines of yore (and now). It includes the dearly departed like Magellan, Open Text, and Infoseek, the new-again, including WebCrawler, Excite, and HotBot, ...

Whenever I think about my first days on the web c. 1995 I think of WebCrawler, the original and for awhile the best fulltext web search engine. WebCrawler's creator, Brian Pinkerton, is now working for Technorati ranking the world's blogs, which isn't much different from what he was doing 12 years ago: ranking the world's then-tiny population of web sites. Back in March 1994, about six weeks after ...