Search engine with multiple crawlers sharing cookes
US7546370B1 Patents
A web-crawler system includes a plurality of network crawl ers configured to fetch documents from hosts on a network and a cookie database shared by the plurality of network crawlers. The cookie database stores cookies and associated
5 claims. 34,737 characters of text.