A second crawl for a different host increases the throughput to a maximum of 240 文件 per minute since the crawler balances the load over all hosts.
高速爬行
当目标服务器数量很多时, 不局限于单个服务器(或站点)的'浅爬取'模式
can extend the pages per minute (ppm) rate to unlimited 文件 per minute when the number of target hosts is high.
This can be done using the Expert Crawl Start servlet.
调度程序指导
The scheduler on crawls can be changed or removed using Automation.
