crawlers

Crawlers would take a week to reach the platform but the payloads could be released at any height to attain any orbit.

“爬行物”将花一周时间抵达平台，但是所携的有效荷载可以在任何高度释放从而进入任何轨道。

The content of the different search collections might be slightly out-of-sync while crawlers are running.

在爬网程序运行时，不同搜索源的内容可能会稍微失去同步。

In this case, the Ares I-X took a ride on one of two crawlers built to carry around the Saturn V rockets that sent astronauts to the moon.

这一次，战神一号X型乘坐的“战车”就是那时的两辆履带车之一，当年它运送的土星V火箭把宇航员送上了月球。

One such set of tools are the robots, spiders, and Web crawlers that aggregate information for Internet and intranet search engines.

这种工具有robot、spider和为Internet和Intranet搜索引擎搜集信息的Web爬行榜。

The final step is to allow this XML document to be made accessible to crawlers through a Web server.

最后一步需要使爬虫程序能通过Web服务器访问这个XML文档。

"Crawlers" stayed horizontal, moving more slowly but generally in straighter lines, a more energy-efficient way of getting around.

“爬行者”待在水平面上，很慢地爬行但是通常在直线上，一种更加节能的到处走动的方式。

It was basically moonshine fermented in a jar filled with snakes, scorpions and other creepy crawlers. Tasty.

那是在一个空罐子发酵过的药酒，有蛇、蝎子、和令人毛骨悚然的爬行动物。

They must be indexed by search engine crawlers, to get beyond our own little specialized indexes.

他们必须能被搜索引擎爬虫索引，以超过我们自己特有的小索引。

On each server, the scheduler will start the crawlers, and the collections will be updated to have the same content.

在每个服务器上，调度程序将启动爬网程序，并且将对集合进行更新以使其具有相同的内容。

Together, these tactics should help you give search engine crawlers a better idea of your exact location.

总得来说，这些办法应该能够帮助你让搜索引擎爬虫对你的确切地址有一个更好的了解。

The crawlers and index maintenance operations run on every server which increases system resources consumption.

每一个服务器上都运行爬网程序和建立维护操作的索引，这将增加系统资源的消耗。

The only way the zerg could defend was if the had rly good micro vs the charges or 2+ spine crawlers.

异虫唯一能防住这个战术的希望就是有足够好的微操来避开炸弹或者有2个以上脊针爬虫。

These crawlers look for missing content, validate all links, and ensure that your Hypertext Markup Language (HTML) is valid.

这些爬虫会查找缺少的内容、验证所有的链接，并会确保超文本标记语言（HTML）是有效的。

Automation detection - Detecting bots, crawlers, scanners and other surface malicious activity.

自动检测——对机器人、爬虫、扫描及其他恶意行为进行检测。

Search engines typically disperse Web crawlers to scour the network and compile an index of existing documents.

一般而言，搜索引擎将Web牵引程序分散开以为网络畅通铺平道路，以及对现有文件的索引进行编译。

Web crawlers return to each site on a regular basis, such as every month or two, to look for changes.

网络抓取工具定期如每个月或两个查找更改返回到每个站点。

Therefore, the defined crawlers and the maintenance process might not be running.

因此，已定义的爬网程序和维护处理可能不会运行。

In the search admin portlet, create your collection, and configure your crawlers and taxonomies.

在搜索管理Portlet中，创建集合，并配置爬网程序和分类。

Web servers can exclude crawlers using a file called robot. txt that tells the crawler what can and can't be crawled.

Web服务器可以使用一个名为robot.txt的文件来执行爬虫，它会告诉爬虫不能搜索的内容。

A site map is useful to facilitate deep crawling so that crawlers can easily visit and index pages deeply embedded within the site.

站点地图对于爬网深度是非常有用的，它使爬行器能够轻松地访问并建立深嵌于该站点内的页面的索引。