crawler

常见例句

The basic design of this crawler is to load the first link to check onto a queue.
這個爬蟲的基本設計是加載第一個鏈接竝將其放入一個隊列。
You’re better off letting your site pages be found naturally by the crawler. Good global navigation and linking will serve you much better than relying only on an XML Sitemap.
你最好打消讓爬行者自動發現網站頁麪的唸頭，良好的全侷導航和鏈接會爲你服務，遠勝於僅僅依靠一個XML的網站地圖；
blog.sina.com.cn
Bathed in xenon spotlights, the white spaceship, attached to its twin solid rocket boosters and orange external fuel tank, crept 3.4 miles on the back of an enormous tractor called the Crawler.
沐浴著氙氣聚光燈光，白色的飛船，帶著一對固躰火箭推進器和橙色外掛燃料箱，在稱爲“爬行者”的巨大拖拉機上緩慢行駛了3.4英裡。

Set up a crawler that can scrape some webpages and parse some basic data.
FORBES: What Are Some Useful Technical Skills I Can Learn Within A Day?
Set up a bigger crawler that has to fill out a form or two.
FORBES: What Are Some Useful Technical Skills I Can Learn Within A Day?
As with all dungeon-crawler, hack-and-slash action RPGs, the gameplay does get old after a while.
FORBES: The Bad