node-crawler 开源项目推荐（22 个）

BruceDone /awesome-crawler

A collection of awesome web crawler,spider in different languages

poozhu /crawler-for-github-trending

🕷️ A node crawler for github trending.

omkarcloud /botasaurus-starter

🚀 OFFICIAL STARTER TEMPLATE FOR BOTASAURUS SCRAPING FRAMEWORK 🤖

MertenD /node-crawler

Node-Crawler is a highly customizable, Node-based web application for creating web crawlers and further processing and transforming the retrieved data.

zcrossoverz /manga-lib

manga-lib is a nodejs library that allows you to easily scrape manga content from various websites.

sarthology /criCLI

🏏 Small CLI app to show Live Score of Cricket matches in Terminal

xikong1995 /node-crawler

nodejs 爬虫，包括不限于微博，instagram，图片和视频

onibus-gv /onibus-gv-crawler

Crawler para pegar horários dos ônibus da grande vitória

omkarcloud /web-scraping-template

🚀 THIS WEB SCRAPING TEMPLATE PROVIDES YOU WITH A GREAT STARTING POINT WHEN CREATING WEB SCRAPING BOTS. 🤖

zhangwinning /crawler_poster

node crawler

AppliedSoul /promise-crawler

Promise support for node-crawler (Web Crawler/Spider for NodeJS + server-side jQuery)

52cik /creeper

简单爬虫引擎 (苦力怕)

canyuegongzi /simple-crawlers-center

基于node的爬虫系统，定时爬取实时热点 ，新闻，存入mongodb

omkarcloud /dentalkart-scraper

🚀 SCRAPE 1000'S OF PRODUCTS FROM DENTALKART 🤖

coooold /PHPCrawler

Most powerful, popular and production crawling/scraping package for PHP

AkashRajpurohit /node-crawler

Nodejs Crawler which scrapes a website on live domain and crawls to find all URL of the domain

m98 /email-extractor-crawler

A minimal Node crawler to find emails used inside a website content, this crawler follows links in the website and tries to find an email in the content of the page

derekeeeeely /dz-pjs

collection of old pjs

YarTsin /web-crawler

A collection web crawler, spider and resources in different languages.

lossless1 /image_crawler

Crawl all images from any website