discover · compare · collections · requirements · contribute · feed · watching · stats · help with your tokens
crawlab-team/crawlab
Distributed web crawler admin platform for spiders management regardless of languages and frameworks. 分布式爬虫管理平台，支持任何语言和框架
History and source changes · Reports and owner responses · Compare
Similar
- ssssssss-team/spider-flow
新一代爬虫平台，以图形化方式定义爬虫流程，不写代码即可完成爬虫。
Why this match
topics crawler, spider, web-crawler; language differs: Go → Java; license differs: BSD-3-Clause → MIT
- BruceDone/awesome-crawler
A collection of awesome web crawler,spider in different languages
Why this match
topics crawler, spider, web-crawler; license differs: BSD-3-Clause → MIT
- jhao104/proxy_pool
Python ProxyPool for web spider
Why this match
topics crawler, spider; language differs: Go → Python; license differs: BSD-3-Clause → MIT
- gocolly/colly
Elegant Scraper and Crawler Framework for Golang
Why this match
topics crawler, go, spider; license differs: BSD-3-Clause → Apache-2.0
- s0md3v/Photon
Incredibly fast crawler designed for OSINT.
Why this match
topics crawler, spider; language differs: Go → Python; license differs: BSD-3-Clause → GPL-3.0
- chyroc/WechatSogou
基于搜狗微信搜索的微信公众号爬虫接口
Why this match
topics crawler, scrapy; language differs: Go → Python; license differs: BSD-3-Clause → Apache-2.0
- binux/pyspider
A Powerful Spider(Web Crawler) System in Python.
Why this match
topics crawler; language differs: Go → Python; license differs: BSD-3-Clause → Apache-2.0
- bda-research/node-crawler
Web Crawler/Spider for NodeJS + server-side jQuery ;-)
Why this match
topics crawler, spider; language differs: Go → TypeScript; license differs: BSD-3-Clause → MIT