discover · compare · collections · requirements · contribute · feed · watching · stats · help with your tokens
ssssssss-team/spider-flow
新一代爬虫平台，以图形化方式定义爬虫流程，不写代码即可完成爬虫。
History and source changes · Reports and owner responses · Compare
Similar
- crawlab-team/crawlab
Distributed web crawler admin platform for spiders management regardless of languages and frameworks. 分布式爬虫管理平台，支持任何语言和框架
Why this match
topics crawler, spider, web-crawler; language differs: Java → Go; license differs: MIT → BSD-3-Clause
- BruceDone/awesome-crawler
A collection of awesome web crawler,spider in different languages
Why this match
topics crawler, spider, web-crawler
- jhao104/proxy_pool
Python ProxyPool for web spider
Why this match
topics crawler, spider; language differs: Java → Python
- s0md3v/Photon
Incredibly fast crawler designed for OSINT.
Why this match
topics crawler, spider; language differs: Java → Python; license differs: MIT → GPL-3.0
- projectdiscovery/katana
A next-generation crawling and spidering framework.
Why this match
topics crawler, web-spider; language differs: Java → Go
- binux/pyspider
A Powerful Spider(Web Crawler) System in Python.
Why this match
topics crawler; language differs: Java → Python; license differs: MIT → Apache-2.0
- jhy/jsoup
jsoup: the Java HTML parser, built for HTML editing, cleaning, scraping, and XSS safety.
Why this match
topics jsoup, xpath
- bda-research/node-crawler
Web Crawler/Spider for NodeJS + server-side jQuery ;-)
Why this match
topics crawler, spider; language differs: Java → TypeScript