discover · compare · collections · requirements · contribute · feed · watching · stats · help with your tokens
andeya/pholcus
Pholcus is a distributed high-concurrency crawler software written in pure golang
History and source changes · Reports and owner responses · Compare
Similar
- luyishisi/Anti-Anti-Spider
越来越多的网站具有反爬虫特性，有的用图片隐藏关键数据，有的使用反人类的验证码，建立反反爬虫的代码仓库，通过与不同特性的网站做斗争（无恶意）提高技术。（欢迎提交难以采集的网站）（因工作原因，项目暂停）
Why this match
topics spider; language differs: Go → Python
- jhao104/proxy_pool
Python ProxyPool for web spider
Why this match
topics spider; language differs: Go → Python; license differs: Apache-2.0 → MIT
- s0md3v/Photon
Incredibly fast crawler designed for OSINT.
Why this match
topics spider; language differs: Go → Python; license differs: Apache-2.0 → GPL-3.0
- bda-research/node-crawler
Web Crawler/Spider for NodeJS + server-side jQuery ;-)
Why this match
topics spider; language differs: Go → TypeScript; license differs: Apache-2.0 → MIT
- gocolly/colly
Elegant Scraper and Crawler Framework for Golang
Why this match
topics spider
- BruceDone/awesome-crawler
A collection of awesome web crawler,spider in different languages
Why this match
topics spider; license differs: Apache-2.0 → MIT
- wechatsync/Wechatsync
一键同步文章到多个内容平台，支持今日头条、WordPress、知乎、简书、掘金、CSDN、typecho各大平台，一次发布，多平台同步发布。解放个人生产力
Why this match
topics spider; language differs: Go → TypeScript; license differs: Apache-2.0 → GPL-3.0
- ssssssss-team/spider-flow
新一代爬虫平台，以图形化方式定义爬虫流程，不写代码即可完成爬虫。
Why this match
topics spider; language differs: Go → Java; license differs: Apache-2.0 → MIT