brainstate

discover · compare · collections · requirements · contribute · feed · watching · stats · help with your tokens

luyishisi/Anti-Anti-Spider

越来越多的网站具有反爬虫特性，有的用图片隐藏关键数据，有的使用反人类的验证码，建立反反爬虫的代码仓库，通过与不同特性的网站做斗争（无恶意）提高技术。（欢迎提交难以采集的网站）（因工作原因，项目暂停）

Python★ 7.3kGitHub ↗

History and source changes · Reports and owner responses · Compare

Similar

  1. s0md3v/Photon

    Incredibly fast crawler designed for OSINT.

    Python★ 13.3kGPL-3.0GitHub ↗

    Why this match

    topics python, spider

  2. andeya/pholcus

    Pholcus is a distributed high-concurrency crawler software written in pure golang

    Go★ 7.6kApache-2.0GitHub ↗

    Why this match

    topics spider; language differs: Python → Go

  3. jhao104/proxy_pool

    Python ProxyPool for web spider

    Python★ 23.8kMITGitHub ↗

    Why this match

    topics spider

  4. bda-research/node-crawler

    Web Crawler/Spider for NodeJS + server-side jQuery ;-)

    TypeScript★ 6.8kMITGitHub ↗

    Why this match

    topics spider; language differs: Python → TypeScript

  5. gocolly/colly

    Elegant Scraper and Crawler Framework for Golang

    Go★ 25.6kApache-2.0GitHub ↗

    Why this match

    topics spider; language differs: Python → Go

  6. pyenv/pyenv

    Simple Python version management

    Shell★ 45.2kMITGitHub ↗

    Why this match

    topics python; language differs: Python → Shell

  7. BruceDone/awesome-crawler

    A collection of awesome web crawler,spider in different languages

    ★ 7.4kMITGitHub ↗

    Why this match

    topics spider

  8. wechatsync/Wechatsync

    一键同步文章到多个内容平台，支持今日头条、WordPress、知乎、简书、掘金、CSDN、typecho各大平台，一次发布，多平台同步发布。解放个人生产力

    TypeScript★ 6.6kGPL-3.0GitHub ↗

    Why this match

    topics spider; language differs: Python → TypeScript