brainstate

s0md3v/Photon

Incredibly fast crawler designed for OSINT.

Python★ 13.3kGPL-3.0GitHub ↗

History and source changes · Reports and owner responses · Compare

Similar

  1. binux/pyspider

    A Powerful Spider(Web Crawler) System in Python.

    Python★ 16.8kApache-2.0archivedGitHub ↗

    Why this match

    topics crawler, python; license differs: GPL-3.0 → Apache-2.0

  2. jhao104/proxy_pool

    Python ProxyPool for web spider

    Python★ 23.8kMITGitHub ↗

    Why this match

    topics crawler, spider; license differs: GPL-3.0 → MIT

  3. luyishisi/Anti-Anti-Spider

    越来越多的网站具有反爬虫特性,有的用图片隐藏关键数据,有的使用反人类的验证码,建立反反爬虫的代码仓库,通过与不同特性的网站做斗争(无恶意)提高技术。(欢迎提交难以采集的网站)(因工作原因,项目暂停)

    Python★ 7.3kGitHub ↗

    Why this match

    topics python, spider

  4. bda-research/node-crawler

    Web Crawler/Spider for NodeJS + server-side jQuery ;-)

    TypeScript★ 6.8kMITGitHub ↗

    Why this match

    topics crawler, spider; language differs: Python → TypeScript; license differs: GPL-3.0 → MIT

  5. antoniaci/blackbird

    An OSINT tool to search for accounts by username and email in social networks.

    Python★ 9.6kGitHub ↗

    Why this match

    topics osint, python

  6. gocolly/colly

    Elegant Scraper and Crawler Framework for Golang

    Go★ 25.6kApache-2.0GitHub ↗

    Why this match

    topics crawler, spider; language differs: Python → Go; license differs: GPL-3.0 → Apache-2.0

  7. injetlee/Python

    Python脚本。模拟登录知乎, 爬虫,操作excel,微信公众号,远程开机

    Python★ 10.9kGitHub ↗

    Why this match

    topics crawler, python

  8. laramies/theHarvester

    E-mails, subdomains and names Harvester - OSINT

    Python★ 18.2kGPL-2.0GitHub ↗

    Why this match

    topics information-gathering, osint, python; license differs: GPL-3.0 → GPL-2.0