brainstate

ScrapeGraphAI/Scrapegraph-ai

Python scraper based on AI

Python★ 32.5kMITGitHub ↗

History and source changes · Reports and owner responses · Compare

Similar

  1. firecrawl/firecrawl

    Supercharge your AI agents with data from the web and beyond. Building the library for superintelligence. 🔥

    TypeScript★ 198.4kAGPL-3.0GitHub ↗

    Why this match

    topics ai-crawler, ai-scraping, ai-search; language differs: Python → TypeScript; license differs: MIT → AGPL-3.0

  2. unclecode/crawl4ai

    Open-source web crawler and scraper for LLMs and AI agents: any website into clean, LLM-ready Markdown. Run it yourself, or use Crawl4AI Cloud with one key. Join our Discord https://discord.gg/VuxzM8mtf

    Python★ 86.9kApache-2.0GitHub ↗

    Why this match

    topics crawler, data-extraction, llm; license differs: MIT → Apache-2.0

  3. D4Vinci/Scrapling

    Scrapling — Python repository. Updated description pending.

    Python★ 95.8kBSD-3-ClauseGitHub ↗

    Why this match

    topics ai-scraping, crawler, data-extraction; license differs: MIT → BSD-3-Clause

  4. getmaxun/maxun

    Turn any website into a structured API. Extract, automate, search and monitor the web.

    TypeScript★ 18.1kAGPL-3.0GitHub ↗

    Why this match

    topics crawler, data-extraction, web-scraper; language differs: Python → TypeScript; license differs: MIT → AGPL-3.0

  5. lorien/awesome-web-scraping

    List of libraries, tools and APIs for web scraping and data processing.

    JavaScript★ 8.2kGitHub ↗

    Why this match

    topics crawler, scraping, scraping-python; language differs: Python → JavaScript

  6. alirezamika/autoscraper

    A Smart, Automatic, Fast and Lightweight Web Scraper for Python

    Python★ 8.1kMITGitHub ↗

    Why this match

    topics crawler, scraping, web-scraping

  7. BruceDone/awesome-crawler

    A collection of awesome web crawler,spider in different languages

    ★ 7.4kMITGitHub ↗

    Why this match

    topics crawler, web-crawler, web-scraper

  8. scrapy/scrapy

    Scrapy, a fast high-level web crawling & scraping framework for Python.

    Python★ 65.2kBSD-3-ClauseGitHub ↗

    Why this match

    topics crawler, scraping, web-scraping; license differs: MIT → BSD-3-Clause