brainstate

mage-ai/mage-ai

🧙 Build, run, and manage data pipelines for integrating and transforming data.

Python★ 8.8kApache-2.0GitHub ↗

History and source changes · Reports and owner responses · Compare

Similar

  1. apache/airflow

    Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

    Python★ 47.4kApache-2.0GitHub ↗

    Why this match

    topics data-engineering, data-integration, data-pipelines

  2. dagster-io/dagster

    An orchestration platform for the development, production, and observation of data assets.

    Python★ 16.4kApache-2.0GitHub ↗

    Why this match

    topics data-engineering, data-integration, data-pipelines

  3. PRQL/prql

    PRQL is a modern language for transforming data — a simple, powerful, pipelined SQL replacement

    Rust★ 10.9kApache-2.0GitHub ↗

    Why this match

    topics data, pipeline, sql; language differs: Python → Rust

  4. airbytehq/airbyte

    Open-source data movement for ELT pipelines and AI agents — from APIs, databases & files to warehouses, lakes, and AI applications. Both self-hosted and Cloud.

    Python★ 22.3kGitHub ↗

    Why this match

    topics data, data-engineering, data-integration

  5. PrefectHQ/prefect

    Prefect is a workflow orchestration framework for building resilient data pipelines in Python.

    Python★ 24.1kApache-2.0GitHub ↗

    Why this match

    topics data, data-engineering, data-science

  6. cloudquery/cloudquery

    Data pipelines for cloud config and security data. Build cloud asset inventory, CSPM, FinOps, and vulnerability management solutions. Extract from AWS, Azure, GCP, and 70+ cloud and SaaS sources.

    Go★ 6.5kMPL-2.0GitHub ↗

    Why this match

    topics data, data-engineering, data-integration; language differs: Python → Go; license differs: Apache-2.0 → MPL-2.0

  7. mrdbourke/machine-learning-roadmap

    A roadmap connecting many of the most important concepts in machine learning, how to learn them and what tools to use to perform them.

    ★ 7.9kMITGitHub ↗

    Why this match

    topics data, data-science, machine-learning; license differs: Apache-2.0 → MIT

  8. Avaiga/taipy

    Turns Data and AI algorithms into production-ready web applications in no time.

    Python★ 19.5kApache-2.0GitHub ↗

    Why this match

    topics data-engineering, data-integration, orchestration