Data integration platform for ELT pipelines from APIs, databases & files to warehouses & lakes.
-
Updated
Aug 4, 2023 - Python
Data integration platform for ELT pipelines from APIs, databases & files to warehouses & lakes.
dbt enables data analysts and engineers to transform their data using the same practices that software engineers use to build applications.
The open source high performance data integration platform built for developers.
Kestra is an infinitely scalable orchestration and scheduling platform, creating, running, scheduling, and monitoring millions of complex pipelines.
Meltano: the declarative code-first data integration engine that powers your wildest data and ML-powered product ideas. Say goodbye to writing, maintaining, and scaling your own API integrations.
Kuwala is the no-code data platform for BI analysts and engineers enabling you to build powerful analytics workflows. We are set out to bring state-of-the-art data engineering tools you love, such as Airbyte, dbt, or Great Expectations together in one intuitive interface built with React Flow. In addition we provide third-party data into data sc…
Optimus is an easy-to-use, reliable, and performant workflow orchestrator for data transformation, data modeling, pipelines, and data quality management.
Dataform is a framework for managing SQL based data operations in BigQuery, Snowflake, and Redshift
A free to use dbt package for creating and loading Data Vault 2.0 compliant Data Warehouses (powered by dbt, an open source data engineering tool, registered trademark of dbt Labs)
Build, run and manage your data pipelines with Python or SQL.
A serverless architecture for orchestrating ETL jobs in arbitrarily-complex workflows using AWS Step Functions and AWS Lambda.
Sync external APIs to your DB, fast.
Use SQL to build ELT pipelines on a data lakehouse.
ReplicaDB is open source tool for database replication, designed for efficiently transferring bulk data between relational and non-relational databases
data load tool (dlt) is an open source Python library that makes data loading easy
Add a description, image, and links to the elt topic page so that developers can more easily learn about it.
To associate your repository with the elt topic, visit your repo's landing page and select "manage topics."