Data integration platform for ELT pipelines from APIs, databases & files to warehouses & lakes.
-
Updated
Jan 7, 2023 - Java
Data integration platform for ELT pipelines from APIs, databases & files to warehouses & lakes.
dbt enables data analysts and engineers to transform their data using the same practices that software engineers use to build applications.
Kestra is an infinitely scalable orchestration and scheduling platform, creating, running, scheduling, and monitoring millions of complex pipelines.
Optimus is an easy-to-use, reliable, and performant workflow orchestrator for data transformation, data modeling, pipelines, and data quality management.
Kuwala is the no-code data platform for BI analysts and engineers enabling you to build powerful analytics workflows. We are set out to bring state-of-the-art data engineering tools you love, such as Airbyte, dbt, or Great Expectations together in one intuitive interface built with React Flow. In addition we provide third-party data into data sc…
Your CLI for ELT+. It's open source, flexible, and scales to your needs. Confidently move, transform, and test your data using tools you know with a data engineering workflow you’ll love.
Dataform is a framework for managing SQL based data operations in BigQuery, Snowflake, and Redshift
A free to use dbt package for creating and loading Data Vault 2.0 compliant Data Warehouses (powered by dbt, an open source data engineering tool, registered trademark of dbt Labs)
A serverless architecture for orchestrating ETL jobs in arbitrarily-complex workflows using AWS Step Functions and AWS Lambda.
Use SQL to build ELT pipelines on a data lakehouse.
Sync external APIs to your DB, fast.
Build, run and manage your data pipelines with Python or SQL on any cloud
ReplicaDB is open source tool for database replication, designed for efficiently transferring bulk data between relational and non-relational databases
Dataplane is an Airflow inspired data platform with additional data mesh capability to automate, schedule and design data pipelines and workflows. Dataplane is written in Golang with a React front end.
Add a description, image, and links to the elt topic page so that developers can more easily learn about it.
To associate your repository with the elt topic, visit your repo's landing page and select "manage topics."