#
apache-airflow
Here are 148 public repositories matching this topic...
Curated list of resources about Apache Airflow
-
Updated
Dec 2, 2020 - Shell
A series of DAGs/Workflows to help maintain the operation of Airflow
-
Updated
Dec 3, 2020 - Python
An end-to-end GoodReads Data Pipeline for Building Data Lake, Data Warehouse and Analytics Platform.
python
airflow
spark
apache-spark
scheduler
s3
data-engineering
data-lake
warehouse
redshift
data-migration
livy
etl-framework
apache-airflow
emr-cluster
etl-pipeline
etl-job
data-engineering-pipeline
airflow-dag
goodreads-data-pipeline
-
Updated
Mar 9, 2020 - Python
terrytangyuan
commented
Oct 27, 2020
This could be example that uses these supported syntax and APIs:
https://github.com/couler-proj/couler/tree/d34a690/couler/core/syntax
Dynamically generate Apache Airflow DAGs from YAML configuration files
-
Updated
Dec 19, 2020 - Python
Helm Charts for the Astronomer Platform, Apache Airflow as a Service on Kubernetes
-
Updated
Dec 23, 2020 - Shell
A plugin for Apache Airflow that exposes rest end points for the Command Line Interfaces
-
Updated
Dec 16, 2020 - Python
barney-s
commented
Aug 9, 2018
Currently the env variables injected are specific to this docker image https://github.com/barney-s/docker-airflow
Align it with https://github.com/puckel/docker-airflow and make necessary changes in the operator to make it work with both.
related to GoogleCloudPlatform/airflow-operator#10
Example DAGs using hooks and operators from Airflow Plugins
airflow
mongodb
etl
google-analytics
imap
selenium
sftp
mailgun
salesforce
facebook-ads
dbt
hubspot
dag
marketo
singer
apache-airflow
marketo-sdk
airflow-plugins
-
Updated
Jul 24, 2018 - Python
A web frontend for scheduling Jupyter notebook reports
docker
kubernetes
airflow
jupyter
notebook
jupyter-notebook
nteract
luigi
celery
jupyterlab
dask
jupyter-notebooks
phosphorjs
apache-airflow
papermill
scheduling-notebooks
-
Updated
Nov 3, 2020 - Python
A process that runs in unison with Apache Airflow to control the Scheduler process to ensure High Availability
airflow
high-availability
scheduler-failover-controller
apache-airflow
airflow-scheduler
airflow-cluster
-
Updated
Nov 30, 2020 - Python
A Helm chart to install Apache Airflow on Kubernetes
-
Updated
Dec 24, 2020 - Shell
CLI that makes it easy to create, test and deploy Airflow DAGs to Astronomer
-
Updated
Dec 23, 2020 - Go
A plugin for Apache Airflow that allows you to edit DAGs in browser
-
Updated
Dec 9, 2020 - JavaScript
Terraform module to deploy an Apache Airflow cluster on AWS, backed by RDS PostgreSQL for metadata, S3 for logs and SQS as message broker with CeleryExecutor
-
Updated
Dec 23, 2020 - HCL
Ansible role to install Apache Airflow
-
Updated
Nov 17, 2020 - HTML
-
Updated
Jan 6, 2020 - Python
Basic tutorial of using Apache Airflow
-
Updated
Sep 25, 2018 - Python
Using Apache Airflow to schedule web scrapers
-
Updated
Oct 3, 2018 - Python
A complete development environment setup for working with Airflow
-
Updated
Oct 28, 2020 - Python
Apache Airflow - OpenApi Client for Go
-
Updated
Sep 6, 2020 - Go
Export Airflow metrics (from mysql) in prometheus format
-
Updated
Mar 6, 2019 - Go
Plugin offering views, operators, sensors, and more developed at Pandora Media.
-
Updated
May 3, 2018 - Python
-
Updated
Jun 10, 2020 - Python
Terraform module for a PostgreSQL-backed Apache Airflow instance
-
Updated
May 16, 2018 - HCL
Improve this page
Add a description, image, and links to the apache-airflow topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the apache-airflow topic, visit your repo's landing page and select "manage topics."
As discussed in apache/airflow#13308 (comment) we would like to add more verification for ifeatures of airflow production image.
We run already 'verify image' step so we can run quite a more number of those veification in
ci_verify_prod_image.shfor example to test ldap we could run:T