An end-to-end GoodReads Data Pipeline for Building Data Lake, Data Warehouse and Analytics Platform.

Few projects related to Data Engineering including Data Modeling, Infrastructure setup on cloud, Data Warehousing and Data Lake development.

Data pipeline performing ETL to AWS Redshift using Spark, orchestrated with Apache Airflow

ETL pipeline combined with supervised learning and grid search to classify text messages sent during a disaster event

A data engineering pipeline for digital marketers.

Solution for the Ultimate Student Hunt Challenge (1st place).

Learning from multiple companies in Silicon Valley. Netflix, Facebook, Google, Startups

Challenge para a vaga de Data Scientist UNJ, na Softplan

An environment for analyzing Twitter

MLOps (a compound of “machine learning” and “operations”) is a practice for collaboration and communication between data scientists and operations professionals to help manage production ML (or deep learning) lifecycle. This repository is intended for my customer and partner workshop guidance.

ETL pipeline for construction permits data in Los Angeles built on AWS S3, Lambda and RDS PostgreSQL.

Classwork projects and home works done through Udacity data engineering nano degree

Marshmallow serializer integration with pyspark

Disaster Response Pipeline | Data Engineering

Data Engineering Projects including Data Modeling, Data Warehouse, Data Lake Development

ETL Pipeline / ML Pipeline of Disaster Data provided by figure8

Examples that I use to learn and show Apache Beam

A quick implementation of OCR Application with AWS Lambda.

Data pipeline with Apache Airflow - Data Engineering Nanodegree (DEND) 5th Project