Optimus is an easy-to-use, reliable, and performant workflow orchestrator for data transformation, data modeling, pipelines, and data quality management.
Hypergol is a Data Science/Machine Learning productivity toolkit to accelerate any projects into production with autogenerated code, standardised structure for data and ML and parallel processing out-of-the-box.
This repository is a working ETL framework which utilizes user data from Spotify API using ➲Python for Extraction and Transformation ➲SQL for Data Loading and Staging ➲Airflow for Data Orchestration and Monitoring ➲PowerBI for Reporting
Built employee database using SQL by applying data modeling, engineering and analysis skills. I prepared an entity relationship diagram (ERD). I used PostgreSQL and pgAdmin to write SQL scripts to build tables, added joins between tables, imported data from CSV files, and wrote custom reports.
