Mark Angelo Evangelista

Software Engineer

Automated ETL Pipeline System

Developed automated data pipelines using Apache Airflow and Python, eliminating manual regulatory reporting

Technologies Used

PythonApache AirflowPostgreSQLMuleSoft

Architected and implemented a comprehensive ETL automation system to streamline regulatory reporting processes at Hawaiian Airlines.

System Overview

The solution automated the extraction, transformation, and loading of critical business data from multiple sources, reducing manual effort by 90% and ensuring regulatory compliance.

Technical Implementation

  • Apache Airflow for orchestration and scheduling
  • Python for data processing and transformation
  • PostgreSQL for data warehousing
  • MuleSoft for API integrations
  • Docker containers for deployment

Impact

Eliminated manual regulatory reporting processes, improved data accuracy, and ensured timely compliance with aviation industry regulations.