Hoang Hong Ha

Results-driven Data Engineer with a holistic and long-term perspective on problem-solving. Skilled in building systems that handle large workloads and evaluating multiple architectural solutions. Proficient in leveraging a comprehensive multi-cloud toolset (AWS, GCP) and IaC (Terraform, Docker) to drive proactive risk management and high-quality outcomes.

Engineer in Information Systems, Hanoi University of Science and Technology
Oct 2015 — Oct 2020

Data Scientist Masters, Hanoi University of Science and Technology
Oct 2021 — Oct 2023

Data Engineer, SETA International Vietnam Co., Ltd
Jul 2024 — present

Educational Platform - Centralized Data Platform

Contributed to the end-to-end implementation of a scalable, secure multi-cloud Data Platform serving thousands of partner universities and complex microservices, helping establish a Single Source of Truth to power Analytics, Data Science, and BI across the organization.

• Architecture & Design: Participated in designing the platform architecture, evaluating multiple solutions and helping select the optimal design based on scalability, cost, and business value.
• Pipeline Performance: Designed and deployed resilient, high-performance data pipelines that reduced daily processing time, enabling near real-time insights.
• AWS Lakehouse: Built a Medallion Lakehouse (Bronze/Silver/Gold) using AWS DMS for CDC replication, MWAA (Airflow) for orchestration, and AWS Glue + Spark for transformations, with Apache Iceberg as the open table format — serving Analytics teams' dashboards and reports.
• GCP Analytics Stack: Developed a parallel pipeline on GCP using Datastream to replicate operational databases into BigQuery, with dbt Cloud modeling Silver/Gold layers to feed AI/ML agents developed by the Data Science team.
• Business Impact: Helped deliver a Unified Single Source of Truth adopted by 5+ departments (Analytics, Data Science, BI), improving data accessibility.

Technologies: Python, PySpark, SQL/NoSQL, AWS (DMS, Appflow, Lambda, S3, Glue, EMR, Athena, Redshift, Lake Formation), GCP (BigQuery, Datastream), Airflow (MWAA), DBT, Terraform, Docker, GitHub Actions, MongoDB, Neo4j, MySQL, PostgreSQL.

Energy Trading Platform - Multi-Region Data Platform

Contributed to building a scalable Data Platform ingesting daily data from operational and sensor sources across global energy markets (Ireland, Japan, Australia, and more). The platform powers real-time price forecasting and battery optimization models, enabling energy trading and market participation strategies for industrial clients with high reliability and low latency.

• Market Data Ingestion: Built Python-based collectors to ingest weather, pricing, and market data from multiple international exchanges, orchestrated via Apache Airflow for reliable, scheduled delivery.
• Unified Data Modeling: Designed a flexible, market-agnostic database schema that standardized heterogeneous data across regions, enabling rapid onboarding of new markets without pipeline rework.
• ML-Ready Datasets: Developed pipelines to automatically prepare and version training/inference datasets for the Data Science team, feeding price-forecasting and battery charge/discharge optimization models that generate profit-maximizing recommendations.
• Sensor & Forecast Integration: Engineered pipelines combining real-time battery sensor telemetry with forecast outputs, feeding downstream optimization models that recommend optimal charge/discharge timing.
• Product Delivery: Developed a FastAPI backend powering a web interface where clients monitor market indicators, forecasts, and optimizer recommendations in near real time.

Technologies: Python, FastAPI, SQL, Airflow, Redis, MySQL Server, PostgreSQL, Azure Database, Azure ML, Azure VM, Docker.

Magento Developer, Freelance
Oct 2021 — Jun 2024

• Developed and maintained websites based on customer requirements, integrating with front-end using APIs.

Magento Developer, Shopstack Vietnam Co., Ltd
Dec 2020 — Oct 2021

• Developed e-commerce website projects for Thai clients.
• Created and modified modules based on customer requirements.
• Utilized AWS and developed projects using RESTful APIs and GraphQL for front-end communication and third-party integration.

Magento Developer, Magenest JSC
Mar 2018 — May 2020

• Developed and enhanced features for existing extensions.
• Contributed to the development of websites for domestic and international clients, customizing functions per customer requirements.
• Worked with APIs, created data migration modules, and maintained various modules.

Microsoft Certified: Azure Data Fundamentals [link]

Microsoft Certified: Azure AI Fundamentals [link]