Summary

I am a proactive Middle Data Engineer with 5 years of experience, specializing in building robust data pipelines for healthcare, retail, logistics, and travel industries. Proficient in Apache Airflow, Azure Data Factory, and Python, I create efficient data infrastructures that support business growth. I enjoy working with engineering teams to troubleshoot issues and enhance data flow, delivering reliable solutions under tight deadlines.

Technical proficiencies

Programming Languages: Python, SQL

Skills:

  • Data Engineering: Apache Airflow, Azure Data Factory, ETL Development
  • Databases: MySQL, PostgreSQL, MongoDB
  • Data Processing: Pandas, PySpark
  • Cloud Platforms: Azure (Data Lake, Databricks), AWS (S3)
  • Others: Data Pipeline Automation, Performance Tuning, Team Collaboration

Tools: Docker, Git, Jenkins, Visual Studio Code.

Professional experience

Retail Data Pipeline Project - Korea

Data Engineer, Aug 2023 - Present

Project description 

  • Engineered data pipelines for a retail platform to process customer transaction and inventory data in real time.

Highlights

  • Recognized as Top Data Engineer of the Quarter, Q3 2024, for resolving critical pipeline issues

Responsibilities 

  • Developed ETL workflows using Apache Airflow to move data from SQL Server to Azure Data Lake.
  • Optimized data processing with Azure Databricks, reducing batch job runtime by 20%.
  • Collaborated with analysts to design data schemas for inventory forecasting.
  • Implemented automated monitoring with Azure Monitor to ensure pipeline reliability.
  • Resolved data ingestion bottlenecks, improving data availability by 15%.
  • Documented processes to facilitate knowledge sharing within the team.

Technologies 

  • Apache Airflow, Azure Data Factory, Python, SQL, SQL Server, Azure Data Lake, Azure Databricks, PySpark

Healthcare Data Workflow Project - Canada

Data Engineer, Jun 2022 – Jul 2023

Project description 

  • Designed data workflows to integrate patient data across multiple healthcare systems.  

Responsibilities 

  • Built ETL pipelines using Azure Data Factory to consolidate data into MongoDB.
  • Used Python (Pandas) to transform and validate patient records for compliance.
  • Worked with IT teams to deploy pipelines on Azure, ensuring 99% data accuracy.
  • Optimized query performance, reducing report generation time by 10%.
  • Supported data scientists with data extracts for research purposes.

Technologies 

  • Azure Data Factory, Python, SQL, MongoDB, Azure, Pandas

Travel Data Processing Project - Thailand

Data Engineer, Mar 2021 - May 2022

Project description 

  • Supported a travel company with data processing for booking and customer analytics.  

Responsibilities

  • Developed Python scripts to process booking data from SQL Server.
  • Designed data pipelines to integrate data into Azure Data Lake.
  • Assisted in optimizing data storage for analytics.
  • Documented pipeline processes for team use.

Technologies

  • Python, SQL, SQL Server, Azure Data Lake

Logistics Data Optimization Project - India

Data Engineer, Jan 2020 - Feb 2021

Project description 

  • Optimized data processing for a logistics company to support route planning.  

Responsibilities

  • Developed Python scripts to process route data.
  • Integrated data into SQL Server for analysis.
  • Assisted in testing data pipeline stability.

Technologies

  • Python, SQL, SQL Server
Certifications

Python for Data Science and Machine Learning Bootcamp, 2022

English: Advanced  

  • IELTS 6.0

Navigating OurCooperation Models

We assess your needs first. Then, we will send you the top software engineer CV options so that you can select your favorite. The chosen engineer becomes part of your in-house team.

Ideal for businesses that:
Need specialized expertise but don't want to hire full-time staff
Want to scale resources up and down quickly
Require extra support for upcoming or ongoing projects
You can choose from our numerous software developer CV options. The selected developers form a dedicated team that works exclusively on your project. They also collaborate closely with your in-house team to achieve your goals.

Ideal for businesses that:
Require cost-effective and scalable solutions for large and long-term projects
Want to form a consistent team with excellent skills
Need a development team committed to their business goal
We define a clear path for your project. Since the project has clear timelines and scopes, you can control your budget better. You can also choose to work with a remote team or manage specialized technical roles.

Ideal for businesses that:
Have a set budget and clearly outline the project scope
Struggle with strict deadlines
Handle projects with clear goals, a detailed outline, and achievable milestones
How to Hire Top Developers from Saigon Technology?