Data Engineer for an US bank – United States
Developer, Sep 2022 – Present
Project description
- Working on a team of 6 members including 1 Scrum Master, 1 Product Owner, 1 Team Leader, 3 Developers.
- This project aims to develop a data pipeline system that could automatically process all the data from bank partners and release the report result for them.
Responsibilities
- Develop the Airflow DAGs for processing data from other services and releasing the report.
- Test, fix issues, and maintain the system.
- Migrate the old system to the new airflow version.
- Modify UI for the report dashboard.
- Integrate the Data Pipeline system with microservice.
Technologies
- Airflow, SQL, Docker, AWS ECR, AWS ECS, Kafka, Snowflake, SQL, Datadog, Slack notification.
Face Attendance Application – UK
Team Leader, May 2022 – Dec 2022
Project description
- Working on a team of 5 members including 1 Team Leader, 4 Developers.
- This project aims to develop a Deep Learning and Webapp system to track employee attendance using facial recognition technology.
Responsibilities
- Design and develop the entire system.
- Research, develop and integrate the Deep Learning models for Face Detection and Recognition tasks.
- Join to review the Django backend and UI template.
- Create the collecting sample tool, feature data and feature store system.
Technologies
- Python, Deep Learning model, Web App.
- Jetson Device, Pytorch, Onnx, Linux, Docker, Kafka, Django, RTSP stream, Websocket IO.
Object Analysis on Camera for Web browser – Vietnam
Team Leader, Feb 2022 – Apr 2022
Dialogflow Chatbot – Australia
Developer, Apr 2022 – May 2022
Project description
- Working on a team of 2 members including 1 PM, 1 Developer.
- This project aims at developing a Q&A chatbot using DialogFlow service, then integrating it into the Zoho platform for website integration and chat management.
Responsibilities
- Build Question and Answer dataset.
- Clean, process and improve the dataset.
- Build a Chatbot using DialogFlow.
- Integrate DialogFlow chatbot into Zoho platform.
Technologies
Object Analysis on Camera for Web browser – Vietnam
Team Leader, Feb 2022 – Apr 2022
Project description
- This project aims at developing a system that could analyse the Object directly on the Camera of Web browser in real time.
Responsibilities
- Develop the Flask backend server for RESTful API.
- Apply the Image Processing algorithms.
- Research and develop the Object Detection, Object Recognition models.
- Maintain, deploy the system, fix issues.
- Maintain, optimize and improve the system performance and speed.
Technologies
- Python, Computer Vision, Image Processing.
- Tensorflow/ Tflite/ Flask.
Semantic Search for Travel Place – Vietnam
Team Leader, Jan 2022 – Feb 2022
Project description
- This project aims at developing a Semantic Searching Engine that could search with meaning not only to find keywords but also to determine the intent and contextual meaning of the input sentence.
Responsibilities
- Develop the Flask backend server for RESTful API.
- Crawl and process, clean the article dataset from the internet.
- Research and build the Text Embeddings model, Text similarity algorithms.
- Maintain, deploy the system, fix issue
- Maintain, optimize and improve the system performance.
Technologies
- Pandas, NLP, Docker, Pytorch, Flask.
Optical Character Recognition for Prescription image – Vietnam
Team Leader, Dec 2021 – Jan 2022
Project description
- This project aims at developing an Optical Character Recognition system that can detect the text regions on a natural image and then convert them to the necessary text information.
Responsibilities
- Develop the Flask backend server for RESTful API.
- Maintain, deploy the system, fix issues.
- Maintain, optimize and improve the system performance.
Technologies
- Python, Image Processing, Computer Vision, NLP.
- Streamlit, Pytorch, OpenCV, Docker, Nginx, Flask.
Text Summarization System – Japan
Team Leader, Nov 2021 – Dec 2021
Project description
- This project aims at developing a system that could use Bot Scraper to crawl data from the internet and then applying AI models to generate the new text from the scraped data.
Responsibilities
- Build and deploy Google Cloud Run service for crawling data from the internet.
- Build and deploy Google Cloud Storage, Firestore, Cloud Fusion, Cloud Dataproc, Cloud BigQuery and Cloud Data Studio for ETL, Analyzing Data.
- Build and deploy some Google Cloud Functions into Google Cloud Workflow service for executing the system.
- Develop the flask backend server for RESTful API.
- Join to support maintain the system, fix issue
- Maintain, optimize and improve the system performance.
Technologies
- Python, NLP, Data Engineer, SQL, ETL process.
- Google Cloud Platform, PySpark, Pytorch, Flask.
Classification Model for Customer Reviews– Japan
Team Leader, Sep 2021 – Oct 2021
Project description
- This project aims at developing a Cloud system that could ETL Customer Reviews and classify these reviews to good or bad reviews.
Responsibilities
- Build and Deploy AWS services: Amazon S3 Data Lake for storing the reviews data, Amazon Athena, Amazon Glue, Amazon QuickSight, Amazon SageMaker for ETL data, Analysing Data, creating classification model and deploying them.
- Develop the flask backend server for RESTful API.
- Join to support, maintain the system, fix issues.
- Maintain, optimize and improve the system performance.
Technologies
- Python, NLP, Data Engineer.
- SQL, ETL process, AWS, Flask.
Synthetic Face to Real Face Conversion – Japan
Team Leader, May 2021 – Sep 2021
Project description
- This project aims at developing a GAN model to convert the synthetic face made by a 3D face generation tool to the real similar face.
Responsibilities
- Develop AI models for problems: GAN, Image Processing.
- Optimize and improve the model performance.
Technologies
- Python, Computer Vision, GAN.
Technology Recommendation System – Japan
Team Leader, Apr 2021 – May 2021
Project description
- This project aims at developing a backend server for deploying document data crawler bot, recommendation AI model and clustering model for text search.
Responsibilities
- Develop a backend flask server.
- Build a data crawler tool.
- Develop recommendation model, data clustering model.
Technologies
- Python, NLP, Flask, Serverless.
- PostgreSQL Database, Data Crawler, Data Clustering model.
AI Models Exchanging System – Japan
Team Leader, Feb 2021 – Apr 2021
Project description
- This project aims at developing a backend server for clients to design, manage, buy, and purchase AI models together.
Responsibilities
- Develop the backend server for RESTful API.
- Applying microservices architecture, applying Factory design pattern method
Technologies
- Firebase, MySQL Database, Microservices, Docker.
Customer Behaviour Analysis System – Japan
Team Leader, Sep 2020 – Feb 2021
Project description
- This project aims at developing a system containing a variety of applications such as people counting, customer behaviour recognition, face recognition, pose estimation.
Responsibilities
- Develop AI models for problems: object detection, pose estimation.
- Integration of all components into the system.
Technologies
- Python, Computer vision, ML, DL.
- OpenCV, Tensorflow, Pytorch.
Image Debugging Server – Japan
Developer, Jul 2020 – Sep 2020
Project description
- This project aims at developing a debugging server to receive data from Camera IP and show results on the web interface.
Responsibilities
- Develop a backend server to receive image and annotation data from Camera IP through TCP socket, process them and show results on the web interface.
Technologies
- Python, OpenCV, Machine Learning.
- Django, RESTful API, PostgreSQL Database.
Object Detection System – Japan
Team Leader, Mar 2020 – Jul 2020
Project description
- This project aims at developing a Face, Head, Hand and Person detection system to detect where the face, head, hand or person bounding boxes are in a natural image or video.
Responsibilities
- Develop AI models for problems: object detection, model optimization.
- Optimize models to be small enough without reducing performance for running on hardware and mobile devices.
Technologies
- Python, Computer vision, ML/DL.
- OpenCV, Tensorflow, Tflite, MNN.
Game Card Classification in Mobile App – Vietnam
Team Leader, Jan 2020 – Mar 2020
Project description
- This project aims at developing some AI models integrating in the Mobile Application.
Responsibilities
- Crawl and process game card dataset from the internet.
- Develop AI models for problems: image classification, image verification, model optimization.
- Develop AI models and apply Image processing for some image transferring filters.
- Optimize model to be small enough without reducing performance for deploying on mobile devices.
- Research React Native modules for deploying models on mobile devices.
- Build Django web server for serving RESTful API.
Technologies
- Python, Image Processing, Deep Learning.
- Tensorflow, Tflite, Tfjs, Django, Scrappy.
Age and Gender Recognition System – Japan
Team Leader, Apr 2019 – Jan 2020
Project description
- This project aims at developing an Age and Gender recognition system to recognize age and gender of humans in natural image or video.
Responsibilities
- Develop Ai models for problems: Multitask CNN, age and gender recognition.
Technologies
- Python, Computer vision, ML/DL.
- OpenCV, Tensorflow, Pytorch.
Virtual Assistant in healthy childcare application – Vietnam
Developer, Dec 2018 – Apr 2019
Project description
- This project aims at developing a virtual assistant app which assists parents in taking care of and monitoring their children's health.
Responsibilities
- Investigate and build Chatbot core.
- Build back-end server and deploy on AWS
Technologies
- Signal Processing, Restful web services.
Maintenance Chatbot – Singapore
Developer, Jul 2018 – Dec 2018
Project description
- This project aims at developing a question-and-answer Chatbot for a Singapore service company.
Responsibilities
- Investigate to build a Chatbot to classify intents and extract entities.
- Investigate Google Cloud Platform.
Technologies
- Python, NodeJS, RESTful web services, Google Cloud Platform.
- Tensorflow, Natural Language Processing, ML/DL.
Azure Chatbot – Vietnam
Developer, May 2018 – Jul 2018
Project description
- This project aims at developing a question-and-answer Chatbot in an application for companies and organizations.
Responsibilities
- Investigate to build a Chatbot to classify intents and extract entities.
- Investigate to deploy Chatbot in MS Teams, WebApps, Microsoft Powerapps.
Technologies
- Python, NodeJS, RESTful web services, Microsoft Azure Services.
- Tensorflow, Natural Language Processing, ML/DL
Face Detection and Recognition System – Vietnam
Developer, May 2017 – May 2018
Project description
- This project aims at developing a computer vision application to detect and recognize Human faces in image.
Responsibilities
- Investigate to build a binary CNN model for Facial detection and recognition.
- Build a two stream CNN model to predict Face bounding box and Face ID.
Technologies
- Python, Image Processing, OpenCV.
- Google Collab, Tensorflow, Keras.
