Building Learning Data Assets – US
AI Engineer – Software Engineer, Jan 2025 – present
Project description
- Working on a team of 12 members.
- This project aims to build Learning Data assets used in every classroom across Ameria. The domain of this project is Education.
Responsibilities
- Integrated with Firecrawl, an AI crawler tool, to extract information from provided URL.
- Implemented APIs for the project.
- Developed background jobs and batch processing systems to enhance the performance of APIs.
- Integrated with AWS services such as AWS S3, AWS Lambda, AWS SES, ...
Technologies
- Programming: Python, NestJS, TypeScript
- AI integration: Firecrawl
- Deployment: Docker, docker-compose, AWS EC2, Lambda
Job Searching System and Career Pathway Building – US
Software Engineer, Feb 2024 – present
Project description
- Working on a team of 19 members including 1 PM, 4 Team Leaders, and 14 Developers.
- This project aims to develop an AI Process that predicts the Career Pathway from Live Job Postings of a list of companies. The domain of this project is Education.
Responsibilities
- Utilized selenium to crawl data from Google Jobs.
- Developed and maintained ETL pipelines to collect data from multiple data sources and integrated with external services.
- Leveraged LangChain, RAG, and OpenAI for predicting Career Pathway and suggesting education courses that are needed for user.
- Deployed the whole process using AWS Step Function and AWS Batch.
Technologies
- Programming: Python, Flask
- Database: PostgreSQL, Vector database
- AI integration: Langchain
- Deployment: Docker, docker-compose, AWS Step Function, AWS Batch
Crypto Trading Development Tools – Singapore
Software Engineer, Sep 2023 – March 2024
Project description
- Working on a team of 9 members including 1 PO, 3 Team Leaders, and 5 Developers.
- This project aims to develop tools that help developers to develop, summarize, and generate reports easily by using their prompt. It also helps to scan vulnerabilities in code.
Responsibilities
- Utilized Flask-Dash/Plotly, Javascript-ReactJS, and Websocket to build a Chat system.
- Leveraged LangChain and OpenAI for SQL generation and Code generation to assess trading strategy performance.
- Used OpenAI to scan the code and check the potential issues.
- Set up and deployed Jupyterlab, and CodeServer for easy development and debugging.
Technologies
- Web: Python - Dash/Plotly, Jinja2, and Javascript - ReactJS.
- Database: PostgreSQL - TimescaleDB, MongoDB, Redis.
- AI integration: Langchain, Sklearn.
- Deployment: Docker, docker-compose.
- Cloud: Google Cloud Platform.
Crypto risk analytics – Singapore
Software Engineer, May 2021 – Aug 2023
Project description
- Working on a team of 9 members including 1 PO, 3 Team Leaders, and 5 Developers
- This project aims to develop Live Trading and Data Visualization Systems that give users insight into prices and trends. Also supported them for auto trading with their strategy and back-testing algorithm on multiple exchanges like Binance, FTX, and Deribit... Save their time up to 40% instead of trading on each exchange. Primarily focused on Python, ReactJS, Dash/Plotly, pandas, SQL, and NoSQL.
Responsibilities
- Everything that matters in development.
- Team Leader who managed a team of 3 junior developers.
- Utilized Flask-Dash/Plotly and Javascript-ReactJS to build a comprehensive Data Visualization System, integrating LangChain for advanced AI capabilities in data analysis.
- Built a Back-testing algorithm based on user input.
- Used Sklearn and LinearRegression to predict the price
- Developed Airflow DAGs for crawling and processing data from several crypto exchanges like Binance, FTX, Deribit,...
- Handled Times-series data, and generated charts to visualize the crypto price data.
- Set up the CI/CD pipelines, monitoring, and logging server.
- Applied Tableau as a BI Tool.
Technologies
- Web development: Python - Dash/Plotly, Jinja2, and Javascript - ReactJS.
- Web server: gUnicorn, Nginx
- Database: PostgreSQL - TimescaleDB, MongoDB, Redis.
- AI integration: Langchain, Sklearn
- Data analytics libs: Pandas, Dash/Plotly.
- Deployment: Docker, docker-compose.
- Monitoring systems: ELK, cAdvisor, Prometheus, and Grafana.
- Cloud: Firebase, Google Cloud Platform.
- Handled Times-series data, and generated charts to visualize the crypto price data.
- Set up the CI/CD pipelines, monitoring, and logging server.
- Applied Tableau as a BI Tool.
- Built a mobile application parallel to the web application using React Native.
Chat Widget with AI – UK
Developer, November 2023 – March 2024
Project description
- Working on a team of 7 members including 1 Project Manager, 1 Product Owner, 1 Quality Assurance, 1 Quality Control, and 3 Developers.
- This project aims to develop a chatbot widget that could enhance user engagement and support capabilities on the existing website.
Responsibilities
- Researched and implemented best practices, new libraries, and frameworks to enhance development efficiency.
- Implemented RESTful APIs and Websocket using FastAPI for seamless and real-time communication between front-end and back-end systems.
- Collaborated with team members in development and communication to stay up-to-date on the project.
- Conducted thorough requirement analysis and actively fostered collaborative efforts within the team to find software solutions.
- Utilized Celery to orchestrate and manage periodic tasks for syncing data with external databases (Airtable).
- Applied Redis as a caching database in running cron jobs and storing temporary conversation data.
- Designed and implemented database schemas using PostgreSQL, optimizing query performance and data integrity...
- Implemented module chat using websocket in FastAPI.
- Conducted unit tests using Pytest and performed bug fixes to ensure software quality and stability.
- Integrated with an AI module (use Large Language Model with Langchain, GPT 3.5 Turbo, and GPT 4 with OpenAI) to handle incoming messages and responses to clients.
- Packaging the code using Docker and documenting the project.
Technologies
- Web development: Python, FastAPI, Jinja2.
- Development tools: Visual Studio Code
- Third-party services: OpenAI
- Others: Websocket, Docker, AWS ECS, AWS CloudWatch, AWS CodeCommit
Data Engineer for a bank – United States
Data Engineer, Sep 2022 – Sep 2023
Project description
- Working on a team of 6 members including 1 Scrum Master, 1 Product Owner, 1 Team Leader, and 3 Developers.
- This project aims to develop a data pipeline system that could automatically process all the data from bank partners and release the report results for them.
Responsibilities
- Developed and maintained Airflow DAGs for seamless data processing from various services and generation of comprehensive reports.
- Implemented Test-Driven Development (TDD) as a fundamental software development process while developing the feature.
- Successfully migrated and updated from the previous Airflow version to the latest release, ensuring compatibility and enhanced functionality.
- Implemented UI modifications utilizing Jinja2, JQuery, HTML, and CSS to enhance the report dashboard's performance and elevate the user experience.
- Integrated seamlessly with the data pipeline system with microservices, facilitating efficient data flow and enhancing overall system performance.
- Integrated seamlessly with the data pipeline system using LangChain-powered microservices, facilitating efficient data flow and enhancing overall system performance with advanced AI capabilities.
- Carried out regular system maintenance to ensure optimal performance and scalability.
Technologies
- Programming Languages: Python, Jinja2, JQuery
- Tools: Airflow, SQL, Docker, AWS ECR, AWS ECS, Kafka, Snowflake, SQL, Datadog, Slack notification.
Face recognizes and track person system – Viet Nam
Software Engineer, Aug 2022 – Sep 2023
Project description
- Working on a team of 6 members including 1 PM, 1 Team Leader, and 4 Developers.
- This project aims to develop a system to detect and recognize employees, collect employees' data, and support internal timekeeping systems.
Responsibilities
- Performed requirement analysis and collaborated with the team to design the software architecture for the application.
- Utilized Python with Django to build web applications, incorporating LangChain for advanced AI capabilities in face recognition and person tracking.
- Leveraged Langchain, OpenAI, and Python to build Chatbot to help summarize the report
- Integrated parallel processing which reduces task processing time by 30%.
- Set up ELK to optimize searching queries and monitor the logging.
- Set up Kafka to consume real-time messages.
- Set up CI/CD using the Bitbucket pipeline to automatically deploy the system.
- Used Apache Superset as a BI Tool to analyze data and generate reports
Technologies
- Web development: Python, Django, Django Rest Framework, and JQuery.
- AI Integration: LangChain
- BI Tools: Apache Superset
- Other tools: Visual Studio Code, JIRA,...
NFT Marketplace – VietNam
DevOps, Dec 2021 - Mar 2022
Project description
- Working on a team of 8 members including 1 PM, 4 Developers, 2 Devops, and 1 Tester.
- This project aims to develop a marketplace where users can buy, sell, and trade non-fungible tokens (NFTs) after they play a game
Responsibilities
- Collaborated with the development team to deploy the application on AWS.
- Utilized Terraform to set up and manage the project's infrastructure architecture on AWS.
- Set up AWS S3 for Storage, SES for sending Email, Route53 for DNS, and VPC for public and private networks.
- Configured GitLab CI for a CI/CD pipeline, integrating it with Terraform for automated builds and deployments.
Technologies
Phu Quoc Market – VietNam
Software Engineer, June 2020 – Mar 2021
Project description
- Working on a team of 5 members including 1 Tech Leader, and 4 Developers.
- This project aims to develop an e-commerce mobile application. Additionally, researched and developed AI modules, including 3D Clothes and a Virtual Assistant.
Responsibilities
- Designed and implemented the project architecture for web applications, messaging systems, and search engines, ensuring scalability and performance.
- Leveraged AI open sources such as Openpose, SMPL-X to generate 3D models
- Utilized RabbitMQ to enable real-time features such as community interactions, post updates, comment notifications, chat functionality, and user notifications.
- Implemented ELK stack (Elasticsearch, Logstash, and Kibana) to enhance product search capabilities and efficiency.
- Set up the docker stack and wrote the deployment script.
- Used Github Action to build the CI/CD pipeline.
Technologies
- Web development: NodeJS, Loopback 4 framework.
- Database: MySQL and ElasticSearch for databases.
- AI Integration: Tensorflow, Pytorch
- Messaging system: RabbitMQ.
- CI/CD tools: GitHub Action.
Crypto Subscriptions – United States
Developer, Dec 2021 – Aug 2022
Project description
- Working on a team of 2 members including 1 PM, and 1 Developer.
- This project aims to develop a system where users can buy crypto subscriptions and receive profit after a period of time.
Responsibilities
- Developed the Django backend server to create a robust and scalable RESTful API, ensuring efficient data processing and seamless integration with client applications.
- Conducted research and successfully implemented KYC (Know Your Customer) and MFA (Multi-Factor Authentication) functionalities to enhance system security and compliance.
- Integrated payment systems, Wyre and Plaid, enabling seamless and secure payment transactions within the application.
- Developed the ReactJS Front-End, and created dynamic UI to ensure an outstanding UX.
- Designed and implemented a cron job to handle subscriptions efficiently.
Technologies
- Backend: Python, Django, Django Rest Framework.
- Frontend: Javascript, React JS, HTML, CSS.
- E-KYC systems: Persona and then Sumsub.
- Payment systems: Wyre and Plaid.
Debugging Tool - Face Recognize System – Japan
Developer, June 2019 – May 2020
Project description
- Working on a team of 5 members including 1 Tech Leader, 3 Developers, and 1 Tester.
- This project aims to develop a dashboard to show images after getting from the Camera and processing from the AI module.
Responsibilities
- Developed the Flask backend server for Face Recognize System.
- Developed the Django backend server for Debugging Tool System.
- Set up docker and Azure Kubernetes Service cluster for deployment.
- Implemented GitHub Actions to set up a CI/CD pipeline for automated deployment processes.
Technologies
- Web development: Python, Flask, Django.
- CI/CD tools: Github Action
- Cloud: Azure Kubernetes Service,
Microsoft Inference IoT system – Japan
Developer, Dec 2018 – June 2019
Project description
- Working on a team of 4 members including 1 PM, and 3 Developers.
- This project aims at researching and implementing OPENVino on IoT devices (Raspberry Pi 3B+). It also integrates with Azure.
Responsibilities
- Researched OpenCV and OpenVino.
- Worked with PiCam to get streaming.
- Built Docker for Raspberry Pi.
- Set up automation with an ARM template (Azure Resource Manager).
- Set up and tried to deploy Kubernetes on-premises and Azure Kubernetes Service.
Technologies
- Programming Language: Python, C/C++.
- Cloud: Azure IoT Edge, Azure Container Registry, Azure Kubernetes Service, Azure blob storage, ...