Oct 2021 – Feb 2026
Technical Manager
HCL Technologies Vietnam
- Maintained and enhanced the ETL platform that brings together data from more than 50 source systems, built on Hive, PySpark, Sqoop, Python, IBM DataStage and Control-M and running on a 63-DataNode Hadoop 3 cluster with 900+ TB in HDFS. Data quality checks and performance tuning kept the jobs within their operational SLAs.
- Took ownership of problem tickets for a team of about 10. With structured tracking in Confluence and a weekly review, the backlog went from over 100 open tickets to a steady 10 or so within three months.
- Tracked down and permanently fixed a long-standing production job failure that was hard to reproduce, working it out from how the platform behaves because the logs offered no direct evidence.
- Reviewed implementation plans, test summary reports and code before approving production deployments, including for other squads that depend on the platform.
- Designed and built a Python ETL monitoring system from scratch on top of Oracle, replacing manual job-status checks with an automated daily report to the operations team.
- Mentored newly onboarded engineers and led code reviews in a 12-person Scrumban squad with a Product Owner and Scrum Master, coordinating priorities with other squads.
Tools: #hadoop, #hive, #pyspark, #sqoop, #python, #ibm datastage, #control-m, #oracle






