Meet Nguyen Cong Khoa: The DevOps Expert and Data Scraping Pro with 14+ Years of Experience

Introduction

At Glinteco, innovation and expertise go hand in hand. Today, we shine the spotlight on Nguyen Cong Khoa, a versatile DevOps Engineer and professional data scraper with over 14 years of experience. Known for his proactive, detail-oriented, and hard-working nature, Khoa is not only a master of DevOps but also a seasoned expert in data scraping, with a bag of tricks to bypass bot detection and reCAPTCHA challenges.

A Versatile Skill Set

Graduating from the Hanoi University of Science and Technology with a degree in Applied Mathematics and Informatics, Khoa has cultivated a rich career spanning DevOps, system architecture, and data scraping. His diverse experience has shaped him into a problem-solver who thrives on tackling complex technical challenges.

Key Highlights of Khoa’s Expertise

DevOps Mastery: Proficient in tools like Docker, Ansible, Terraform, and GitLab.Github CI/CD for efficient system deployments.
AWS and Cloud Services: Skilled in building pipelines, APIs, and services in cloud environments.
Data Scraping Specialist: Developed advanced techniques to bypass bot detection mechanisms like reCAPTCHA, ensuring efficient and undetectable data extraction.

Glinteco Contributions

Since joining Glinteco, Khoa has been instrumental in advancing both our DevOps infrastructure and our data scraping capabilities. His deep understanding of backend systems and proactive mindset have been invaluable in delivering robust solutions for clients.

Notable Achievements at Glinteco

DSTax.com: Architected and deployed a microservices-based tax integration platform, optimizing performance with Kubernetes and Prometheus.
Endeverus.com: Designed CI/CD pipelines for smooth feature rollouts and enhanced system reliability. Built a Celery Worker auto-scaling system and implemented logging integration with Datadog.
STLPro.com: Designed and implemented advanced bots using Playwright, Selenium, and Puppeteer for automating tasks like auto-purchase, shipping tracking, order fulfillment, and email notifications in Amazon Shop.
Matomo Tracking System: Set up a scalable Matomo tracking system using Docker and Nginx, dynamically scaling from 1 to 4 web tracking apps to handle 50 million actions per month. Also configured GitHub CI/CD for automated deployments.
Data Scraping Expertise: Implemented sophisticated strategies to bypass reCAPTCHA and bot detection for projects requiring large-scale data collection.

Pro Tips from Khoa: Avoiding Bot Detection

Khoa’s experience in data scraping has equipped him with advanced strategies to overcome challenges like bot detection and reCAPTCHA. Here are a few insights he often shares:

Dynamic User-Agent Rotation: Prevents detection by mimicking different devices and browsers.
Proxy Management: Utilizes rotating proxies to distribute requests across multiple IPs.
Headless Browsers: Leverages tools like Selenium and Playwright to simulate human-like interactions.
Reverse Engineering Mechanism: Applies hacky code snippet to bypass advanced CAPTCHA mechanisms.
Rate Limiting Awareness: Keeps request rates in line with acceptable thresholds to avoid triggering bot defenses.

The Personality Behind the Expertise

Khoa’s technical skills are complemented by his standout personality traits: flexibility, responsibility, and honesty. His detail-oriented approach ensures that every aspect of a project is optimized, while his proactive mindset drives innovation across the board.

Conclusion

Nguyen Cong Khoa’s dual expertise in DevOps and data scraping makes him a unique and invaluable member of the Glinteco team. Whether it’s deploying scalable systems or tackling reCAPTCHA challenges, Khoa’s skills and dedication set him apart as a leader in his field.

Stay tuned for more stories about the incredible individuals who power Glinteco’s success!