Company Description

About Grab and Our Workplace

Grab is Southeast Asia's leading superapp. From getting your favourite meals delivered to helping you manage your finances and getting around town hassle-free, we've got your back with everything. In Grab, purpose gives us joy and habits build excellence, while harnessing the power of Technology and AI to deliver the mission of driving Southeast Asia forward by economically empowering everyone, with heart, hunger, honour, and humility.

Job Description

Get to Know the Team

The POI team is part of the Grab Geo department. We will build the POI data system for Southeast Asia and important geo-services including search, recommendation, geocoding, and reverse geocoding, which support all of Grab's businesses across ride-hailing, food delivery, and payments.

Get to Know the Role

We are looking for a Web Crawler Engineer. In the digital age, using online resources is necessary for building vibrant, rich, and high-quality map data. We need your expertise to help us construct this essential platform and deliver a world-class Map Making service.

The Critical Tasks You Will Perform

1. Take ownership of designing, architecting, and implementing a available, scalable, distributed POI data collection platform to reliably support massive data crawling from web and mobile sources.
2. Analyze and solve fundamental challenges within the crawler system, including bypassing anti-crawling mechanisms (e.g., dynamic encryption, behavioral verification, login), distributed task scheduling, million-level concurrency control and cost optimization.
3. Explore and implement modern technologies like LLMs in scenarios such as intelligent parsing, adaptive anti-crawling strategies, and data quality validation to improve collection efficiency, reduce costs, and enhance data quality.
4. Technology Planning & Innovation: research industry trends, conduct technology prototypes, introduce new technologies to the team, and contribute to the long-term technical roadmap.

Qualifications

What Essential Skills You Will Need

Required skills:

1. Bachelor's degree or higher in Computer Science or a related field. 1+ years of experience in web crawling or data collection, with architecture design experience for medium/large-scale distributed crawler systems.
2. Proficiency in at least one of Python, Go, or Java, with a deep understanding of their asynchronous programming, concurrency models, and performance optimization. Mastery of mainstream crawler frameworks and tools like Scrapy, Playwright, Selenium, including their principles and applications.
3. In-depth knowledge of HTTP protocols, Javascript, web security mechanisms, and various anti-crawling techniques. Proven track record of solving complex challenges like dynamic content loading, CAPTCHA solving, and login simulation.
4. Experience with data parsing, cleaning techniques, and related toolchains e.g. Presto, Spark. uild automated data pipelines.
5. Personal Attributes: Strong technical curiosity, exceptional self-learning ability, resilience in tackling challenging problems, and excellent teamwork and communication skills.

Bonus Points:

• Deep understanding of LLM technology with hands-on experience applying it to data collection or processing projects.
• Experience with mobile reverse engineering or protocol analysis.
• Deep understanding of the mapping industry and POI data.

Additional Information

Life at Grab

We care about your well-being at Grab, here are some of the global benefits we offer:

• We have your back with Term Life Insurance and comprehensive Medical Insurance.
• With GrabFlex, create a benefits package that suits your needs and aspirations.
• Celebrate moments that matter in life with loved ones through Parental and Birthday leave, and give back to your communities through Love-all-Serve-all (LASA) volunteering leave
• We have a confidential Grabber Assistance Programme to guide and uplift you and your loved ones through life's challenges.
• Balancing personal commitments and life's demands are made easier with our FlexWork arrangements such as differentiated hours

What We Stand For at Grab

We are committed to building an inclusive and equitable workplace that enables diverse Grabbers to grow and perform at their best. As an equal opportunity employer, we consider all candidates fairly and equally regardless of nationality, ethnicity, religion, age, gender identity, sexual orientation, family commitments, physical and mental impairments or disabilities, and other attributes that make them unique.