Crawling/Scraping Expert with experience in Node.js
We are looking for a Crawling/Scraping Expert with experience in Node.js to join our technical team to enhance and scale our data collection systems in the field of price intelligence and e-commerce monitoring.
The successful candidate will be responsible for designing, developing and maintaining high-performance, resilient crawlers capable of acquiring large volumes of data from e-commerce sites in a structured and scalable manner.
Proven experience in web scraping/crawling is required, with a particular focus on anti-bot management, IP rotation and dynamic parsing.
A technical test will be required during the selection process.
The candidate will be part of the data team in full-time mode (8 hours/day).
It is assumed that this will be the candidate's only job; no secondary or freelance work is permitted during our collaboration.
Main responsibilities
- Develop and maintain crawlers in Node.js to acquire structured data from e-commerce and marketplaces.
- Manage anti-bot systems (CAPTCHA, honeypots, rate-limiting).
- Implement proxy rotation, user-agent management, and retry mechanisms.
- Monitor the stability of scraping jobs and intervene in case of errors or crashes.
- Collaborate with the data engineering and operations team to ensure the quality and timeliness of the data collected.
Minimum requirements
- Proven experience in web scraping/crawling, with portfolio or examples of real projects.
- Excellent knowledge of Node.js and its crawling libraries (e.g. Puppeteer, Cheerio, Playwright, Axios, etc.).
- Experience in managing proxies, headless browsers, and anti-detection techniques.
- Ability to write modular, reusable and maintainable code.
- Excellent knowledge of relational databases.
- Autonomy in debugging and solving complex problems.
Preferred requirements
- Knowledge of other languages used in crawling (e.g. Python).
- Familiarity with NoSQL databases (ElasticSearch, Redis).
- Experience in SaaS environments or technology start-ups.
Selection process
The process includes:
- Introductory interview.
- Technical test on a real scraping case (estimated time: 2 hours).
- Final technical interview with the team.
Required languages
English | B1 - Intermediate |