Spider / Scraper Team Lead

We are seeking an experienced Spider / Scraper Team Lead to take full ownership of the scraping ecosystem behind our international SaaS platform.
 

This is a fully remote leadership role with significant responsibility. You will define technical structure, set direction, and ensure that our scraping infrastructure is stable, scalable, and performance-driven. The role combines hands-on technical expertise with team leadership and operational accountability.
 

Responsibilities

  • Lead and manage the spider/scraper team, including coordination with QA
  • Define and prioritize the technical roadmap
  • Ensure system stability, scalability, and performance across markets
  • Monitor KPIs and proactively identify and resolve bottlenecks
  • Improve architecture, infrastructure, and development processes
  • Mentor developers and elevate technical standards within the team
  • Take full accountability for scraping operations and output quality

     

This role goes beyond writing spiders. You will lead both the technical systems and the people responsible for them.
 

Qualifications

  • Strong Python skills and advanced web scraping expertise
  • Experience working with large-scale scraping infrastructure
  • Deep understanding of proxies, anti-bot strategies, scaling, monitoring, and performance optimization
  • Proven leadership experience managing developers or technical teams
  • Experience structuring workflows and improving operational performance
  • Fluent English (written and spoken)
  • Strong remote communication and documentation skills

     

We are looking for someone with demonstrated experience leading and scaling technical teams - not a solo contributor without leadership background.
 

Work Setup

  • 100% remote
  • International team environment
  • Open to contract/freelance arrangements
  • Required time zone overlap with Europe
     

What We Offer

  • Ownership of a critical SaaS infrastructure
  • Direct impact on product performance and revenue
  • Autonomy and decision-making authority
  • Fast execution and flat organizational structure
  • Opportunity to expand into broader technical leadership
  • Competitive compensation based on experience
     

Application

To apply, please send:

  • CV
  • A brief description of scraping teams you have led
  • Examples of infrastructure you have built, scaled, or improved

Required languages

English C1 - Advanced
Published 16 February
9 views
ยท
1 application
To apply for this and other jobs on Djinni login or signup.
Loading...