Python Web Scraping Engineer

We are looking for an experienced Python Web Scraping Engineer to build and maintain scalable data extraction systems. You will develop robust web scrapers, automate data collection workflows, and help create market intelligence solutions by aggregating and analyzing large volumes of web data.

Responsibilities

• Design, develop, and maintain web scraping solutions using Python.
• Extract, process, and validate data from multiple web sources.
• Handle website protection mechanisms and ensure scraper reliability.
• Integrate and manage residential proxy solutions.
• Build automated data pipelines and load data into BigQuery.
• Deploy and monitor scraping services using Google Cloud Run.
• Optimize scraper performance, scalability, and data quality.
• Collaborate with stakeholders to define data collection requirements.

Requirements

• 2+ years of commercial experience with Python.
• Proven experience building and maintaining web scrapers.
• Strong understanding of HTTP, HTML, CSS Selectors, XPath, and web technologies.
• Experience with scraping frameworks and tools such as Scrapy, Playwright, Selenium, BeautifulSoup, or similar.
• Experience working with proxy networks and IP rotation.
• Solid SQL skills and experience with BigQuery or other data warehouses.
• Experience with cloud platforms, preferably Google Cloud Platform (GCP).
• Ability to troubleshoot, optimize, and maintain large-scale scraping operations.
• Intermediate or higher English level.

Nice to Have

• Experience with Scrapling.
• Experience deploying applications with Google Cloud Run.
• Docker and containerization experience.
• Experience building ETL/data pipeline solutions.
• Familiarity with data analytics and market intelligence projects.

What We Offer

• Competitive compensation.
• Fully remote work environment.
• Flexible working hours.
• Opportunity to work on large-scale data collection and analytics projects.
• Direct impact on technical decisions and system architecture.

We are an innovative company in the digital entertainment space (short drama series), specializing in next-generation short-form video content. Having already achieved millions of downloads, we are rapidly gaining traction in the global market.

We are cracking the formula for the next dominant entertainment format — mobile-first micro-series. In a market already generating over 2.3B downloads, the company broke into the US Top 10 highest-grossing apps in under a year (while still in stealth mode), by combining Hollywood-grade production with an AI-driven engine that continuously optimizes storytelling for retention, engagement, and monetization.

We are a startup that has already raised millions in funding.