Senior Backend / Automation Engineer

Senior Backend / Automation Engineer — Data Intelligence Platform

Qail Labs Inc | Remote | Contract-to-hire

We're building a social media intelligence platform that collects and analyzes public content across audience segments in real time. We need an engineer who can own the infrastructure, data collection pipeline, and backend.

What you'll do

Build and maintain the data collection infrastructure: provisioning servers, managing browser-based scrapers, and automating data pipelines at scale. Design the backend API, data storage layer, and integrate with the Next.js dashboard. Monitor system health and scale from prototype to production.

Must have

• Python (FastAPI or similar async framework)
• Browser automation at scale (Playwright, Puppeteer, or Selenium)
• Residential proxy management — rotation strategies, sticky sessions, IP health monitoring
• Web scraping at production scale — handling rate limits, retries, and data quality
• CAPTCHA solving service integration (2Captcha, CapMonster, or similar)
• Docker / Docker Compose on bare metal or cloud (Hetzner, AWS, etc.)
• PostgreSQL and Redis

Strong plus

• LLM API integration (OpenAI, Gemini, DeepSeek)
• Next.js / React
• Experience with social media data collection
• Disposable email/phone verification pipelines

How we work

Small team, milestone-based delivery with live demos. You'll work directly with the founder. We move fast and ship weekly.

Compensation

Competitive, based on experience. Contract starting immediately with path to ongoing engagement.