Backend Developer Node Offline

Job Overview
We're looking for an experienced developer to help us launch, maintain & scale our headful chrome farm. We've started building it out - but it's (mostly) in a nonworking state at the moment. Hoping you can come in and clean up our mess 

Context
Our GPU Farm leverages a single AWS G4dn.xlarge instance with an NVIDIA T4 GPU, orchestrated through Docker Compose.Currently, the system hosts four Chrome instances.

- AWS Instance: Single G4dn.xlarge with NVIDIA T4 GPU
- Container Management: Docker Compose
- OS: Ubuntu 22.04 with NVIDIA drivers

Tech Stack:
- Containers: Docker Compose managing Chrome, Node.js API, Next.js frontend, and Nginx
- Backend API: Express.js with SQLite
- Frontend Dashboard: Next.js 14, TypeScript, Tailwind CSS
- Proxy Solution: Node.js proxy-chain
- Browser Automation: Chrome DevTools Protocol (CDP)
- Remote Browser Viewing: noVNC
- CAPTCHA Handling: Integrated with 2Captcha

How the System Works
- Chrome Containers: Each runs Chrome with GPU acceleration, proxy-chain server, and VNC server for remote viewing.
- Task Flow: API receives automation tasks, assigns tasks to available Chrome instances, and provides CDP endpoints.
- Proxy Management: Individual proxy-chain servers authenticate and manage proxy IPs via SmartProxy.
- Profile Rotation: Automatic management and rotation of browser profiles with fingerprinting.
- GPU Utilization: Shared GPU resource management across multiple Chrome containers.

Skills Required
- Strong expertise in Docker and Docker Compose
- Proficiency with Node.js and Express.js
- Extensive experience with AWS EC2,
- Linux system administration
- Familiarity with Git/GitHub workflows
- Experience with Chrome DevTools Protocol (CDP)

Preferred Skills:
- Background in web automation/scraping
- Next.js or React experience
- nginx configuration experience

We offer:

  • Cooperation with a stable company with well-established processes and a positive atmosphere
  • Experience in project management of different levels of complexity, methodology, and approaches
  • Flexible schedule: Mon-Fri (8 hours a day)
  • 18 days of paid vacation; 15 days sick leave
  • A decent level of remuneration with regular reviews of the results of cooperation
  • Extensive loyalty program 

Required skills experience

Node.js

Required languages

English B2 - Upper Intermediate

The job ad is no longer active

Look at the current jobs Node.js →

Loading...