Backend Developer Node Offline
Job Overview
We're looking for an experienced developer to help us launch, maintain & scale our headful chrome farm. We've started building it out - but it's (mostly) in a nonworking state at the moment. Hoping you can come in and clean up our mess
Context
Our GPU Farm leverages a single AWS G4dn.xlarge instance with an NVIDIA T4 GPU, orchestrated through Docker Compose.Currently, the system hosts four Chrome instances.
- AWS Instance: Single G4dn.xlarge with NVIDIA T4 GPU
- Container Management: Docker Compose
- OS: Ubuntu 22.04 with NVIDIA drivers
Tech Stack:
- Containers: Docker Compose managing Chrome, Node.js API, Next.js frontend, and Nginx
- Backend API: Express.js with SQLite
- Frontend Dashboard: Next.js 14, TypeScript, Tailwind CSS
- Proxy Solution: Node.js proxy-chain
- Browser Automation: Chrome DevTools Protocol (CDP)
- Remote Browser Viewing: noVNC
- CAPTCHA Handling: Integrated with 2Captcha
How the System Works
- Chrome Containers: Each runs Chrome with GPU acceleration, proxy-chain server, and VNC server for remote viewing.
- Task Flow: API receives automation tasks, assigns tasks to available Chrome instances, and provides CDP endpoints.
- Proxy Management: Individual proxy-chain servers authenticate and manage proxy IPs via SmartProxy.
- Profile Rotation: Automatic management and rotation of browser profiles with fingerprinting.
- GPU Utilization: Shared GPU resource management across multiple Chrome containers.
Skills Required
- Strong expertise in Docker and Docker Compose
- Proficiency with Node.js and Express.js
- Extensive experience with AWS EC2,
- Linux system administration
- Familiarity with Git/GitHub workflows
- Experience with Chrome DevTools Protocol (CDP)
Preferred Skills:
- Background in web automation/scraping
- Next.js or React experience
- nginx configuration experience
We offer:
- Cooperation with a stable company with well-established processes and a positive atmosphere
- Experience in project management of different levels of complexity, methodology, and approaches
- Flexible schedule: Mon-Fri (8 hours a day)
- 18 days of paid vacation; 15 days sick leave
- A decent level of remuneration with regular reviews of the results of cooperation
- Extensive loyalty program
Required skills experience
| Node.js |
Required languages
| English | B2 - Upper Intermediate |
The job ad is no longer active
Look at the current jobs Node.js →