Lead Data Engineer

Job Description

The ideal candidate will have a robust blend of technical mastery, leadership skills, and the ability to operate effectively in a collaborative environment.

Technical Expertise: Deep proficiency in Python and SQL is a must-have for this role. The Tech Lead must also have a strong understanding of big data technologies and cloud services, including Databricks, Spark, and Delta Lake. Experience with AWS services like S3, Lambda, and Redshift is essential. A solid grasp of DevOps practices, including CI/CD and experience with containerization (Docker) and orchestration (Kubernetes), is required for guiding the DevOps team member.  

Leadership and Soft Skills: Proven experience in leading and mentoring technical teams is critical. The candidate must possess strong communication skills to both guide engineers and explain technical concepts to non-technical stakeholders. Excellent problem-solving, project management, and conflict resolution abilities are also required. The capacity to foster a blameless culture, where team members can learn from mistakes without fear of judgment, is a key soft skill for this role.

Language Proficiency: Good verbal and written communication skills in English are required to effectively communicate with technical and non-technical stakeholders across the organization.

Job Responsibilities

The Tech Lead's responsibilities go beyond coding to encompass technical guidance, leadership, and proactive problem-solving to ensure the team's success and project delivery.

Technical Leadership and Architecture: Establish project specifications and technical direction, including making architectural and design decisions for data pipelines and the cloud infrastructure.

Team Guidance and Mentorship: Actively guide and mentor team members on technical matters, including code reviews, troubleshooting, and resolving complex technical issues.

Proactive Problem-Solving: Lead the team in identifying and resolving technical roadblocks and inefficiencies. The role demands a proactive mindset and the ability to stay calm and coordinate the team under pressure.

Stakeholder Communication: Serve as the primary technical liaison between the engineering team and stakeholders, including a key responsibility to maintain frequent and clear communication with the manager. The ability to articulate complex technical concepts to non-technical individuals is essential.

Project and Process Management: Manage the technical aspects of the project, balancing priorities and ensuring the team meets deliverables. This may include playing the role of a Scrum Master, leading stand-up meetings and facilitating agile ceremonies to streamline workflows.

Department/Project Description

The Tech Lead will oversee a team of Data Engineers and DevOps engineers, all with strong Python development skills. The primary objective is to drive the technical direction, development, and maintenance of the Client's cloud-first data platform, a key component of the client's developer ecosystem. This platform is the engine for monetizing APIs and enabling new business models. The team's work involves building and scaling robust data pipelines using a modern, cloud-native architecture. The project is focused on transforming how Clients's core intellectual property is delivered to developers, from traditional licensing to an agile, subscription-based service. The Tech Lead's work will directly support the development of data-driven products and services that deliver immersive experiences to millions of consumers.