Senior Kotlin ETL Developer IRC259282
Description
GlobalLogic seeks an experienced Software Engineer to help us improve and develop the new modern personalized digital platform. Every developer in our team has an opportunity to make a tremendous impact. We seek innovative and passionate developers who want to take ownership of features and projects and collaborate with other developers and product managers to evaluate, design, and implement from top to bottom. We will provide opportunities to work with cutting-edge technology that helps millions of people save their/money.
We seek creative and motivated engineers to work on our digital coupon solution. There are a wide variety of challenges that have been and still need to be solved. You will have opportunities for growth and development. You will be part of a team that works on services that have saved over 1 billion coupons.
Requirements
- Strong proficiency in Kotlin (or Java / Scala) for ETL development, with experience in designing and maintaining scalable data pipelines and frameworks.
- Experience designing, implementing, and optimizing data solutions and ETL processes.
- Extensive experience with SQL, including database design, optimization, and performance tuning, with proficiency in Snowflake and PostgreSQL.
- Hands-on experience with Python for data manipulation, scripting, and automation tasks, with the ability to integrate with APIs and external data sources.
- Experience working with cloud platforms such as Microsoft Azure, including services like Azure Data Lake Storage, Azure SQL Database, and Azure Databricks.
- Proficiency in utilizing Databricks for data engineering tasks, such as data ingestion, processing, and analytics, leveraging distributed computing capabilities.
- Strong understanding of version control systems, particularly git, and experience implementing best practices for collaboration and code management.
- Excellent communication and collaboration skills, with the ability to effectively engage with clients, understand their needs, and translate them into technical solutions.
- Demonstrated leadership abilities with a track record of leading complex data engineering projects in a client-facing capacity.
- Strong problem-solving skills with the ability to analyze complex data challenges and develop innovative solutions.
Job responsibilities
- Lead the design, development, and maintenance of our Data Warehouse, ensuring it exposes the right data to the right clients, whether internal or external, while maintaining high performance, reliability, and scalability.
- Architect and optimize our internally developed Data Pipeline Framework, using Kotlin, to efficiently import and/or export data from our internal and external clients, ensuring data integrity, timeliness, and ease of use.
- Collaborate closely with cross-functional teams and clients to understand business requirements, identify data sources, and design data models and schemas to support analytical and reporting needs.
- Develop and maintain ETL processes using Kotlin, SQL, and Python, ensuring data accuracy, completeness, and timeliness.
- Design and implement data solutions using Snowflake and PostgreSQL, optimizing database performance, and ensuring data integrity and security.
- Utilize Microsoft Azure services for cloud infrastructure, data storage, and processing, ensuring scalability, reliability, and cost-effectiveness.
- Utilize Databricks for data engineering tasks, such as data ingestion, processing, and analytics, leveraging distributed computing capabilities to handle large volumes of data efficiently.
- Implement version control and collaboration best practices using git, ensuring code quality, traceability, and reproducibility of data engineering workflows.
- Provide technical leadership and mentorship to junior members of the data engineering team, guiding them in best practices, design principles, and client engagement.
- Stay abreast of industry trends, best practices, and emerging technologies in data engineering and analytics, advocating for their adoption where appropriate.