Data Engineer Offline

Your typical day:

Create and maintain optimal data pipeline architecture

Assemble large, complex data sets that meet functional / non-functional business requirements

Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.

Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and big data technologies

Create data tools for analytics and data scientist team members that assist them in building and optimizing our product

 

Requirements

Advanced working SQL knowledge and experience working with relational databases, working familiarity with a variety of databases

Experience building and optimizing ‘big data’ data pipelines, architectures and data sets

Experience in software developmen 4+ years

Experience in database management 2+ years

Practical experience with high-level programming languages: Python, Java, C++, Scala, etc.

Big Data tools: Hadoop, Spark, Kafka, etc.

Data pipeline and workflow management tools: Azkaban, Luigi, Airflow, etc.

AWS cloud services: EC2, EMR, RDS, Redshift

Stream-processing systems: Storm, Spark-Streaming, etc.

NoSQL databases: MongoDB, Cassandra, HBase

Building microservices and containerized applications: Docker, k8s

Understanding of the ETL process

Understanding of software development process, Agile approach, and CI/CD

Degree in computer science or related field

Upper-Intermediate English level or higher

 

Nice to have:

Experience with mining of structured, semi-structured, and unstructured data

Applied statistics skills, such as distributions, hypothesis testing, regression analysis, etc.

RESTful API creation in Python (Flask, Falcon or similar)

Experience with data visualization tools, such as Ggplot2, Plotly, Matplotlib

 

Benefits

Friendly and highly professional team

Flexible working hours

20 working days of paid vacation

English lessons and English speaking club with a native speaker

Modern comfortable office with all amenities

15 days of paid sick leave

Relax zone (including a terrace with a barbecue in summer)

Yoga classes

Lectures and after-work activities

Snacks and fruit in the office kitchen:)

The job ad is no longer active
Job unpublished on 1 February 2021

Look at the current jobs Data Science Lviv→

Loading...