Data Engineer (offline)

Your typical day:
Create and maintain optimal data pipeline architecture
Assemble large, complex data sets that meet functional / non-functional business requirements
Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and big data technologies
Create data tools for analytics and data scientist team members that assist them in building and optimizing our product

Requirements
Advanced working SQL knowledge and experience working with relational databases, working familiarity with a variety of databases
Experience building and optimizing ‘big data’ data pipelines, architectures and data sets
Experience in software developmen 4+ years
Experience in database management 2+ years
Practical experience with high-level programming languages: Python, Java, C++, Scala, etc.
Big Data tools: Hadoop, Spark, Kafka, etc.
Data pipeline and workflow management tools: Azkaban, Luigi, Airflow, etc.
AWS cloud services: EC2, EMR, RDS, Redshift
Stream-processing systems: Storm, Spark-Streaming, etc.
NoSQL databases: MongoDB, Cassandra, HBase
Building microservices and containerized applications: Docker, k8s
Understanding of the ETL process
Understanding of software development process, Agile approach, and CI/CD
Degree in computer science or related field
Upper-Intermediate English level or higher

Nice to have:
Experience with mining of structured, semi-structured, and unstructured data
Applied statistics skills, such as distributions, hypothesis testing, regression analysis, etc.
RESTful API creation in Python (Flask, Falcon or similar)
Experience with data visualization tools, such as Ggplot2, Plotly, Matplotlib

Benefits
Friendly and highly professional team
Flexible working hours
20 working days of paid vacation
English lessons and English speaking club with a native speaker
Modern comfortable office with all amenities
15 days of paid sick leave
Relax zone (including a terrace with a barbecue in summer)
Yoga classes
Lectures and after-work activities
Snacks and fruit in the office kitchen:)

About Surprise

Surprise.com is fundamentally changing how people work, by engaging employees and providing impactful analytics to people operations professionals. To continue scaling our impact, we’re committed to hiring builders who are inspired by our team’s guiding principle: to derive a tremendous sense of purpose to make anything we touch be the best it can be.

To deliver on our very lofty goals, we need engineers with industry-defining talent and an unrestrained drive to deliver flawless results. This role offers tremendous opportunities to build a highly scalable, highly stable, easily-maintainable back-end architecture; to push the boundaries of fault-tolerant programming; and to work with a broad range of public and proprietary APIs.

Company website:
https://www.surprise.com/home