Middle Data Engineer Offline
We invite those who fired up to:
β Working with big enough datasets (100+ TB) which must be updated at least with hourly frequency;
β DWH components: AWS (S3, Athena, Redshift), GCP(Cloud Storage, BigQuery), PostgreSQL;
β Data collection: Kafka, Google Analytics, Firebase, Appsflyer, Cloudflare, other 3rd party apps;
β Data modelling: building centralised data catalog with well validated and documented data marts;
β Data quality / integrity testing automation;
β Designing and implementing REST based APIs;
β Development and support of ETL / ELT processes;
β Creation and support of project documentation.
Essential professional experience:
β 2+ years experience Python / Data Engineer;
β Hands-on experience with following technologies:
β Designing, implementing RESTful APIβs (Aiohttp, Flask, FastAPI);
β Relational databases (PostgreSQL, Microsoft SQL Server);
β Job scheduling, task queues;
β Cloud providers: Google Cloud Platform (Cloud Storage, BigQuery),
β AWS (S3, Athena, Redshift) etc.;
β Linux, Docker;
β Incorporating and utilising BDD / TDD / Unit testing;
β Exceptional problem solving, technical and data analysis skills;
β Extensive knowledge of best practices in software design and design patterns;
β Strong Computer Science fundamentals;
β Knowledge in database theory: types, their pros and cons;
β Knowledge in performance tuning of ETL Jobs, SQLβs, Partitioning, Indexing;
β Hands-on experience with ETL, Data Warehousing tasks;
β Solid understanding of git flow best practices.
Will be a plus:
β Familiarity with WEB / Mobile applications data sources;
β Hands-on experience with following technologies:
β Kubernetes;
β Apache Airflow;
β NoSQL databases (Elasticsearch, Redis, MongoDB);
β Kafka, Kafka Connect, Kafka Streams;
β NoSQL databases: MongoDB, ElasticSearch, Redis;
β IaC: Terraform, Ansible;
β Saleforce: CRM and Marketing platform;
β Graph databases (Neo4j, AgensGraph);
β Near real time data processing;
β Data visualisation tools (Tableau, PowerBI, QlikView, Metabase, Apache β Superset, Grafana, Kibana etc.).
We care of your:
Health
β Medical insurance/Sport compensation;
β Sport club participation (football, running, basketball or swimming clubs);
β 100% paid sick leaves;
β 20 working days of paid vacation.
Wealth
β Competitive salary and Ρonstant encouragement for your efforts and contribution;
β Bonuses according to companyβs policy;
β Welfare (financial support in critical situation);
β Gifts for significant life events (marriage, childbirth).
Personal and professional growth
β Individual annual training budget with an opportunity to visit paid conferences, training sessions, workshops etc.;
β Free corporate library;
β Opportunity to visit our non-stop internal meetups: open talks, IT Pump, etc. as a participant or a speaker and exchange knowledge;
β A world-class team of T-shaped skilled professionals that share knowledge and support each other.
Leisure time
β Corporate parties and events (Pub Quiz, Carquest, etc.);
β PM Foundation activities (social responsibility events);
β Weekly events aimed at culture, arts, soft skills development
The job ad is no longer active
Job unpublished on
22 July 2022
Look at the current jobs Data Science Kyivβ