lead big data developer

Lviv · $7000 · More than 10 years of experience · Upper Intermediate

Batch and streaming apps with Apache Spark (Scala), Kafka, Hive, HDFS, AWS, SQL/NoSQL, leading a team, enterprise applications with Java, Spring, JPA/Hibernate.

Java, SQL, Cassandra, Scala, Hadoop, Hive, Apache Spark, Kafka

Developed a lot of enterprise and big data projects, released own startup, spoke at conferences


Senior Data Engineer (remote)

Remote work, Ukraine · $6000 · 9 years of experience · Intermediate

Goal-oriented team player with can-do approach. Have experience of developing from scratch: * Batch processing ETLs (Spark / AWS Glue, AWS S3) * Streaming ETLs (Spark Streaming / Storm, Kafka) * Data transfers between S3/Kafka/RDBMS/MongoDB/etc * REST API for analytics data querying (Spring Boot, Vertica, Druid) * REST API for Machine Learning, Model as a Service (Python) * BI processes and ML training automation using Jenkins (Groovy pipelines) and GitLab CI

Java, Scala, Python, Apache Spark, Hadoop, PostgreSQL, Vertica, Kafka, Cassandra, Druid, HBase, Docker, Jenkins, Spring Boot, Microservices, AWS Glue, AWS Athena, AWS S3, AWS EMR, Android, Hive, MongoDB, Team Management

* TL of 13 developers * Leading 5 sub-projects simultaneously * Have experience of taking ownership of huge infrastructure with 100+ polyglot microservices (new team creation, platform upgrade, reducing costs for hardware, migration to open-source solutions) * Participated in creation of several BI departments * Successfully collaborated with the Data Science team to integrate several Machine Learning solutions into the production

* Remote only (business trips - ok) * European time zone * Professional technical management

15 February

Senior Software Engineer (Scala), Tech Lead 

Kyiv · $5000 · 7 years of experience · Advanced/Fluent

- Scala, Kotlin, Java, other JVM languages - Cassandra - SQL - Clickhouse - Neo4j - Kafka - Akka (Actors, HTTP, Streams etc) - Apache Spark - AWS (S3, SES etc) - Telecom [messaging] protocols - Docker - Functional programming Junior mentoring. Leading teams / projects from inception to production releases.

neo4j, Java, Scala, bash, ElasticSearch, Linux, Cassandra, MongoDB, Redis, ClickHouse, Git, Kafka, SQL, Python, Akka, Spark, AWS, Functional programming, Docker, Kotlin, Spring Boot, Sbt, PostgreSQL, Cats

- Bachelor's degree in cryptography - open-source work - several successful projects in production - led transitions from Java to Scala for several projects - leading & mentoring teams

++: - product company - smart, enthusiastic teammates - competent leadership - transparent processes - floating workday (come early - leave early, come later - leave later) or remote --: - outsourcing (please don't contact for outsourcing work, i appreciate your understanding, but not willing to do it for now) - legacy solutions which you won't consider upgrading/refactoring/etc.

13 February

Senior Scala Developer 

Kyiv · $4500 · 7 years of experience · Upper Intermediate

Building scalable back-end systems with microservice architecture Building BigData applications using Apache Spark

Scala, Akka, Spark, Java, SQL, Linux, Git, MongoDB, Docker, Functional programming, Play Framework, Kafka, Sbt, play-framework, AWS, REST API, JSON, Cassandra, Cats-effect, Multithreading, OOP

11 February

Senior scala developer/Tech lead/Architect

Remote work, Ukraine · $4000 · More than 10 years of experience · Upper Intermediate

Play framework, akka, akka-streams, akka-http, akka-cluster, scala, sbt, elasticsearch, cqrs, mongodb, kafka, neo4j, docker, kubernetes, hazelcast, cassandra, lagom, sangria, http4s, cats, cats-effect, zio, parboiled2, shapeless, slick, postgresql, mysql

http4s, Scala, Akka, MongoDB, Kafka, PostgreSQL, Git, Sbt, Play Framework, Cassandra, Functional programming, SQL, Linux, CI, Docker, Circe, AWS, Redis, REST API

grpc-based pure functional lagom microservices in scala powered by zio. Analytics with elasticsearch and graph databases(neo4j, janusgraph) Online casino(Lagom, scala, cassandra, elasticsearch, akka-streams, cats, http4s) Expressions parser(parboiled2) Play and akka-based microservices for knowledge sharing project. Active using of akka-streams and alpakka Fullstack development of educational social network(scala, lift, mongodb)

Interesting projects desirable not a pure bigdata but could be mixed with bigdata/ai tasks

11 February

Senior Scala Developer / Tech Lead 🔥

Kyiv, Mjunhen · $5500 · 5 years of experience · Upper Intermediate

Team / Tech Lead Leading development of innovative Payment Service Provider (PSP) from scratch. Duties and Responsibilities: Complete cycle of software development: Requirements collecting Prototype creation Release management Interviewing Test Driven Development Stage / Production deployment CI / CD infrastructure management (CircleCI) Kubernetes cluster management Integration tests development Technologies: Back end: Scala / Akka / Playframework / Slick / Cats MySQL / PostgreSQL / SQLite Kafka / RabbitMQ ElasticSearch (Cloud / OSS) / Logstash / Kibana Front end: ReactJS NodeJS JQuery Infrastructure: Kubernetes Docker CircleCI nginx Google Cloud: Kubernetes Engine PubSub CDN Storage SQL (Postgres / MySQL) Endpoints

Scala, Akka, PostgreSQL, Kafka, Slick, RabbitMQ, Play Framework, Functional programming, Google Cloud, ElasticSearch

Участвовал в написании с нуля лидирующего FinTech проекта Украины. Глубокое понимание FinTech, acquiring, banking, payments. Совмещение Team / Tech Lead. Организация процессов компании. Ведение партнерских проектов.

11 February

Java/Scala Developer 🔥 

Kyiv · $4000 · 5 years of experience · Upper Intermediate

project architecture and technologies: - algorithms - Java/Scala, play framework, circe, scalatest, Spring, REST - distributed systems - microservices - kubernetes - networking

Scala, Java, AWS, Spark, Play Framework, REST API, Maven, Sbt

designed and developed the logging tool, backup engine, mongo migration engine, which were widely used by customers, QA and other developers.

Desired: - Scala - AWS - Algorithms - Artificial intelligence, machine learning (I have little experience, but I want to gain more) Not desired: - Gambling/Credit/Banking industry - Project with Pagerduty and on call rotation

3 February

Scala Developer

Kyiv · $4300 · 6 years of experience · Upper Intermediate

Scala, Cats, Cats-effect, Shapeless, Functional programming, Hadoop, Spark, Hive, Cassandra, Oracle, Sbt, Git, ScalaTest, Mockito, Akka, Agile

29 January

Data Engineer with Scala

Kyiv · $6700 · 7 years of experience · Upper Intermediate

Feb. 2019 – present time: Java/Scala Software Engineer * Java 8, Spring Boot, Scala 2.13, Hadoop (HDP), Spark (Structured Streaming), Kafka, Cassandra (DSE), Solr, Linux, Git, Gradle, bash scripting; * developing, testing and maintaining data pipelines for ingesting, processing and storing data in a production system built on top of Big Data and Microservices symbiosis; * creating Microservices with the Java 8/Spring Boot/REST stack, that interact with Kafka, HDFS, Cassandra storages and cloud services; * creating, monitoring and maintaining Spark on YARN jobs for both batch and streaming data processing; * creating and maintaining Jenkins jobs for CI/CD pipelines; * writing Scala runners and bash scripts for performing ad-hoc tasks, such as loading data from a cloud service into Kafka; streaming data from HDFS to a REST endpoint; sending test data into Kafka; filtering, grepping and loading data to/from HDFS; * participating in PoC projects; * writing technical documentation, creating system design and data pipelines diagrams. Feb. 2018 – Feb. 2019: Java Developer with Big Data * Java, Hadoop distributions (Cloudera, HDP), Spark, Beam, Kafka, AWS, Kerberos, Docker, Linux; * configuring and using Hadoop distributions running in Docker for development and testing; * working with AWS Management Console for creating and configuring clusters (S3, EMR); * participating in technical meetings with developers from other vendors; * writing technical documentation; Jan. 2017 – Feb. 2018: Java Developer * Java 8, Spring (Data, MVC), MySQL, JUnit, Mockito, Cucumber, Maven, Git; * developing, testing and maintaining data and service layers for RESTful services; * writing Cucumber tests; Jun. 2015 – Oct. 2016: Java Trainee/Junior Java Developer * Java 7/8, Spring, MySQL, MongoDB, Servlets, JSP, Bootstrap, Tomcat, Maven, Git; Jun. 2013 – Jun. 2015: Content Manager, Webmaster * HTML, CSS, Bootstrap, jQuery, PHP, Git;

Scala, Apache Spark, Kafka, Cassandra, Gradle, Distributed Systems, Git, Design Patterns, Linux, Docker, Hadoop, ScalaTest, Akka Actors, Cats, Lua, Apache Beam, AWS, Solr, Functional programming

I'm a software engineer with a strong background in modern backend technologies and a keen desire to continue improving my knowledge and skills in Scala and Big Data. The GoF Design Patterns help me make a flexible and maintainable design, the principles of Clean Code and FP guide me to write concise and readable code, IoC makes my code loosely coupled and testable, and TDD guarantees that the code does what it's expected to do. I’m a good team player and I always do my best to answer questions and share my knowledge with other team members. I have hands-on experience with multiple distributed systems and technologies acquired during: * participation in PoC projects; * taking part in technical discussions with other engineers and devOps about the proper configuration of Kafka and Cassandra clusters; * investigating problems in production data processing pipelines built on top of Microservices and Spark streaming jobs. I reviewed the existing data model of the main storage, investigated and proposed changes according to the best practices of the Cassandra data modelling in order to improve query performance.

I have a passion for functional programming and distributed systems, so I’m looking for a project that would benefit from my knowledge and skills in a Scala ecosystem (Akka, Cats) and a wide range of modern fault-tolerant, scalable systems for building real-time, high-load applications (Spark, Kafka, Cassandra, Solr, AWS). Such a project would be developed by a team adhering to the best practices and methodologies of software design and development. I’m a quick learner and curious to learn new technologies, especially in the areas of streaming stateful processing (Flink) and performing analytics on large volumes of data (ML, Deep Learning).

29 January

Scala developer

Remote work, Ukraine · $4700 · 10 years of experience · Intermediate

Design and build distributed systems, scalable back-end solutions. Docker Kubernates Scala Java Kafka Python Akka streams Akka cluster cats Scalatest Git Cassandra Apache Camel Spark

Scala, Spark, Linux, Sbt, Cassandra, Akka, Git, Play Framework, Python, Akka Stream, Functional programming, Cats, Cats-effect, Kafka, Redis, AWS

  • 28 candidates found. Page 1 of 3.