Senior Data Engineer for Ciklum (SA) (offline)

Project description:
Seeking Alpha is the market leader for crowdsourced equity research in the USA. We employ 150+ people across its operations in New York, Israel and India.
The company is the premier website for actionable stock market opinion and analysis, and vibrant, intelligent finance discussion. Each month our crowdsource investment analysis draws an audience of 5.2MM+ monthly visitors to our real-time alerts products on email and mobile.
We handpick articles from the world’s top market blogs, money managers, financial experts and investment newsletters, publishing 500 unique article and news updates daily. The company gives a voice to over 5.5MM registered users, including 12,000+ contributors and individuals averaging 130,000+ comments a month, providing access to the nation’s savviest and inquisitive investors.
Our site is the only free, online source for over 5,000 public companies’ quarterly earnings call transcripts, including the S&P 500. The company was named the Most Informative Website by Kiplinger’s Magazine and has received Forbes’ ‘Best of the Web’ Award.

Responsibilities:
Solve challenging problems in a fast-paced and evolving environment while maintaining uncompromising quality
Contribute to the core design of data architecture, data models and schemas, and implementation plan
Design, build and maintain optimal data pipeline architecture for extraction, transformation, and loading of data from a wide variety of data sources, including external APIs, data streams, and data stores
Design, build, and maintain the infrastructure for ingesting data into our data lake and data warehouse and providing frameworks and services for operating on that data
Design, build, and maintain the infrastructure for real-time streaming analytics, big data analytics, and machine learning analytics capabilities
Implement data privacy and data security requirements to ensure solutions stay compliant with security standards and frameworks
Enhance the team’s dev-ops capabilities

Requirements:
BSc in CS/Mathematics/Statistics/Physics/EE or equivalent experience
5+ years of proven experience developing large-scale software using an object-oriented or a functional language
Outstanding Software Engineering skills
Proven experience with cloud-based data pipeline/backend services, using AWS
Proficient with relational and non-relational data modeling
Proficient with stream processing using the current industry standards (e.g. Akka, AWS Kinesis, Kafka, Spark, Flink, etc.)
Familiarity with a variety of big data frameworks and tools, including EMR, Athena, Glue, Airflow, etc.
High-level English – a must

Desirable:
Experience with containerized (Docker, ECS, Kubernetes) or serverless (Lambda) deployment
Experience with building Machine Learning models
Experience with Data Lineage
Deep knowledge of Spark internals (tuning, query optimization)

Personal skills:
A team player with excellent collaboration skills

What's in it for you:
Very close cooperation with the client
Possibility to propose solutions on a project
Dynamic and challenging tasks
Ability to influence project technologies
Team of professionals: learn from colleagues and gain recognition of your skills
Low bureaucracy, European management style

Here is the link with more details about the position:
https://jobs.ciklum.com/jobs/senior-data-engineer-for-seeking-alpha-2/

About Ciklum International

Ciklum (www.ciklum.com) is a leading global product engineering and digital services company, serving Fortune 500 and fast-growing organisations.

Headquartered in the UK, Ciklum has 4,000+ software developers, designers, product managers and data scientists around the world building tailored digital solutions that leverage emerging technologies. Ciklum specialises in enabling digital transformation for some of the largest household names in the digital economy.

The Company empowers its clients and people to exceed their potential and pursue the extraordinary.

Join one of the top 10 employers in Ukraine, according to Forbes.
Boost your skills and make a difference with cutting-edge projects, skilled colleagues and the latest tech stacks.

Company website:
https://www.ciklum.com/

DOU company page:
https://jobs.dou.ua/companies/ciklum/