Big Data project for diagnostics of different systems in real time.
Technologies: AWS, Ansible, Terraform, Python
Processed messages come from Apache Flume, the core part is Apache Storm which does parsing of the messages and needed aggregations. Prepared messages are stored in MemSQL and Elasticsearch. Visualization is done via web UI.
The source code is stored in Github Enterprise. CI/CD is done with Concourse CI. Build artifacts are stored in JFrog.
Amazon Web Services (AWS)
Cloud Architecture, Networking
Know how to build high scale and high performance enterprise web applications, microservices, serverless architecture
Experience with Linux
Spoken English knowledge (intermediate or better)
Nice to Have:
Knowledge of Python
Serving AWS instance maintenance and deployment
Improving CI/CD deployment procedures
Create a centralized Elasticsearch instance and automate data movement between local data centers and a centralized instance
Integrate a system with other internal Comcast systems with automated data flows
Work in well-organized professional team (Odessa city center or remote)
Opportunities for career growth and for technical learning
English language courses, QA and computer languages courses
Flexible work schedule, possibility to work and getting paid remotely
Optional participation in Events, Conferences, Business trips, Sports activities.
About The Product Engine
Founded in 2001 and located in the heart of Silicon Valley, The Product Engine provides end-to-end consulting and software development services.
Our mission is to be a highly dependable, single-source digital solutions provider to a wide-range of customers and organizations.
The Product Engine strives to deliver the most suitable and intelligent software & technology solutions on demand. Our goal is to be a leading force in the successful development and implementation of innovative products and services that fully satisfy the evolving goals of our customers and their businesses.
With our headquarters and project managers in Silicon Valley and our offshore development centers in Ukraine (Odessa), The Product Engine delivers the best of offshore IT talent, using intensive project management, efficient and reliable communication practices, sound risk management, and an unwavering commitment to quality.
The Product Engine delivers high quality software applications and solutions on time and on budget in a variety of fields. From designing sophisticated software architectures for data intensive applications to building intricate websites, we have the flexibility to take on tasks either by complementing your existing engineering team, or by functioning as your complete virtual engineering department.
DOU company page: