Data Engineer Offline
We are looking for a passionate, innovative and experienced Data Engineer to help bring value to our customers, both internal and external, and help us make data-driven decisions to change the way the world communicates.
This position is an opportunity for a creative individual to engineer innovative products and services that will propel DISH into the forefront of the next technological revolution using a data-driven approach. If you have a sense of adventure, take pride in solving complex data problems, and strive to build the best products on the planet, we want you on our Software Engineering team here at DISH Technologies.
Responsibilities:
Work collaboratively with other engineers, data scientists and business product owners from USA in an agile environment to build out a production level pipeline that supports business and engineering requirements. Architect, build, and support the operation of Cloud and On-Premises enterprise data infrastructure and tools. Migrate data from legacy systems to new Cloud based systems. Create documents for all architectural design and ensure the re-usability of the design for future upcoming development work. Mentor junior engineers in development work.
- Design, build, and maintain the data architecture of the company to support data ingestion, processing, storage, and extraction
- Lead the data engineering team in implementing robust, scalable data processing pipelines, data structures, and database systems
- Optimize data engineering practices for efficiency and speed, keeping in mind both current and future data requirements
- Work closely with data analysts, data scientists, and machine learning engineers to understand their data needs and translate those into technical requirements
- Develop and implement data validation frameworks to ensure data integrity and reliability across all data pipelines
- Identify, design, and implement internal process improvements such as automating manual processes, optimizing data delivery, and re-designing infrastructure for greater scalability
- Understand the data needs of the company’s product and analytics teams, and ensure the data infrastructure meets these needs
- Maintain data security and compliance according to best practices and relevant regulations
- Keep up-to-date with the latest industry trends and technologies in data engineering, and suggest improvements to current data systems and processes
- Train and mentor junior data engineers and other team members in data engineering principles and best practices
Basic Requirements:
- Bachelor’s degree in Computer Science, Engineering, or a related field. A Master’s degree would be a plus
- A minimum of 5 years of experience in a Data Engineering role, with a proven track record of leading successful data projects
- Expertise in big data tools: Hadoop, Spark, Kafka, etc.
- Proficiency in database technologies, both SQL (e.g., PostgreSQL, MySQL) and NoSQL (e.g., MongoDB, Cassandra)
- Strong knowledge of data pipeline and workflow management tools: Azkaban, Luigi, Airflow, etc.
- Experience with AWS cloud services: EC2, EMR, RDS, Redshift
- Experience in building and optimizing ’big data’ data pipelines, architectures, and data sets
- Strong analytic skills related to working with unstructured datasets
- Proficiency in scripting languages such as Python and Java
- Strong project management and organizational skills
- Experience supporting and working with cross-functional teams in a dynamic environment
- Excellent communication and collaboration skills, with the ability to explain complex technical concepts to non-technical stakeholders
- Must be curious and detail-oriented, with a strong desire to learn and share knowledge with others
- A commitment to promoting a culture of data-driven decision-making within the company
Preferred Qualifications:
- Advanced degree (Master’s or Ph.D.) in Computer Science, Engineering, or a related field
- Certifications in big data technologies or cloud platforms, such as AWS Certified Big Data, Google Certified Professional Data Engineer, etc.
- Experience with real-time data processing frameworks
- Experience with Apache Superset or other similar data visualization tools like Tableau, PowerBI
- Understanding of Machine Learning algorithms and experience working closely with ML models
- Familiarity with agile development methodologies
- Experience with containerization and orchestration technologies such as Docker and Kubernetes
- Experience with DevOps practices and tools, such as CI/CD pipelines and automation tools
- Proven track record in managing and delivering large, complex data projects on time and to budget
- Demonstrated ability to innovate and adapt to the latest developments in the field of data engineering
- Strong leadership qualities, including experience in mentoring and guiding junior team members
- Experience working in the media and entertainment industry is a plus
- Upper-Intermediate English level or above
We offer:
- Individual development plan and technical/soft training, certificates.
- Office/hybrid work in Lviv(Kharkiv) or Remote in Ukraine
- 25 days off
- Access to LinkedIn Learning
- Medical Insurance