Senior AWS Data Engineer (IRC267111)
Job Description
- Amazon Web Services (AWS) – Kinesis, DMS, EMR, Glue, Lambda, Athena, Redshift, S3
- Strong expertise in building data ingestion, ETL/ELT pipelines and orchestration on AWS
- Experience with Change Data Capture (CDC) and real-time streaming data architectures
- Proficiency in SQL and data modeling
- Solid understanding of distributed systems and big data processing
- Python for data transformations and scripting
- Hands-on experience with orchestration frameworks like AWS Step Functions or Data Pipeline
Nice to Have
- Apache Spark, Zeppelin, Hadoop ecosystem
- Infrastructure-as-Code (IaC) using Terraform or CloudFormation
- Experience with data quality frameworks and monitoring
- Knowledge of HIPAA or similar healthcare data compliance standards
- Experience working in highly regulated environments
Job Responsibilities
Job Responsibilities
Lead the design and development of scalable and reliable data pipelines in AWS using tools such as Kinesis, DMS, Glue, EMR, Athena, and Lambda.
Define the architecture of the data ingestion and processing layer, considering performance, cost-efficiency, and maintainability.
Collaborate closely with business stakeholders and technical teams to gather requirements, validate solutions, and align data flows with business needs.
Propose and validate technical approaches and best practices for CDC, ETL/ELT, orchestration, data storage, and query optimization.
Own the implementation of key data workflows, ensuring quality, security, and adherence to architectural standards.
Conduct technical reviews, mentor junior engineers, and foster a culture of continuous improvement.
Participate in strategic planning of the data platform and actively contribute to its evolution.
Monitor and optimize performance of AWS-based data solutions, addressing bottlenecks and proposing enhancements.
Department/Project Description
The client is a pioneer in medical devices for less invasive surgical procedures, ranking as a leader in the market for coronary stents. The company’s medical devices are used in a variety of interventional medical specialties, including interventional cardiology, peripheral interventions, vascular surgery, electrophysiology, neurovascular intervention, oncology, endoscopy, urology, gynecology, and neuromodulation.
The client’s mission is to improve the quality of patient care and the productivity of health care delivery through the development and advocacy of less-invasive medical devices and procedures. This is accomplished through the continuing refinement of existing products and procedures and the investigation and development of new technologies that can reduce risk, trauma, cost, procedure time and the need for aftercare.