The customer operates a data store which is extracted from an external supplier system. The data is hosted in AWS and consists of a set of relational tables stored in Parquet format in S3 and queried with Apache Spark SQL and Amazon Athena. The customer transforms this data store via custom SQL queries developed by the existing Amach Software team to create several daily and weekly feeds to external systems.
In 2022, the customer will be migrating feeds currently delivered directly from the external supplier system to feeds delivered from their copy of this data in AWS. This will require writing moderately complex SQL queries in order to transform this data. The existing Amach Team is composed of DevOps Engineers and would benefit from an engineer who specializes in Data and SQL.
Must Haves:
Good working knowledge of SQL Experience working with AWS data technologies (e.g., Hive, Athena, Spark) Good level of communication (both written and spoken) in English.
Duties will include, but not limited to:
Advising on database technologies in AWS Exploring and understanding relational data, to advise on what is possible Translating business requirements for data into code Writing or assisting others to write complicated SQL queries joining multiple tables Participating in an all-remote Agile team
Skills & Experience:
Desirable experience: Have worked on databases / data lakes based in AWS Reverse-engineering external data models Familiarity with ingesting data as JSON and outputting CSV Knowledge of Python or another programming language Desirable certifications: AWS Certified Data Analytics β Specialty (DAS-C01) AWS Certified Database β Specialty (DBS-C01)
We offer:
An opportunity to join a fast-growing company Options for career advancement Learning and development opportunities Flexible working environment Competitive rate based on experience
About Amach Software
Amach Software helps organisations of all sizes achieve continuous delivery through Automation. We specialise in Automation testing, CI/CD and are AWS partners. Our team will help build and integrate a bespoke test Automation framework that align testing practices in your organisation. We build frameworks using best of breed 100% open source technologies based on best practices and decades of experience.