IT - Systems Integration
Apr 13, 2021
Our client needs to hire multiple Data Engineers. You will collaborate with internal teams on both technical aspects of data migration and storage as well as in a consultative manner to understand unique data parameters, contributing to the design and build of a data lake.
Elicit, understand, and translate. You will work across business lines and newly acquired businesses to understand individualized technical and practical data storage.
Design. You will create and support an ETL solution using AWS Glue to extract and import data into the new data lake. You will determine how to connect to the various data sources, bring data into our new data lake, and the appropriate method of storing the data.
You will create data pipelines, reports, visualisations and extracts to support product and research needs. You will work with stakeholders to assist with data-related technical issues and support their data infrastructure needs.
You will research data governance and security to ensure our data storage methodology adheres to any constraints and follows best practices.
Try new things. You will take the initiative to research, test, and solve complex data engineering problems and big data storage.
Hands-on experience. You have worked with a broad range of data management, analysis, and visualisation tools, including ETL/data format conversion, SQL, and NoSQL/ non-traditional database technologies, including newer tools such as Glue and Snowflake. You have worked with AWS/Cloud computing infrastructure.