Big data Engineer

IT - Application & Software Development
Austin, ON
Permanent
Oct 20, 2021

Accountabilities

 

? Technical Delivery

? Quality Assurance

? Customer Satisfaction

 

About the Job

 

As a Big Data Engineer, you will report to the Practice Lead, Data, Analytics & Machine

Learning and work with our Big Data Consultants to build data pipelines, data

warehouses and dashboards. You will help our customers build modern data solutions

on the AWS stack.

 

Responsibilities

 

? Under the supervision of Big Data Consultants, work with multiple clients

simultaneously to implement enterprise-wide scalable operations on AWS

? Validate technical plans and time estimates for customers with Big Data

Consultants

? Build complex ETL code

? Build complex SQL queries using MongoDB, Oracle, SQL Server, MariaDB,

MySQL, Redshift, Athena

? Develop code using Python, Scala, PySpark

? Work with technologies such as Spark, Hadoop, Kafka, etc.

? Build complex Data Engineering workflows

? Create complex data solutions and build data pipelines

? Establish credibility and build impactful relationships with our customers to

enable them to be cloud advocates

? Capture and share industry best practices amongst the broader community

 

Required Skills

 

? 2+ years design & implementation experience with distributed applications

? 2+ years of experience in database architectures and data pipeline development

? Strong experience working with Loading, extracting data from Glue, SQL, DDL,

DML commands

? Experience handling unstructured, semi-structured data, working in a data lake

environment

? Data streaming and developing data pipelines driven by events/queues a plus

? Demonstrated knowledge of software development tools and methodologies

Job Description & Accountabilities

? Presentation skills with a high degree of comfort speaking with IT management,

and developers

? AWS Big Data Specialty Certification (required within 6 months of hire)

Send to Friend

Send to Friend