Senior Data Engineer

IT - Application & Software Development
Toronto, ON
Permanent
Oct 20, 2021

RESPONSIBILITIES:

  • Design and build organizational data infrastructure and architecture
  • Identifying, designing and implementing internal process improvements including re-designing infrastructure for greater scalability, optimizing data delivery, and automating manual processes
  • Choose the best tools/services/resources to build robust data pipelines for data ingestion, connection, transformation, and distribution
  • Design, develop and manage ETL processes
  • Transform data and engineer new features for machine learning models
  • Version data and create data monitoring models
  • Assist with deploying models to production
  • Working with global teams to deliver models

REQUIREMENTS:

  • Experience with Azure
  • Experience with Python
  • Experience in dealing with different kind of databases, data sources and formats
  • Experience writing ETL jobs
  • Experience with big data tools like data lakes, Spark, Hadoop, etc.
  • Excellent communication skills
  • Ability to conduct data profiling, cataloging, and mapping for technical data flows
  • Ability to work with an international team

DESIRED SKILLS:

  • Strong cloud architecture principles: compute, storage, networks, security, cost savings, etc.
  • Experience with NLP tools like spaCy or NLTK
  • Experience with machine learning tools like Tensorflow, PyTorch or Keras
  • Experience with real-time data pipelines

 

Send to Friend

Send to Friend