Principal Data Engineer

4 days ago

Toronto, Canada Movable Ink Full time
Movable Ink scales content personalization for marketers through data-activated content generation and AI decisioning. The world’s most innovative brands rely on Movable Ink to maximize revenue, simplify workflow and boost marketing agility. Headquartered in New York City with close to 600 employees, Movable Ink serves its global client base with operations throughout North America, Central America, Europe, Australia, and Japan.

As a Principal Data Engineer you will help drive the direction of our Data Warehouse. You will be hands-on with teammates across all departments enabling them to access the data and empowering teams to make data-driven decisions about the direction of our business. You will play a pivotal role in owning the infrastructure and code for our data pipelines within our Data Platform. You will be responsible for designing, implementing, and optimizing ingestion pipelines, enabling seamless extraction and loading of data from various sources such as customer warehouses, business systems, and events messaging buses. Movable Ink collects campaign data resulting from Billions of requests served each day. Come and help us manage and make sense of the massive amount of data we’re ingesting

Responsibilities:

  • Partner with internal operations teams to identify, collect, and integrate data from various business systems, ensuring comprehensive and accurate data capture
  • Design, implement, and maintain robust data pipelines that feed data into our Data Platform, ensuring high performance, scalability, and reliability
  • Ensure data pipelines adhere to best practices and are optimized for performance and scalability
  • Conduct thorough testing of data pipelines to validate data accuracy and integrity
  • Monitor data pipelines, troubleshoot any issues that arise, and make improvements to these issues where applicable
  • Establish and track SLAs for data processing and delivery, ensuring timely and reliable access to data for all users
  • Become a mentor for less experienced team members, and establish patterns and practices that can be followed to increase quality, accuracy, and efficiency of solutions produced by the team
  • Work with other teams in order to ensure access to data corresponds with company policies, and ensure data access, processing, and storage is in compliance with regulatory (e.g. GDPR, CCPA, etc.) requirements

Qualifications:

  • 12+ years of professional experience in data engineering, software engineering, database administration, business intelligence, or related field with 8+ years of that experience as a Data Engineer with a focus on cloud-based Data Warehouse platforms (Redshift, Snowflake, Firebolt, BigQuery). We currently use Redshift.
  • Elite-level understanding on how to work with and optimize multi-petabyte, mission-critical databases, ensuring high availability, performance, and reliability informed by a strong understanding of database internals
  • Elite-level proficiency with Python and SQL languages, and significant experience building robust data pipelines with these languages
  • Elite-level proficiency in using, deploying and managing at least one data pipeline orchestration tool/framework such as Apache Airflow, Prefect, etc. We currently use Apache Airflow.
  • Significant experience in building solutions that comply with regulatory requirements such as GDPR and CCPA
  • Significant experience in designing and implementing solutions that can support both batch and real-time data consumption models
  • Significant experience in building solutions that implement data security best practices within an AWS environment
  • Significant experience in providing technical leadership, setting best practices, and successfully driving the adoption of new technologies and methodologies within a fast-moving organization
  • Significant data modeling experience spanning more than one data modeling paradigm (e.g. Data Vault, Kimball/Ross, Inmon)
  • Experience working in an Agile/Scrum environment, has experience working with technical managers and product owners/manager to break down high-level requirements into actionable cards
  • Experience working with streaming platforms such as Apache Kafka and Apache Pulsar
  • Excellent communication skills for effective collaboration with cross-functional teams

Studies have shown that women, communities of color, and historically underrepresented people are less likely to apply to jobs unless they meet every single qualification. We are committed to building a diverse and inclusive culture where all Inkers can thrive. If you’re excited about the role but don’t meet all of the abovementioned qualifications, we encourage you to apply. Our differences bring a breadth of knowledge and perspectives that makes us collectively stronger.

We welcome and employ people regardless of race, color, gender identity or expression, religion, genetic information, parental or pregnancy status, national origin, sexual orientation, age, citizenship, marital status, ethnicity, family or marital status, physical and mental ability, political affiliation, disability, Veteran status, or other protected characteristics. We are proud to be an equal opportunity employer.

  • Principal Engineer, Data Engineering Principal Engineer, Data Engineering

    4 weeks ago

    Toronto, ON, Canada Compest Solutions Inc. Full time

    Job Description We are seeking a highly skilled and experienced Principal Data Engineer to lead our data engineering team. As a Principal Data Engineer, you will be responsible for designing, developing, and implementing complex data solutions to support our business objectives. Responsibilities: Team Leadership: Lead and mentor a team of data...

  • Principal Data Insights Engineer

    4 weeks ago

    Toronto, Ontario, Canada NearSource Full time

    Role OverviewNearSource Technologies is seeking a highly skilled Principal Data Insights Engineer to drive data-driven decision-making across our digital platform.About the RoleThis is a high-impact position that requires expertise in quantitative analysis, data mining, and machine learning to create models influencing product strategy and priorities. As a...

  • Principal Data Engineer

    6 hours ago

    Toronto, Canada Premium Stairs & Railings Inc. Full time

    About the Role:We are seeking a highly skilled and experienced Principal Data Engineer to lead our data engineering team. As a Principal Data Engineer, you will be responsible for designing, developing, and implementing robust data pipelines, data warehouses, and data lakes. You will also play a key role in driving data-driven decision-making across the...

  • Principal Data Engineer-Full-Time Contract

    4 weeks ago

    Toronto, Canada Compest Solutions Inc. Full time

    Job DescriptionWe are seeking a highly skilled and experienced Principal Data Engineer to lead our data engineering team. As a Principal Data Engineer, you will be responsible for designing, developing, and implementing complex data solutions to support our business objectives.Responsibilities:Team Leadership: Lead and mentor a team of data engineers.Data...

  • Data Engineer

    1 month ago

    Toronto, Canada NTT DATA Full time

    Job Description Req ID: 299022 NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Engineer to remotely join our team in or near Tornoto, Ontario (CA-ON), Canada (CA).We are...

  • Principal Data Engineer-Full-Time Contract

    4 weeks ago

    Toronto, Canada Compest Solutions Inc. Full time

    Job DescriptionWe are seeking a highly skilled and experienced Principal Data Engineer to lead our data engineering team. As a Principal Data Engineer, you will be responsible for designing, developing, and implementing complex data solutions to support our business objectives.Responsibilities:Team Leadership: Lead and mentor a team of data engineers.Data...

  • Principal Data Engineer-Full-Time Contract

    4 weeks ago

    Toronto, Canada Compest Solutions Inc. Full time

    Job DescriptionWe are seeking a highly skilled and experienced Principal Data Engineer to lead our data engineering team. As a Principal Data Engineer, you will be responsible for designing, developing, and implementing complex data solutions to support our business objectives.Responsibilities:Team Leadership: Lead and mentor a team of data engineers.Data...

  • Principal Data Engineer

    1 day ago

    Toronto, Ontario, C6A, Ontario, Canada Premium Stairs & Railings Inc. Full time

    About the Role:We are seeking a highly skilled and experienced Principal Data Engineer to lead our data engineering team. As a Principal Data Engineer, you will be responsible for designing, developing, and implementing robust data pipelines, data warehouses, and data lakes. You will also play a key role in driving data-driven decision-making across the...

  • Principal Data Engineer

    3 weeks ago

    Old Toronto, Canada Endava Limited Full time

    Unlock Your Potential as a Principal Data EngineerWe are seeking an exceptional Principal Data Engineer to join our team. In this role, you will be responsible for ensuring data quality and integrity across various data sources and systems, optimizing data pipelines for performance and scalability, providing technical support to promptly resolve escalated...

  • Principal Data Engineer-Full-Time Contract

    4 weeks ago

    Toronto, Ontario, Ontario, Canada Compest Solutions Inc. Full time

    Job DescriptionWe are seeking a highly skilled and experienced Principal Data Engineer to lead our data engineering team. As a Principal Data Engineer, you will be responsible for designing, developing, and implementing complex data solutions to support our business objectives.Responsibilities:Team Leadership: Lead and mentor a team of data engineers.Data...

  • Principal Data Engineer-Full-Time Contract

    4 weeks ago

    Toronto, ON, Canada Compest Solutions Inc. Full time

    Job Description We are seeking a highly skilled and experienced Principal Data Engineer to lead our data engineering team. As a Principal Data Engineer, you will be responsible for designing, developing, and implementing complex data solutions to support our business objectives. Responsibilities: Team Leadership: Lead and mentor a team of data...

  • Principal Data Engineering Specialist

    2 weeks ago

    Toronto, Canada GalaxEons Full time

    Job DescriptionWe are seeking a highly skilled Principal Data Engineering Specialist to join our team at GalaxEons. As a key member of our data engineering team, you will be responsible for designing and implementing optimal data pipeline architectures.About the RoleThis is a senior-level position requiring 10+ years of relevant experience in a related field...

  • Principal Engineer

    7 months ago

    Greater Toronto Area, Canada AutoTrader.ca Full time

    Principal Engineer  Companies are coming to realize the power that leveraging integrated data effectively can have on their businesses. In all industries, business performance can be dramatically improved when companies act on the insights that organized, accessible data can provide into their internal processes and models. Like most companies AutoTrader...

  • Principal, Data Management

    10 hours ago

    Toronto, Canada Skillsoft Full time

    At Skillsoft, we propel organizations and people to grow together through transformative learning experiences. We believe every team member has the potential to be AMAZING. Join us in our quest to transform learning and help individuals unleash their edge. **Principal - Data Management, Enterprise Data Strategy & Execution Team** At Skillsoft, we are all...

  • Principal Data Scientist

    2 days ago

    Toronto, Canada Experfy Inc Full time

    **Opportunity Description** We are seeking a Principal Data Scientist with strongly developed expertise in graph-based AI and related technologies to maximize utilization of data and knowledge in the client's data and digital transformation. **ESSENTIAL EXPERIENCE**: - Degree in mathematics, computer science, engineering, physics, statistics, economics,...

  • Principal Data Scientist

    6 months ago

    Toronto, Canada Siteimprove Full time

    The Siteimprove AI and Data Science team is responsible for developing, testing, and deploying AI models and ensuring their reliability. Additionally, the team collaborates with the Data Foundation team to integrate and support the end-to-end lifecycle of data needed for training and inference. Our team is seeking a principal data scientist who is a...

  • Junior Data Scientist and ML Engineer

    1 month ago

    Toronto, Canada NTT DATA Full time

    Job Description Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it’s a place where you can grow, belong and thrive.Your day at NTT...

  • Data Engineering Lead for Scalable Solutions

    4 weeks ago

    Toronto, Ontario, Canada Compest Solutions Inc. Full time

    About Compest Solutions Inc.We are a cutting-edge technology company seeking an experienced Principal Data Engineer to lead our data engineering team. As a key member of our team, you will play a crucial role in designing and implementing complex data solutions to drive business growth.

  • Staff / Principal Software Engineer

    4 weeks ago

    Old Toronto, Canada Aitopics Full time

    h3>Staff/Principal Software Engineer – Edge Compute - Containerization 9401Extreme NetworksWe provide networking solutions to power your business. Our flexible and scalable cloud networking services help optimize your network infrastructure.Extreme Networks Named to Computerworld’s 2023 List of Best Places to Work in IT! Over 50,000 customers globally...

  • Principal Data Scientist, Risk Modeling

    4 weeks ago

    Toronto, Ontario, Canada Royal Bank of Canada Full time

    About the RoleWe are seeking a Principal Data Scientist to join our Risk Modeling team at the Royal Bank of Canada. As a key member of this team, you will be responsible for developing and implementing predictive risk models that support credit decisions in Portfolio Management and Credit Strategies.The ideal candidate will have a strong background in...