Senior/Principal Backend Data Engineer

7 days ago

Waterloo, Canada Dematic Ltd. Full time
At Dematic, we are gearing up to revolutionize our data landscape by building a cutting-edge Enterprise Data Lakehouse Platform. We are forming two pivotal platform teams that will spearhead the creation of the platform's foundational components. These teams go beyond traditional data ingestion; they are architects of a microservices-driven platform, providing abstractions that empower other teams to seamlessly extend the platform.

Role Overview We are seeking dynamic and highly skilled Senior and Principal level Data Engineers to design and build the core foundation of our Enterprise Data Platform. This role demands engineers who not only possess a profound understanding of the data engineering landscape but have built core foundations in the past. The ideal candidates will contribute significantly to the platform development while actively shaping the future of our data ecosystem.

What we offer: What We Are Looking For: Responsibilities:
  • Architect, design and develop core data platform components with a microservices architecture, abstracting platform, and infrastructure intricacies.
  • Create and maintain essential data platform SDKs and libraries, adhering to industry best practices.
  • Design and develop connector frameworks and modern connectors to source data from disparate applications both on-prem and cloud.
  • Design and optimize data storage, processing, and querying performance for large-scale datasets using industry best practices.
  • Design and develop data quality frameworks and processes to ensure the accuracy and reliability of data.
  • Collaborate with data scientists, analysts, and cross-functional teams to design data models, database schemas, and data storage solutions.
  • Design and develop advanced analytics and machine learning capabilities on the data platform.
  • Design and develop observability and data governance frameworks and practices.
  • Solid experience in deployment and release cycles of data assets, ensuring a robust and scalable platform.
  • Stay up to date with the latest data engineering trends, technologies, and best practices.
Tasks and Qualifications: Requirements:
  • 10+ (for senior) 15+ (for principal) of proven experience in modern cloud data engineering, data architectures, data warehousing, and software engineering.
  • Expertise in architecting, designing, and building end-to-end data platforms in the GCP environment while adhering to best practice guidelines such as open standards, cost, performance, time to market and minimize vendor lock.
  • Solid experience building data platforms in GCP environment.
  • Solid experience designing and developing modular, distributed data platform components with a microservices architecture. Strong experience with Docker, Kubernetes, APIs is needed.
  • Proficiency in data engineering tools and technologies - SQL, Python, Spark, DBT, Airflow, Kafka.
  • Solid experience implementing data lineage, data quality and data observability for big data workflows.
  • Strong experience with modern data modeling, data architecture, and data governance principles.
  • Excellent experience with DataOps principles and test automation.
  • Excellent experience with observability tools - Grafana and Datadog.
  • Applicants must be authorized to work for any employer in the US without visa requirements. This position is not eligible for employment visa sponsorship.
Nice to have:
  • Experience with Data Mesh architecture.
  • Experience building Semantic layers for data platforms.
  • Experience building scalable IoT architectures.
#J-18808-Ljbffr

  • Senior/Principal Backend Data Engineer

    4 weeks ago

    Waterloo, Canada Data Spree GmbH Full time

    Dematic Ltd.Waterloo, CanadaRole HighlightsGOSQLPythonData ArchitectData GovernanceAPIData QualityTest AutomationData WarehousingDatabase SchemaMicroservicesInfrastructureCloudStorageDataSetsReliabilityDatabaseDeploymentInternet Of ThingsTools, Libraries and FrameworksSDKGCPDockerAirflowKafkaGrafanaDataDogDescriptionDematic is seeking skilled Senior and...

  • Senior/Principal Backend Data Engineer

    4 weeks ago

    Waterloo, Canada Data Spree GmbH Full time

    Dematic Ltd.Waterloo, CanadaRole HighlightsGOSQLPythonData ArchitectData GovernanceAPIData QualityTest AutomationData WarehousingDatabase SchemaMicroservicesInfrastructureCloudStorageDataSetsReliabilityDatabaseDeploymentInternet Of ThingsTools, Libraries and FrameworksSDKGCPDockerAirflowKafkaGrafanaDataDogDescriptionDematic is seeking skilled Senior and...

  • Senior/Principal Backend Data Engineer

    4 weeks ago

    Waterloo, Ontario, M2L, City of Toronto, Canada Data Spree GmbH Full time

    Dematic Ltd.Waterloo, CanadaRole HighlightsGOSQLPythonData ArchitectData GovernanceAPIData QualityTest AutomationData WarehousingDatabase SchemaMicroservicesInfrastructureCloudStorageDataSetsReliabilityDatabaseDeploymentInternet Of ThingsTools, Libraries and FrameworksSDKGCPDockerAirflowKafkaGrafanaDataDogDescriptionDematic is seeking skilled Senior and...

  • Senior/Principal Backend Data Engineer

    7 days ago

    Waterloo, Canada Dematic Ltd. Full time

    At Dematic, we are gearing up to revolutionize our data landscape by building a cutting-edge Enterprise Data Lakehouse Platform. We are forming two pivotal platform teams that will spearhead the creation of the platform's foundational components. These teams go beyond traditional data ingestion; they are architects of a microservices-driven platform,...

  • Senior/Principal Backend Data Engineer

    1 week ago

    Waterloo, Canada Dematic Ltd. Full time

    At Dematic, we are gearing up to revolutionize our data landscape by building a cutting-edge Enterprise Data Lakehouse Platform. We are forming two pivotal platform teams that will spearhead the creation of the platform's foundational components. These teams go beyond traditional data ingestion; they are architects of a microservices-driven platform,...

  • Senior/Principal Backend Data Engineer

    3 weeks ago

    Waterloo, Canada Dematic Ltd. Full time

    At Dematic, we are gearing up to revolutionize our data landscape by building a cutting-edge Enterprise Data Lakehouse Platform. We are forming two pivotal platform teams that will spearhead the creation of the platform's foundational components. These teams go beyond traditional data ingestion; they are architects of a microservices-driven platform,...

  • Senior/Principal Backend Data Engineer

    3 weeks ago

    Waterloo, Canada Dematic Ltd. Full time

    At Dematic, we are gearing up to revolutionize our data landscape by building a cutting-edge Enterprise Data Lakehouse Platform. We are forming two pivotal platform teams that will spearhead the creation of the platform's foundational components. These teams go beyond traditional data ingestion; they are architects of a microservices-driven platform,...

  • Senior/Principal Backend Data Engineer

    3 weeks ago

    Waterloo, Canada Dematic Ltd. Full time

    At Dematic, we are gearing up to revolutionize our data landscape by building a cutting-edge Enterprise Data Lakehouse Platform. We are forming two pivotal platform teams that will spearhead the creation of the platform's foundational components. These teams go beyond traditional data ingestion; they are architects of a microservices-driven platform,...

  • Senior/Principal Backend Data Engineer

    3 weeks ago

    Waterloo, Canada Towards AI, Inc. Full time

    Dematic Ltd.Waterloo, CanadaRole HighlightsGOSQLPythonData ArchitectData GovernanceAPIData QualityTest AutomationData WarehousingDatabase SchemaMicroservicesInfrastructureCloudStorageDataSetsReliabilityDatabaseDeploymentInternet Of ThingsTools, Libraries and FrameworksSDKGCPDockerAirflowKafkaGrafanaDataDogDescriptionDematic is seeking skilled Senior and...

  • Senior Data Engineer

    1 week ago

    Waterloo, Canada Ontario Teachers Insurance Plan (OTIP) Full time

    Job DescriptionWhat You’ll Do:Reporting to the Senior Manager – Data Management, you’ll be accountable for building, maintaining and enhancing Azure data pipelines for various analytical and operational use cases, The Senior Data engineer is also responsible for leading the delivery of Data migration, Data warehousing and Master data management...

  • Senior Data Engineer

    1 week ago

    Waterloo, Canada Ontario Teachers Insurance Plan Full time

    With every job, there’s always the question of “why”. Why join a company? Why be part of their mission? Here, the why is easy. It’s because at some point, we’ve all needed someone there for us.At the OTIP Group of Companies (OGC), we believe that something special happens when employees feel valued for the work they do, supported as the people they...

  • Senior Data Engineer

    7 days ago

    Waterloo, Canada Ontario Teachers Insurance Plan Full time

    With every job, there’s always the question of “why”. Why join a company? Why be part of their mission? Here, the why is easy. It’s because at some point, we’ve all needed someone there for us.At the OTIP Group of Companies (OGC), we believe that something special happens when employees feel valued for the work they do, supported as the people they...

  • Senior Data Science Engineer

    2 days ago

    Waterloo, Canada Manulife Financial Corporation Full time

    The OpportunityAs a Senior Data Science Engineer, you will take a leading role in designing and delivering AI/Advanced Analytics solution in cloud-based production environments to business; be accountable for delivering business value with data by focusing on key corporate objectives, including port

  • Senior Staff Software Engineer

    1 day ago

    Waterloo, Canada Broadcom Inc. Full time

    p>Job requisition id: R020773Job Description:Broadcom’s Mainframe Software Division (MSD) is looking for an excellent software engineer with a passion for building high quality applications using agile practices to join our development team working on the solution in the area of Workload Automation.Mainframe systems are at the heart of the digital economy,...

  • Senior Data Engineer

    4 months ago

    Waterloo, Canada Company 1 - The Manufacturers Life Insurance Company Full time

    Description We are seeking a dynamic and well versed Senior Data Engineer to orchestrate our Data Lake team, with a focus on data curation, report creation, and data feed management. The ideal candidate will possess the qualifications to champion the development and implementation of end-to-end data pipelines using advanced data engineering skills to...

  • Senior Manager

    3 weeks ago

    Waterloo, Canada Carta, Inc. Full time

    h3>The Company You’ll JoinCarta is a platform that helps people manage equity, build businesses, and invest in the companies of tomorrow. p>Carta is trusted by more than 40,000 companies and over two million people in nearly 160 countries to manage cap tables, compensation, and valuations. Carta also supports nearly 7,000 funds and SPVs, and represents...

  • Sr. Data Engineer

    1 week ago

    Waterloo, Canada Dematic Ltd. Full time

    We are seeking a dynamic and highly skilled Senior Data Engineer who has extensive experience building self-service enterprise scale data platforms with microservices architecture and lead these foundational efforts. This role demands someone who not only possesses a profound understanding of the data engineering landscape but also has a very strong software...

  • Sr. Data Engineer

    7 days ago

    Waterloo, Canada Dematic Ltd. Full time

    We are seeking a dynamic and highly skilled Senior Data Engineer who has extensive experience building self-service enterprise scale data platforms with microservices architecture and lead these foundational efforts. This role demands someone who not only possesses a profound understanding of the data engineering landscape but also has a very strong software...

  • Senior Software Engineer

    2 days ago

    Waterloo, Canada SAP SE Full time

    Senior Software Engineer - HANA Data Lake Relational Engine We help the world run better At SAP, we enable you to bring out your best. Our company culture is focused on collaboration and a shared passion to help the world run better. We offer a highly collaborative, caring team environment

  • Senior Data Science Engineer

    1 month ago

    Waterloo, Canada Manulife Insurance Malaysia Full time

    Senior Data Science EngineerLocations: Waterloo, Ontario; Toronto, OntarioTime Type: Full timePosted On: Posted 2 Days AgoJob Requisition ID: JR24010668We are a leading financial services provider committed to making decisions easier and lives better for our customers and colleagues around the world. From our environmental initiatives to our community...