Lead Data Engineer

1 week ago

Halifax, Nova Scotia, Canada Ness Canada, Inc. Full time
Job Title: Lead Data Engineer / Data Architect Location: Canada About the Role:
We are seeking an experienced Lead Data Engineer / Data Architect to spearhead the design, development, and implementation of our enterprise data platform. This role will be instrumental in shaping and driving our data engineering roadmap, ensuring scalability, performance, and innovation. The ideal candidate combines deep technical expertise with strong leadership skills and a solid understanding of financial services data domains. Key Responsibilities:
  • Lead the data architecture and engineering strategy, ensuring alignment with business and technology roadmaps.
  • Design and implement data models, pipelines, and data integration frameworks across multiple platforms.
  • Partner with stakeholders to translate business requirements into scalable data solutions.
  • Performance Optimization: Optimize data pipelines for performance, scalability, and reliability, including query tuning and resource management within Snowflake.
  • Drive adoption of best practices in data engineering design patterns and modern cloud architectures.
  • Data Quality Assurance: Implement and monitor data validation procedures to ensure data accuracy and consistency across systems.
  • Collaboration and Communication: Work closely with project managers, data architects, and business analysts to align project milestones and deliverables with business goals.
  • Mentor and guide data engineering teams (onsite & offshore) to deliver high-quality outcomes.
  • Ensure compliance with data governance, security, and privacy standards.
  • Documentation: Create and maintain detailed documentation of data pipelines, data flow diagrams, and transformation logic.
  • Issue Resolution: Troubleshoot and resolve issues related to data pipelines, including job failures and performance bottlenecks.
Required Qualifications:
  • Bachelor's degree in Computer Science, Information Technology, or a related field.
  • 8+ years of experience in data engineering with a strong focus on Data Architecture, Data Modelling (Conceptual, Logical, Physical), ELT processes and data pipeline development.
  • Hands-on experience with Snowflake cloud data platform, including data sharing, secure views, and performance optimization.
  • Proficiency in SQL and familiarity with data integration and ETL/ELT tools.
  • Azure Data Services and other Cloud Technologies (Glue, EMR)
  • Data Bricks hands on experience 
  • Python for data engineering workflows
  • Strong understanding of data engineering design patterns
  • Strong problem-solving skills and the ability to work independently to meet deadlines.
  • Excellent communication skills for effectively interacting with technical and non-technical stakeholders.
Preferred Qualifications:
  • Certifications in Snowflake or relevant data technologies.
  • Experience in the financial services sector, especially asset management / alternative investments, with an understanding of data security and compliance requirements.
  • Familiarity with cloud platforms (e.g., AWS, Azure) and data orchestration tools (e.g., Apache Airflow).
  • Knowledge of data visualization tools (e.g., Tableau, Power BI).
Why Join Us: 
At Ness, you will work with diverse, talented professionals who are dedicated to making an impact through technology. We encourage applicants of all backgrounds to apply—even if you don't meet every requirement, we'd love to connect with you if this role excites you. We're committed to creating an inclusive workplace that celebrates each team member's unique talents.   With flexible remote options, diverse projects, and access to development resources, joining Ness means building a career that's meaningful and impactful.  Ready to Start Your Journey?

  • Lead Software Engineer

    6 days ago

    Halifax, Nova Scotia, Canada Lloyds Banking Group Full time £90,440 - £164,920

    End DateWednesday 17 December 2025Salary Range£90,440 - £164,920We support flexible working – click here for more information on flexible working optionsFlexible Working OptionsHybrid Working, Job ShareJob Description Summary.Job DescriptionJOB TITLE: Lead Software EngineerSALARY: £90,440 - £106,000LOCATION(S): HalifaxHOURS: Full timeWORKING PATTERN:...

  • Data Engineer

    1 week ago

    Halifax, Nova Scotia, Canada Tiger Analytics Inc. Full time

    Tiger Analytics is a fast-growing advanced analytics consulting firm. Our consultants bring deep expertise in Data Engineering, Data Science, Machine Learning and AI. We are the trusted analytics partner for multiple Fortune 500 companies, enabling them to generate business value from data. Our business value and leadership has been recognized by various...

  • Engineering Lead

    7 days ago

    Halifax, Nova Scotia, Canada Lloyds Banking Group Full time £90,440 - £117,000

    End DateTuesday 16 December 2025Salary Range£90,440 - £106,400We support flexible working – click here for more information on flexible working optionsFlexible Working OptionsJob ShareJob Description Summary.Job DescriptionJOB TITLE:  Engineering LeadSALARY: £90,440 – £117,000LOCATION: Halifax or EdinburghHOURS:  Full timeWORKING PATTERN: Hybrid,...

  • Senior Data Engineer, GFT

    2 hours ago

    Halifax, Nova Scotia, Canada RBC Full time

    Job DescriptionWhat is the opportunity? Global Functions Technology (GFT) is part of RBC's Technology and Operations division. GFT's impact is far-reaching as we collaborate with partners from across the company to deliver innovative and transformative IT solutions. Our clients represent Risk, Finance, HR, CAO, Audit, Legal, Compliance, Financial Crime,...

  • Data Conversion Lead

    2 days ago

    Halifax, Nova Scotia, Canada United Software Group Inc Full time

    Data Conversion Lead | Remote (Canada)Halifax Canada (Remote)We are looking for aData Conversion Leadto support our client on a large-scaleidentity and access management (IAM) migration initiative. This role is ideal for a senior data professional with strong leadership, ETL, and data migration expertise who can drive complex conversions with precision and...

  • Sr SAS Developer

    2 weeks ago

    Halifax, Nova Scotia, Canada NTT DATA Full time

    Seeking a highly skilled SAS Developer with strong Data Science capabilities to design, develop, and optimize data-driven solutions. This role combines advanced SAS programming with modern data science techniques to deliver actionable insights, predictive models, and robust analytics for business decision-making. SAS Development: Design, develop, and...

  • Senior Data Engineer

    2 weeks ago

    Halifax, Nova Scotia, Canada RBC Full time

    Job DescriptionWhat is the Opportunity?The Compliance team, part of Global Functions Technology (GFT), focuses on trading and employee surveillance, privacy, and risk governance. This role is situated within the Compliance Technology division of GFT. The ideal candidate will be responsible for designing and implementing innovative solutions while addressing...

  • Senior Data Engineer

    6 days ago

    Halifax, Nova Scotia, Canada RBC Full time

    Job DescriptionWhat is the Opportunity?The Compliance team, part of Global Functions Technology (GFT), focuses on trading and employee surveillance, privacy, and risk governance. This role is situated within the Compliance Technology division of GFT. The ideal candidate will be responsible for designing and implementing innovative solutions while addressing...

  • Senior Data Engineer

    6 days ago

    Halifax, Nova Scotia, Canada RBC Full time

    Job DescriptionWhat is the Opportunity?The Compliance team, part of Global Functions Technology (GFT), focuses on trading and employee surveillance, privacy, and risk governance. This role is situated within the Compliance Technology division of GFT. The ideal candidate will be responsible for designing and implementing innovative solutions while addressing...

  • Senior Data Engineer

    6 days ago

    Halifax, Nova Scotia, Canada RBC Full time

    Job DescriptionWhat is the Opportunity?The Compliance team, part of Global Functions Technology (GFT), focuses on trading and employee surveillance, privacy, and risk governance. This role is situated within the Compliance Technology division of GFT. The ideal candidate will be responsible for designing and implementing innovative solutions while addressing...