Current jobs related to Data Engineer - Canada - HCLTech

  • Data Engineering Specialist

    7 days ago

    Canada Data Elephant Full time

    About UsData Elephant is a boutique data and analytics consulting firm based in Vancouver, BC. We help Canadian organizations develop data strategies, modernize their data platforms, and unlock the power of data, analytics, and AI.We're looking for a Cloud Data Solutions Architect to join our growing team. In this role, you'll contribute to the design,...

  • Databricks Data Engineer

    1 week ago

    Canada Data Elephant Full time

    About UsWe're a boutique data and analytics consulting firm based in Vancouver, BC, helping Canadian organizations develop data strategies, modernize their data platforms and unlock the power of data, analytics, ML and GenAI. As a certified partner with leading cloud platforms, including AWS, Azure and Databricks, we deliver strategic solutions that create...

  • Databricks Data Engineer

    1 week ago

    Canada Data Elephant Full time

    About Us We're a boutique data and analytics consulting firm based in Vancouver, BC, helping Canadian organizations develop data strategies, modernize their data platforms and unlock the power of data, analytics, ML and GenAI. As a certified partner with leading cloud platforms, including AWS, Azure and Databricks, we deliver strategic solutions that create...

  • Data Engineering Lead for Cloud Data Platforms

    1 week ago

    Canada Data Elephant Full time

    About Data ElephantWe're a boutique data and analytics consulting firm based in Vancouver, BC, helping Canadian organizations develop data strategies, modernize their data platforms, and unlock the power of data, analytics, ML, and GenAI.Our MissionWe deliver strategic solutions that create real business impact. Our team thrives on solving complex...

  • Big Data Pipeline Developer

    7 days ago

    Canada Data Elephant Full time

    About the Role:We're looking for a Data Engineer to join our growing team. As a key member of our data engineering team, you will be responsible for designing, developing, and deploying modern data solutions using Azure, AWS, and Databricks.Your primary focus will be on building scalable and efficient data pipelines that meet the needs of our clients. You...

  • Cloud Data Solutions Architect

    7 days ago

    Canada Data Elephant Full time

    Job Description:We are seeking a Big Data Pipeline Developer to join our team. As a key member of our data engineering team, you will be responsible for designing, developing, and deploying big data pipelines using Azure Databricks, Delta Lake, and AWS Glue.Your primary focus will be on building scalable and efficient data pipelines that meet the needs of...

  • Data Engineer

    6 days ago

    Canada KData AI Full time

    Company Description KData AI is a leading firm in Data and AI Engineering in the cloud, dedicated to delivering exceptional results for businesses worldwide. We specialize in transforming data into actionable insights through innovative AI and engineering solutions. We are looking for an experienced Data Architect with a minimum of 5 years in designing...

  • Data Engineer

    4 days ago

    Canada KData AI Full time

    Company Description KData AI is a leading firm in Data and AI Engineering in the cloud, dedicated to delivering exceptional results for businesses worldwide. We specialize in transforming data into actionable insights through innovative AI and engineering solutions. We are looking for an experienced Data Architect with a minimum of 5 years in designing...

  • Data Engineer

    4 weeks ago

    Canada KData AI Full time

    Company DescriptionKData AI is a leading firm in Data and AI Engineering in the cloud, dedicated to delivering exceptional results for businesses worldwide. We specialize in transforming data into actionable insights through innovative AI and engineering solutions. Follow us on Twitter: @KDataAI.Role DescriptionThis is a full time role for a Data Engineer....

  • Data Engineer

    15 hours ago

    Canada Aadhya Tech Inc Full time

    Company Description Aadhya Tech Inc specializes in delivering IT consulting and recruitment services to help businesses thrive in the digital world. With a focus on quality, agility, and innovation, we solve complex tech challenges and build teams for long-term success. Our services include IT consulting, technical and non-technical recruitment, staffing,...

  • Data Engineer

    22 hours ago

    Canada Aadhya Tech Inc Full time

    Company Description Aadhya Tech Inc specializes in delivering IT consulting and recruitment services to help businesses thrive in the digital world. With a focus on quality, agility, and innovation, we solve complex tech challenges and build teams for long-term success. Our services include IT consulting, technical and non-technical recruitment, staffing,...

  • Data Engineer

    1 week ago

    Canada NXT Move IT Solutions Inc Full time

    Company DescriptionNXT Move IT Solutions Inc. is a Toronto-based company providing cutting-edge IT services, expert consulting, and technology recruitment solutions across North America. We specialize in application development, cloud architecture, DevOps engineering, cybersecurity, data platforms, and enterprise systems. Serving clients locally and...

  • Data Engineer

    3 weeks ago

    Canada Summer Full time

    Title: Data EngineerLocation: Remote CanadaAbout this Role: As a Data Engineer, you will play a crucial role in designing, building, and optimizing our data infrastructure. You'll be responsible for developing scalable data pipelines, implementing ETL processes, and ensuring the quality and integrity of our data. Your expertise will contribute to the success...

  • Data Engineer

    3 weeks ago

    Canada Summer Full time

    Title: Data Engineer Location: Remote Canada About this Role: As a Data Engineer, you will play a crucial role in designing, building, and optimizing our data infrastructure. You'll be responsible for developing scalable data pipelines, implementing ETL processes, and ensuring the quality and integrity of our data. Your expertise will contribute to the...

  • Data Engineer

    2 weeks ago

    Canada United Software Group Inc Full time

    Job Title: Data EngineerRemote work12 Months ContractPosition overview : Help us create our Financial Data Warehouse using dbt, Dagster, Snowflake and Power BIResponsibilities :Build our data pipelines for our Financial Data WarehouseBuild power bi reports and dashboards associated to this processContribute to our strategy for new data pipelines and data...

  • Data Engineer

    5 days ago

    Canada United Software Group Inc Full time

    Job Title: Data Engineer Remote work 12 Months Contract Position overview : Help us create our Financial Data Warehouse using dbt, Dagster, Snowflake and Power BI Responsibilities : Build our data pipelines for our Financial Data Warehouse Build power bi reports and dashboards associated to this process Contribute to our strategy for new data...

  • Data Engineer

    3 weeks ago

    Canada hireVouch Full time

    Our client is a leading data and cloud services provider that works with enterprise companies to build systems and infrastructures for them. As a Data Engineer, you'd be responsible for designing, building, and optimizing data pipelines, ensuring seamless data flow and analytics capabilities. This is a 6-month contract, with a possibility of extension. ...

  • Data Engineer

    2 weeks ago

    Canada IT Chapter Full time

    The Data Engineer will be responsible for leading the delivery of data on data and analytics platform. These services are at the forefront of building out data engineering practice cloud-native technologies. The Senior Data Engineer Service Provider must have experience in leading, designing, implementing, and collaborating with stakeholders to achieve the...

  • Data Engineer

    4 days ago

    Canada Hire DigITalent Inc. Full time

    We are seeking an experienced and detail-oriented Data Engineer to join one of our clients teams. In this role, you will be responsible for architecting and maintaining reliable, scalable data solutions that enable seamless data flow across various platforms. Your expertise in Boomi iPaaS will be central to building and optimizing integrations between...

  • Data Engineer

    20 hours ago

    Canada Hire DigITalent Inc. Full time

    We are seeking an experienced and detail-oriented Data Engineer to join one of our clients teams. In this role, you will be responsible for architecting and maintaining reliable, scalable data solutions that enable seamless data flow across various platforms. Your expertise in Boomi iPaaS will be central to building and optimizing integrations between...

Data Engineer

4 weeks ago

Canada HCLTech Full time

Skillset required for Data/MLOps Engineer:

  • Experience within the Azure ecosystem, including Azure AI Search, Azure Storage Blob, Azure Postgres, with expertise in leveraging these tools for data processing, storage, and analytics tasks.
  • Proficiency in data preprocessing and cleaning large datasets efficiently using Azure Tools, Python, and other data manipulation tools.
  • Strong background in Data Science/MLOps, with hands-on experience in DevOps, CI/CD, Azure Cloud computing, and model monitoring.
  • Expertise in healthcare data standards, such as HIPAA and FHIR, with a deep understanding of sensitive data handling and data masking techniques to protect PII and PHI.
  • In-depth knowledge of search algorithms, indexing techniques, and retrieval models for effective information retrieval tasks.
  • Experience with chunking techniques and working with vectors and vector databases like Pinecone.
  • Ability to design, develop, and maintain scalable data pipelines for processing and transforming large volumes of structured and unstructured data, ensuring performance and scalability.
  • Implement best practices for data storage, retrieval, and access control to maintain data integrity, security, and compliance with regulatory requirements.
  • Implement efficient data processing workflows to support the training and evaluation of solutions using large language models (LLMs), ensuring that models are reliable, scalable, and performant.
  • Proactively identify and resolve data quality issues, pipeline failures, or resource contention to minimize disruption to systems.
  • Experience with large language model frameworks, such as Langchain, and the ability to integrate them into data pipelines for natural language processing tasks.
  • Familiarity with Snowflake for data management and analytics, with the ability to work within the Snowflake ecosystem to support data processes.
    • Knowledge of cloud computing principles and hands-on experience with deploying, scaling, and monitoring AI solutions on platforms like Azure, AWS, and Snowflake.
      • Ability to communicate complex technical concepts effectively to both technical and non-technical stakeholders and collaborate with cross-functional teams.
        • Analytical mindset with attention to detail, coupled with the ability to solve complex problems efficiently and effectively.
          • Knowledge of cloud cost management principles and best practices to optimize cloud resource usage and minimize costs.

Experience with ML model deployment, including testing, validation, and integration of machine learning models into production systems.

  • Knowledge of model versioning and management tools, such as MLflow or Azure Machine Learning, for tracking experiments, versions, and deployments.
    • Model monitoring and performance optimization, including tracking model drift and addressing performance issues to ensure models remain accurate and reliable.
      • Automation of ML workflows through CI/CD pipelines, enabling smooth model training, testing, validation, and deployment.
        • Monitoring and logging of AI/ML systems post-deployment to ensure consistent reliability, scalability, and performance.
          • Collaboration with data scientists and engineering teams to facilitate model retraining, fine-tuning, and updating.
            • Familiarity with containerization technologies, like Docker and Kubernetes, for deploying and scaling machine learning models in production environments.
              • Ability to implement model governance practices to ensure compliance and auditability of AI/ML systems.

Understanding of model explainability and the use of tools and techniques to provide transparent insights into model behavior.

Must Have:

  • Minimum of 10 years' experience as a data engineer
  • Hands-on experience with Azure Cloud eco-system.
  • Hands-on experience using Python for data manipulation.
  • Deep understanding of vectors and vector databases.
  • Hands-on experience scaling POC to production.
  • Hands-on experience using tools such as Document Intelligence, Snowflake, function app. Azure AI Search
  • Experience working with PII/PHI
  • Hands-on experience working with unstructured data.