Data Engineer

4 weeks ago


Canada Intelliswift Software Full time

Job Title: Data Engineer

Location: Anywhere in Canada (100% remote)

Duration: 12+ months


Position Overview:

We are seeking a highly skilled and motivated Data Engineer to join our team. The ideal candidate will have a strong background in data engineering, with expertise in DataBricks and Data Lake technologies. This role will involve designing, building, and optimizing data pipelines and analytical solutions to support our organization's data-driven initiatives.


Key Responsibilities:

Design, develop, and maintain scalable data pipelines using DataBricks for data ingestion, transformation, and processing.

Implement and optimize DataBricks jobs to handle large volumes of data efficiently.

Collaborate with data architects and analysts to design and implement data lake solutions that meet business requirements.

Develop and maintain data lake infrastructure on platforms such as AWS S3, Azure Data Lake Storage, or Google Cloud Storage.

Write complex SQL and Spark queries for data analysis, aggregation, and reporting within the DataBricks environment.

Implement data governance, security, and access control policies to ensure data quality and compliance.

Monitor and troubleshoot data pipeline issues, identify performance bottlenecks, and implement optimizations.

Stay updated with the latest DataBricks features, best practices, and data engineering trends.


Qualifications:

Bachelor's degree in Computer Science, Engineering, or related field.

Proven experience working as a Data Engineer or similar role.

Strong proficiency in DataBricks and Apache Spark for big data processing.

Experience working with Data Lake architectures and technologies.

Solid understanding of cloud platforms such as AWS, Azure, or Google Cloud Platform.

Proficiency in SQL for data querying and manipulation.

Experience with data modeling, ETL processes, and data warehousing concepts.

Strong problem-solving and analytical skills.

Effective communication and collaboration abilities.


Preferred Qualifications:

Master's degree in Computer Science, Engineering, or related field.

Certifications in DataBricks or relevant cloud platforms.

Experience with other big data technologies such as Hadoop, Kafka, or Apache Flink.

Familiarity with containerization technologies such as Docker and Kubernetes.


  • Sr Data Engineer

    1 week ago


    Canada NTT Data Vertex Software Inc. Full time

    Apply for Sr Data Engineer, Career Progress Consultants in Canada for Year of Experience on

  • Sr Data Engineer

    1 week ago


    Canada NTT Data Vertex Software Inc. Full time

    Apply for Sr Data Engineer, Career Progress Consultants in Canada for 8 - 11 Year of Experience on TimesJobs.com.

  • Lead Engineer

    4 weeks ago


    Canada Scribble Data Full time

    About Scribble Data Scribble Data is a generative AI (GenAI), machine learning (ML), and advanced analytics data products platform company. It focuses on the Annuities and Pension Risk Transfer (PRT) segments of the Insurance industry in the US, Canada, and UK. Hasper - Scribble Data's flagship product, is designed to implement and transform...

  • Data Engineering

    3 weeks ago


    Canada Shopify Full time

    About the roleData is a crucial part of Shopify's mission to make commerce better for everyone. We organize and interpret petabytes of data to provide solutions for our merchants and stakeholders across the organization. As a Data Engineer at Shopify, your primary responsibility will be to contribute to Shopify's Data Warehouse, while unlocking powerful...

  • Data Engineering

    7 days ago


    Canada Shopify Full time

    About the roleData is a crucial part of Shopify's mission to make commerce better for everyone. We organize and interpret petabytes of data to provide solutions for our merchants and stakeholders across the organization. As a Data Engineer at Shopify, your primary responsibility will be to contribute to Shopify's Data Warehouse, while unlocking powerful...

  • Data Engineer

    1 week ago


    Canada Epsilon Solutions Ltd. Full time

    Join to apply for the Data Engineer role at Epsilon Solutions Ltd. Join to apply for the Data Engineer role at Epsilon Solutions Ltd. Save this job with your existing LinkedIn profile, or create a new one. Save this job with your existing LinkedIn profile, or create a new one. Your job seeking activity is only visible to you. Email Welcome back ...

  • Data Engineer

    3 days ago


    Canada CGS (Computer Generated Solutions) Full time

    Data Engineer– Full time – Permanent PositionComputer Generated Solutions – Saint John, NBOpen for Remote workCorporate Profile:We provide custom learning solutions, channel partner enablement services and applications development. Since 1984, CGS has been delivering expert, cross-industry solutions across multiple platforms. To learn more about us,...

  • Data Engineer

    2 days ago


    Canada CGS (Computer Generated Solutions) Full time

    Data Engineer– Full time – Permanent PositionComputer Generated Solutions – Saint John, NBOpen for Remote workCorporate Profile:We provide custom learning solutions, channel partner enablement services and applications development. Since 1984, CGS has been delivering expert, cross-industry solutions across multiple platforms. To learn more about us,...

  • Data Engineer

    2 days ago


    Canada CGS (Computer Generated Solutions) Full time

    Data Engineer– Full time – Permanent Position Computer Generated Solutions – Saint John, NB Open for Remote work Corporate Profile: We provide custom learning solutions, channel partner enablement services and applications development. Since 1984, CGS has been delivering expert, cross-industry solutions across multiple platforms. To learn more about...

  • Data Engineer

    2 weeks ago


    Canada Orion eSolutions Full time

    As a Data Engineer at Orion, you will be responsible for designing, developing, and maintaining data pipelines, as well as analyzing and interpreting data to extract actionable insights. This role requires technical expertise in data engineering to support the decision-making processes across the organization. Experience: 3-7 years Job location: Remote ...

  • Data Engineer

    4 weeks ago


    Canada Wysdom Full time

    They say you only get one chance to make a great first impression. At Wysdom we’re here to change that. We exist to help our clients make a great first impression with their customers – over and over again! Conversation is the new user interface (UI). It will power everything from self-driving cars to gadgets around your home. For a conversational UI to...


  • Canada Quantum Technology Recruiting Inc. Full time

    Save this job with your existing LinkedIn profile, or create a new one. Save this job with your existing LinkedIn profile, or create a new one. Your job seeking activity is only visible to you. Email Welcome back Sign in to save Senior Data Engineer at Quantum Technology Recruiting Inc. (QTR) . Our client, a leading American delivery company based...

  • Data Engineer

    4 weeks ago


    Canada Intelliswift Software Full time

    Job Title: Data Engineer Location: Anywhere in Canada (100% remote) Duration: 12+ months Position Overview: We are seeking a highly skilled and motivated Data Engineer to join our team. The ideal candidate will have a strong background in data engineering, with expertise in DataBricks and Data Lake technologies. This role will involve designing, building,...


  • Canada The Kynetec Group Full time

    Responsibilities: - Provide leadership, support and mentorship to a small team, ensuring their professional and technical growth. - Collaborate effectively with leadership at all levels and contribute towards Data Engineering strategy and direction. - Design and develop new techniques and data pipelines to enable various insights for internal and external...

  • Senior Data Engineer

    4 weeks ago


    Canada Collage HR Full time

    Product & Technology Full Time Montreal, QC Our platform is designed to capture the real-world performance of go-to-market teams, offering a clear picture of their success and challenges. That's why we're seeking an exceptional Senior Data Engineer to join our team and contribute to this vital mission. *** Welcome to Vasco, a science-driven revenue...

  • Senior Data Engineer

    2 weeks ago


    Canada Techedinlabs Full time

    We have an opportunity for a "Senior Data Engineer" role based in Canada. Kindly review the job description provided below. This position offers full-time engagement with the flexibility of remote work, although candidates must reside within Canadian territory. Minimum Qualifications Bachelor’s degree in computer science, Engineering or related field,...

  • Lead Data Engineer

    1 week ago


    Canada Kynetec Full time

    At Kynetec, we're proud to be at the forefront of the intersection between agriculture, sustainability, and animal health. We’re redefining our industry with unparalleled insights and leading technology, whilst on an ambitious growth plan to supersede our influence from the food on our plates, to the health of our livestock and the care of our beloved pets...

  • Lead Data Engineer

    1 week ago


    Canada Kynetec Full time

    At Kynetec, we're proud to be at the forefront of the intersection between agriculture, sustainability, and animal health. We’re redefining our industry with unparalleled insights and leading technology, whilst on an ambitious growth plan to supersede our influence from the food on our plates, to the health of our livestock and the care of our beloved pets...

  • Lead Data Engineer

    2 weeks ago


    Canada Kynetec Full time

    At Kynetec, we're proud to be at the forefront of the intersection between agriculture, sustainability, and animal health. We’re redefining our industry with unparalleled insights and leading technology, whilst on an ambitious growth plan to supersede our influence from the food on our plates, to the health of our livestock and the care of our beloved pets...

  • Data Engineer/MLOps

    6 days ago


    Canada COGNITO INC Full time

    Data Engineer Location: Toronto, ON Job Description: Mandate Skills: ML OPS, Azure Data bricks, Visualization Experience, SQL, Python Job Description: Minimum 5 years of experience in Data Engineering role that involves Analyzing, organizing raw data, and building data systems & pipelines in Cloud Platform [Azure] Experienced in migrating data from...