W2 : Data Engineer - Mississauga, ON / Montreal, QC( Hybrid )

4 weeks ago


Mississauga, Canada Zodiac Solutions Full time

Role: Data Engineer

Location: Mississauga, ON / Montreal, QC

3 Days Hybrid from Day 1

Must Have:

  • Snowflake
  • SQL
  • Python
  • ADF

Job Description:

This position is for a Cloud Data Engineer with a background in Python, Pyspark, SQL, and data warehousing for enterprise-level systems. The position calls for someone who is comfortable working with business users along with business analyst expertise.

Major Responsibilities:

  • Build and optimize data pipelines for efficient data ingestion, transformation, and loading from various sources while ensuring data quality and integrity.
  • Design, develop, and deploy Spark programs in the Databricks environment to process and analyze large volumes of data.
  • Experience with Delta Lake, DWH, Data Integration, Cloud, Design, and Data Modelling.
  • Proficient in developing programs in Python and SQL.
  • Experience with Data Warehouse Dimensional data modeling.
  • Work with event-based/streaming technologies to ingest and process data.
  • Work with structured, semi-structured, and unstructured data.
  • Optimize Databricks jobs for performance and scalability to handle big data workloads.
  • Monitor and troubleshoot Databricks jobs, identifying and resolving issues or bottlenecks.
  • Implement best practices for data management, security, and governance within the Databricks environment.
  • Experience designing and developing Enterprise Data Warehouse solutions.
  • Proficient in writing SQL queries and programming including stored procedures and reverse engineering existing processes.
  • Perform code reviews to ensure fit to requirements, optimal execution patterns, and adherence to established standards.

Skills:

  • 5+ years Python coding experience.
  • 5+ years SQL Server-based development of large datasets.
  • 5+ years of experience developing and deploying ETL pipelines using Databricks Pyspark.
  • Experience in any cloud data warehouse like Synapse, Big Query, Redshift, Snowflake.
  • Experience in Data Warehousing - OLTP, OLAP, Dimensions, Facts, and Data modeling.
  • Previous experience leading an enterprise-wide Cloud Data Platform migration with strong architectural and design skills.
  • Experience with cloud-based data architectures, messaging, and analytics.
  • Cloud certification(s).
  • Any experience with Airflow is a plus.
#J-18808-Ljbffr

  • Mississauga, Canada Data Engineer Jobs Full time

    Job Summary What is the opportunity? Data Engineer on the Insurance Development team in Technology & Operations at the Royal Bank of Canada. We are looking for an energetic, dynamic, collaborative, progressive, and high-performing team member who is highly talented and willing to share and work together. Our team is looking for a data engineer who is...


  • Mississauga, Ontario, Canada Data Engineer Jobs Full time

    Job Title: Data Engineer, FinanceAutoCapital Canada Inc. is a leading financial services company with a strong presence in the Canadian market. We are seeking a highly skilled Data Engineer to join our team and contribute to the development of our data-driven solutions.Key Responsibilities:Design, implement, and maintain robust data pipelines and ETL...

  • Senior Data Engineer

    1 month ago


    Mississauga, Ontario, Canada Data Engineer Jobs Full time

    About the RoleWe are seeking an experienced Data Engineer to join our team at AutoCapital Canada. As a Data Engineer, you will play a crucial role in designing, implementing, and maintaining robust data pipelines and ETL processes for efficient extraction, transformation, and loading of large-scale datasets.Key ResponsibilitiesData Pipeline Design and...


  • Mississauga, Ontario, Canada Data Engineer Jobs Full time

    Job Title: Senior Data Processing EngineerCompany Overview:AutoCapital Canada Inc. is a Canadian national financial services company with a diverse portfolio of automotive, consumer, and merchant lending.We specialize in managing the entire lifecycle of finance receivables, from credit adjudication to contract administration and customer service.We work...


  • Mississauga, Canada Data Engineer Jobs Full time

    AutoCapital Canada Inc. is part of privately-owned Canadian national financial services company with multiple verticals across automotive, consumer, and merchant lending portfolios. We manage the entire lifecycle of the finance receivable from credit adjudication through to contract administration, customer service, default management and post charge-off...


  • Mississauga, Ontario, Canada Data Engineer Jobs Full time

    AutoCapital Canada Inc. is a leading Canadian financial services company with diverse portfolios across automotive, consumer, and merchant lending.About the RoleThis position offers an exciting opportunity to leverage big data and cloud computing technologies in writing impactful data pipelines that drive business growth.Design, implement, and maintain...


  • Mississauga, Canada Atlantis IT group Full time

    **Role name: Transition Manager** **Location : Mississauga,ON (Hybrid)** **Duration : 12+ Months(long-term contract)** **Transition Management, Project Management, Delivery Management** **Role Description**: Managing Business Analyst role, Responsible & accountable for doing requirement gathering and creation of high level and detailed Docs. Analyzing...

  • Senior Data Architect

    3 weeks ago


    Mississauga, Ontario, Canada Data Engineer Jobs Full time

    Unlock career opportunities as a Senior Data Architect with AutoCapital Canada Inc., a leading national financial services company. Our team focuses on innovative data solutions and cutting-edge technology to drive business growth.We are looking for an experienced Senior Data Architect to join our Engineering team in Toronto, Ontario. As a key member of the...


  • Mississauga, Canada Atlantis IT group Full time

    Role - Transition Manager Location - Mississauga, ON - Hybrid Duration - Long term **Role Description**: Managing Business Analyst role ,Responsible & accountable for doing requirement gathering and creation of high level and detailed Docs. - Analyzing various source of data and compare with target data. Able to convey the right message. **Competencies**:...

  • Process Support

    6 months ago


    Mississauga, Canada Linde plc Full time

    **Process Support (Summer Student) Mississauga, ON or Montreal, QC** - 24000786 Linde is a leading global industrial gases and engineering company with 2022 sales of $33 billion. We live our mission of making our world more productive every day by providing high-quality solutions, technologies and services which are making our customers more successful and...


  • Mississauga, Canada Virtual Labs Full time

    Role: Data Engineer Location: Mississauga, ON / Montreal, QC (3 Days Hybrid from Day 1) Client: Synecheron // Mizuho Must Have: Snowflake, SQL, Python, ADF Job Description: This position is for a Cloud Data Engineer with a background in Python, Pyspark, SQL, and data warehousing for enterprise-level systems. The position calls for someone comfortable working...


  • Mississauga, Canada McKesson’s Corporate Full time

    h3>Scientifique de données / Data Scientist - AI & InnovationApply remote type Hybrid locations CAN, QC, Montreal, Ville Saint-Laurent CAN, ON, Mississauga time type Full time posted on Posted Yesterday job requisition id JR0121478McKesson is an impact-driven, Fortune 10 company that touches virtually every aspect of healthcare. We are known for delivering...

  • Data Engineer

    6 months ago


    Mississauga, Canada CB Canada Full time

    Data Engineer On behalf of our client in the Retail Sector, PROCOM is looking for a Data Engineer. Data Engineer – Mandatory Skills Proficient in building data pipelines in Hadoop/GCP Expert in data analysis using SQL Ability to build scalable resilient systems with minimum guidance 5+ years’ experience in data engineering Team player, mindset to work...


  • Mississauga, Canada Plaxonic Technologies Full time

    **Pole Line QC Specialist** **Location: Mississauga, Ontario** **Hybrid - Once a week/ One day a week to office** **Fulltime** **Position Requirements**: - High school diploma or equivalent; college degree (preferred)_ - Must have experience in the Telecommunications Outside plant engineering and/or construction industry._ Experience with Aerial...

  • Murex Business Analyst

    3 months ago


    Mississauga, Canada Compest Solutions Inc Full time

    **Key Responsibilities**: - **5 - 7 years IT experience as a Data Analyst, with minimum 2 - 3 years of Murex experience.**: - **Collaborate with various teams to generate accurate and reliable financial data using the Murex and Calculation engine platforms.**: - **Troubleshoot and resolve issues pertaining to data quality, ensuring the integrity of...


  • Mississauga, Ontario, Peel region, Canada Randstad Digital Full time

    Senior Data Engineer (Contract Position)Number of Positions: 1 Duration: 3 months initial contract, FT perm conversation possible Location: Mississauga, ON, CAMust be eligible to work in CanadaHybrid position, 2d / w onsite in Mississauga ONRoles and responsibilities:This role is to help migrate from Azure synapses into Databricks and the redesign of the...

  • Data Analyst

    3 weeks ago


    Mississauga, Canada Atlantis IT group Full time

    **Role name: Data Analyst** **Location: Mississauga, ON | Hybrid** **Duration: 12 Months** Role Description: Managing Data Analyst role, Compare data and match against the requirement. Analyzing various source of data and compare with target data. Responsible & accountable for doing requirement gathering and creation of high level and detailed technical...


  • Mississauga, Ontario, Canada KUBRA Data Transfer Ltd Full time

    We are seeking a highly skilled Reliability Engineering Manager to join our team at KUBRA Data Transfer Ltd. in Mississauga, ON.This is a hybrid opportunity that offers a unique blend of technical and leadership challenges. As a Reliability Engineering Manager, you will play a critical role in ensuring the high availability and security of our customer...


  • Mississauga, Canada CRH Canada - Cement ON Full time

    Job ID: 488563 Ash Grove Cement, a CRH company, provides Portland and masonry cements to help build the foundation and infrastructure for the world around us. We ship millions of tons of cement from our plants and network of terminals located across North America. When you work for Ash Grove, you are connecting to something bigger. We stand together to...


  • Mississauga, Canada TRANSFLOW EXPEDITE LTD. Full time

    We are hiring for Montreal-QC run, Min 2 Years Experience required, Please call VarinderPal Khaira - + 1 (647) 296-7719 Pay: $100,000.00 per year **Benefits**: - Language training provided Flexible language requirement: - English not required Schedule: - 10 hour shift - 12 hour shift Work Location: In person