Data Engineering Consultant

4 weeks ago

Halifax Regional Municipality, Canada CGI Full time

Position Description:

MUST-HAVE Security clearance: Reliability Clearance granted or eligible (5+ years residing in Canada)
Location: Halifax NS or any Atlantic region where a CGI office is located (NB, PEI or Newfoundland)

Are you a data engineering professional interested in working within a talented and collaborative team developing Cloud, Data, and AI solutions for leading global clients?

Do you often find yourself in discussions about disparate and scattered data sources and feel the need to create robust data engineering infrastructure to remedy this disorder? If you have the technical expertise to build pipelines and enable data engineering or ETL within organizations, a genuine problem-solving aptitude, and the mindset required to collaborate with diverse clients and team members, we are looking for you.

Your future duties and responsibilities:

As a data engineer within this team, your responsibilities will include:

• Strategic collaboration with clients to explore and deliver key data engineering solutions
• Delivery in areas of data preparation and transformations, as well as ETL or ELT development, whether on-premises or in the cloud
• Building data engineering pipelines on the cloud (Azure, AWS, GCP, etc.)
• Working in a professional environment with large, complex, and voluminous datasets, as well as scattered data sources
• Utilizing SQL or advanced SQL skills and Python skills as needed
• Gathering client requirements, coding, and implementing data solutions
• Implementing proof of concepts to demonstrate value, then packaging and scaling full-fledged data engineering both on-premises and in cloud environments
• Supporting and collaborating with other data engineers or data scientists on the team regarding technical knowledge

•Pipeline Construction: Build and maintain scalable and high-performance data pipelines using Azure Data Factory, Azure Databricks, or other Azure services to transport data seamlessly across systems.
•Data Storage and Management: Manage data storage in Azure, selecting appropriate storage solutions (like Azure Data Lake, Azure SQL Database) to ensure data is stored efficiently and securely.
•Data Cleaning and Transformation: Develop scripts or use ETL tools for data cleaning and transformation to prepare data for analysis, ensuring data quality and accessibility.
•Automation and Optimization: Automate pipelines and optimize data retrieval using Python and Azure Data Factory, Azure Data Bricks.
•Monitoring and Maintenance: Monitor data pipelines and performance, troubleshoot any issues, and ensure systems are up-to-date with the latest security patches.

Required qualifications to be successful in this role:

Required qualifications to be successful in this role
• 5 years or more of practical experience in data engineering
• Experience working on at least one modern cloud platform (Azure, AWS, GCP, etc.)
• Excellent communication and teamwork skills

Desirable:

• Experience in data engineering with ML projects
• Experience with pipeline management tools and data workflow tools such as Airflow, Jenkins, etc.
• Experience with a variety of tools such as Azure Data Factory, Google Dataflow, Qlik Compose, AWS Data Pipeline or Glue, Talend, Microsoft SSIS, IBM Datastage, Informatica

#LI-MT1

Skills:

Data Engineering English ETL MS SQL Server Python Amazon CloudFront French

  • DevOps Engineer

    1 month ago

    Halifax Regional Municipality, Canada NTT DATA Services Full time

    NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a DevOps Engineer (Onsite) to join our team in Halifax, Nova Scotia (CA-NS), Canada (CA). Platform Solutions team is looking...

  • Cloud Data Engineer

    2 months ago

    Halifax Regional Municipality, Canada CGI Full time

    Position Description: Location: Hybrid/GTA Job Type: Full-Time We are seeking a highly skilled and experienced Cloud Data Engineer to join our dynamic team. In this role, you will play a crucial role in designing and implementing cutting-edge data solutions using a variety of technologies and platforms. Your future duties and responsibilities: ...

  • Cloud Data Engineer

    4 weeks ago

    Halifax Regional Municipality, Canada CGI Full time

    Position Description: Location: Hybrid/GTA Job Type: Full-Time We are seeking a highly skilled and experienced Cloud Data Engineer to join our dynamic team. In this role, you will play a crucial role in designing and implementing cutting-edge data solutions using a variety of technologies and platforms. Your future duties and responsibilities: ...

  • Senior Data Engineering Consultant

    4 weeks ago

    Halifax, Canada CGI Full time

    Position Description: *** CANADIAN OPPORTUNITY FOR INTERNATIONAL CANDIDATES ONLY. If you are already in Canada, we invite you to apply on our local opportunities for quicker processing times*** Looking to immigrate to Canada? CGI’s global delivery Centre in Atlantic Canada is growing rapidly, with exciting work opportunities to serve dynamic global...

  • Senior Data Engineering Consultant

    1 week ago

    Halifax, Nova Scotia, Canada CGI Full time

    Position Description: *** CANADIAN OPPORTUNITY FOR INTERNATIONAL CANDIDATES ONLY. If you are already in Canada, we invite you to apply on our local opportunities for quicker processing times*** Looking to immigrate to Canada? CGI's global delivery Centre in Atlantic Canada is growing rapidly, with exciting work opportunities to serve dynamic global...

  • Senior Data Engineering Consultant

    4 weeks ago

    Halifax, Canada CGI Full time

    Position Description: *** CANADIAN OPPORTUNITY FOR INTERNATIONAL CANDIDATES ONLY. If you are already in Canada, we invite you to apply on our local opportunities for quicker processing times*** Looking to immigrate to Canada? CGI’s global delivery Centre in Atlantic Canada is growing rapidly, with exciting work opportunities to serve dynamic global...

  • SAP Supply Chain Data Consultant

    5 days ago

    Halifax, Canada NTT DATA Full time

    NTT DATA's Client is currently seeking a SAP Supply Chain Data Consultant to join their team in Canada (REMOTE). Must work EST hours to align with U.S. Responsibilities Provide continuous improvement and technical leadership to project delivery for SCM Solutions in demand planning (APO DP), manufacturing planning (APO PP DS), and global available-to-promise...

  • SAP Supply Chain Data Consultant

    6 days ago

    Halifax, Canada NTT DATA Full time

    NTT DATA's Client is currently seeking a SAP Supply Chain Data Consultant to join their team in Canada (REMOTE). Must work EST hours to align with U.S. **Responsibilities**: Provide continuous improvement and technical leadership to project delivery for SCM Solutions in demand planning (APO DP), manufacturing planning (APO PP DS), and global...

  • Sr DevOps Engineer

    2 months ago

    Halifax Regional Municipality, Canada Ness Digital Engineering Full time

    Description Ness is seeking an Sr DevOps Engineer. This role will assist with building out an on-premises failover environment and onboarding of all critical Renaissance applications in clearing, settlement, and risk pillars.  Customer is required by regulators to demonstrate the ability to run all clearing and risk systems through internal datacenter (...

  • Sr DevOps Engineer

    4 weeks ago

    Halifax Regional Municipality, Canada Ness Digital Engineering Full time

    Description Ness is seeking an Sr DevOps Engineer. This role will assist with building out an on-premises failover environment and onboarding of all critical Renaissance applications in clearing, settlement, and risk pillars.  Customer is required by regulators to demonstrate the ability to run all clearing and risk systems through internal datacenter (...

  • Sr Consultant, Health Data, Analytics and AI-Government and Public Sector

    2 months ago

    Halifax Regional Municipality, Canada CGI Full time

    Position Description: CGI is expanding its Health and Life Sciences Team in the Atlantic Region. We are seeking an experienced Senior Consultant of Health Data, Analytics and AI with experience leading and managing medium to large-sized technology consulting and delivery projects a complex healthcare setting. Experience working with Nova Scotia Health...

  • Site Reliability Engineering Consultant

    4 weeks ago

    Halifax Regional Municipality, Canada CGI Full time

    Position Description: As a Site Reliability Engineer (SRE), you will play a critical role in ensuring the reliability, performance, and availability of our systems. Your expertise in managing infrastructure, automating processes, and implementing best practices will contribute to seamless operations. You’ll collaborate with cross-functional teams,...

  • Tech Lead/Senior Data Engineer

    2 months ago

    Halifax Regional Municipality, Canada LifeRaft Full time

    As a key member of our engineering department, you will lead the design, development, and implementation of innovative data solutions to enhance our platform's capabilities. Leveraging your expertise in data engineering, you will collaborate closely with cross-functional teams to architect scalable data pipelines, optimize data workflows, and drive...

  • Tech Lead/Senior Data Engineer

    4 weeks ago

    Halifax Regional Municipality, Canada LifeRaft Full time

    As a key member of our engineering department, you will lead the design, development, and implementation of innovative data solutions to enhance our platform's capabilities. Leveraging your expertise in data engineering, you will collaborate closely with cross-functional teams to architect scalable data pipelines, optimize data workflows, and drive...

  • DevOps & Infra - Automation Engineer (Network Automation)

    4 weeks ago

    Halifax Regional Municipality, Canada Ness Digital Engineering Full time

    Description Ness is seeking an Sr DevOps/Automation Engineer. This role will assist with building out an on-premises failover environment and onboarding of all critical Renaissance applications in clearing, settlement, and risk pillars.  Customer is required by regulators to demonstrate the ability to run all clearing and risk systems through internal...

  • Lead Data Engineer, GFT

    4 weeks ago

    Halifax Regional Municipality, Canada Royal Bank of Canada> Full time

    Job SummaryJob DescriptionWhat is the opportunity?Are you a talented, creative, and results-driven professional who thrives on delivering high-performing applications. Come join us!Global Functions Technology (GFT) is part of RBC’s Technology and Operations division. GFT’s impact is far-reaching as we collaborate with partners from across the company to...

  • Lead Data Engineer, GFT

    4 weeks ago

    Halifax Regional Municipality, Canada Royal Bank of Canada> Full time

    Job SummaryJob DescriptionWhat is the opportunity?Are you a talented, creative, and results-driven professional who thrives on delivering high-performing applications. Come join us!Global Functions Technology (GFT) is part of RBC’s Technology and Operations division. GFT’s impact is far-reaching as we collaborate with partners from across the company to...

  • DevOps & Infra - Automation Engineer (SailPoint API, Python)

    2 months ago

    Halifax Regional Municipality, Canada Ness Digital Engineering Full time

    Description Ness is seeking an Sr DevOps/Automation Engineer. This role will assist with building out an on-premises failover environment and onboarding of all critical Renaissance applications in clearing, settlement, and risk pillars.  Customer is required by regulators to demonstrate the ability to run all clearing and risk systems through internal...

  • DevOps & Infra - Automation Engineer (Service Now Expert)

    4 weeks ago

    Halifax Regional Municipality, Canada Ness Digital Engineering Full time

    Description Ness is seeking an Sr DevOps/Automation Engineer. This role will assist with building out an on-premises failover environment and onboarding of all critical Renaissance applications in clearing, settlement, and risk pillars.  Customer is required by regulators to demonstrate the ability to run all clearing and risk systems through internal...

  • DevOps & Infra - Automation Engineer (Service Now Expert)

    1 month ago

    Halifax Regional Municipality, Canada Ness Digital Engineering Full time

    Description Ness is seeking an Sr DevOps/Automation Engineer. This role will assist with building out an on-premises failover environment and onboarding of all critical Renaissance applications in clearing, settlement, and risk pillars.  Customer is required by regulators to demonstrate the ability to run all clearing and risk systems through internal...