Data Engineering Consultant

2 weeks ago

Halifax Regional Municipality, Canada CGI Full time

Position Description:

MUST-HAVE Security clearance: Reliability Clearance granted or eligible (5+ years residing in Canada)
Location: Halifax NS or any Atlantic region where a CGI office is located (NB, PEI or Newfoundland)

Are you a data engineering professional interested in working within a talented and collaborative team developing Cloud, Data, and AI solutions for leading global clients?

Do you often find yourself in discussions about disparate and scattered data sources and feel the need to create robust data engineering infrastructure to remedy this disorder? If you have the technical expertise to build pipelines and enable data engineering or ETL within organizations, a genuine problem-solving aptitude, and the mindset required to collaborate with diverse clients and team members, we are looking for you.

Your future duties and responsibilities:

As a data engineer within this team, your responsibilities will include:

• Strategic collaboration with clients to explore and deliver key data engineering solutions
• Delivery in areas of data preparation and transformations, as well as ETL or ELT development, whether on-premises or in the cloud
• Building data engineering pipelines on the cloud (Azure, AWS, GCP, etc.)
• Working in a professional environment with large, complex, and voluminous datasets, as well as scattered data sources
• Utilizing SQL or advanced SQL skills and Python skills as needed
• Gathering client requirements, coding, and implementing data solutions
• Implementing proof of concepts to demonstrate value, then packaging and scaling full-fledged data engineering both on-premises and in cloud environments
• Supporting and collaborating with other data engineers or data scientists on the team regarding technical knowledge

•Pipeline Construction: Build and maintain scalable and high-performance data pipelines using Azure Data Factory, Azure Databricks, or other Azure services to transport data seamlessly across systems.
•Data Storage and Management: Manage data storage in Azure, selecting appropriate storage solutions (like Azure Data Lake, Azure SQL Database) to ensure data is stored efficiently and securely.
•Data Cleaning and Transformation: Develop scripts or use ETL tools for data cleaning and transformation to prepare data for analysis, ensuring data quality and accessibility.
•Automation and Optimization: Automate pipelines and optimize data retrieval using Python and Azure Data Factory, Azure Data Bricks.
•Monitoring and Maintenance: Monitor data pipelines and performance, troubleshoot any issues, and ensure systems are up-to-date with the latest security patches.

Required qualifications to be successful in this role:

Required qualifications to be successful in this role
• 5 years or more of practical experience in data engineering
• Experience working on at least one modern cloud platform (Azure, AWS, GCP, etc.)
• Excellent communication and teamwork skills

Desirable:

• Experience in data engineering with ML projects
• Experience with pipeline management tools and data workflow tools such as Airflow, Jenkins, etc.
• Experience with a variety of tools such as Azure Data Factory, Google Dataflow, Qlik Compose, AWS Data Pipeline or Glue, Talend, Microsoft SSIS, IBM Datastage, Informatica

#LI-MT1

Skills:

Data Engineering English ETL MS SQL Server Python Amazon CloudFront French

  • Senior Data Engineering Consultant

    1 month ago

    Halifax Regional Municipality, Canada CGI Full time

    Position Description: Principal Quant Data Engineering The Role The Asset Management Quant Research Engineering team is looking for a Principal Data Engineering who wishes to take on the challenge of building a world-class data operation. We are looking for individuals who bring expertise in data onboarding and quality best practices and the drive to...

  • DevOps Engineer

    4 days ago

    Halifax Regional Municipality, Canada NTT DATA Services Full time

    NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a DevOps Engineer (Onsite) to join our team in Halifax, Nova Scotia (CA-NS), Canada (CA). Platform Solutions team is looking...

  • Cloud Data Engineer

    1 month ago

    Halifax Regional Municipality, Canada CGI Full time

    Position Description: Location: Hybrid/GTA Job Type: Full-Time We are seeking a highly skilled and experienced Cloud Data Engineer to join our dynamic team. In this role, you will play a crucial role in designing and implementing cutting-edge data solutions using a variety of technologies and platforms. Your future duties and responsibilities: ...

  • Sr Consultant, Health Data, Analytics and AI-Government and Public Sector

    1 month ago

    Halifax Regional Municipality, Canada CGI Full time

    Position Description: CGI is expanding its Health and Life Sciences Team in the Atlantic Region. We are seeking an experienced Senior Consultant of Health Data, Analytics and AI with experience leading and managing medium to large-sized technology consulting and delivery projects a complex healthcare setting. Experience working with Nova Scotia Health...

  • Sr DevOps Engineer

    4 weeks ago

    Halifax Regional Municipality, Canada Ness Digital Engineering Full time

    Description Ness is seeking an Sr DevOps Engineer. This role will assist with building out an on-premises failover environment and onboarding of all critical Renaissance applications in clearing, settlement, and risk pillars.  Customer is required by regulators to demonstrate the ability to run all clearing and risk systems through internal datacenter (...

  • Tech Lead/Senior Data Engineer

    4 weeks ago

    Halifax Regional Municipality, Canada LifeRaft Full time

    As a key member of our engineering department, you will lead the design, development, and implementation of innovative data solutions to enhance our platform's capabilities. Leveraging your expertise in data engineering, you will collaborate closely with cross-functional teams to architect scalable data pipelines, optimize data workflows, and drive...

  • Lead Data Engineer, GFT

    20 hours ago

    Halifax Regional Municipality, Canada Royal Bank of Canada> Full time

    Job SummaryJob DescriptionWhat is the opportunity?Are you a talented, creative, and results-driven professional who thrives on delivering high-performing applications. Come join us!Global Functions Technology (GFT) is part of RBC’s Technology and Operations division. GFT’s impact is far-reaching as we collaborate with partners from across the company to...

  • DevOps & Infra - Automation Engineer (SailPoint API, Python)

    2 weeks ago

    Halifax Regional Municipality, Canada Ness Digital Engineering Full time

    Description Ness is seeking an Sr DevOps/Automation Engineer. This role will assist with building out an on-premises failover environment and onboarding of all critical Renaissance applications in clearing, settlement, and risk pillars.  Customer is required by regulators to demonstrate the ability to run all clearing and risk systems through internal...

  • Functional QA Tester

    4 days ago

    Halifax Regional Municipality, Canada NTT DATA Services Full time

    Req ID: 283549 NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Functional QA Tester - Oracle EBS to join our team in Halifax, Nova Scotia (CA-NS), Canada (CA).  This...

  • Functional QA Tester

    18 hours ago

    Halifax Regional Municipality, Canada NTT DATA Services Full time

    Req ID: 283549 NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Functional QA Tester to join our team in Halifax, Nova Scotia (CA-NS), Canada (CA).  This position will be...

  • DevOps Engineer

    5 days ago

    Halifax, Canada NTT Data Full time

    NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a DevOps Engineer (Onsite) to join our team in Halifax, Nova Scotia (CA-NS), Canada (CA). Platform Solutions team is...

  • DevOps & Infra - Automation Engineer (Service Now Expert)

    2 weeks ago

    Halifax Regional Municipality, Canada Ness Digital Engineering Full time

    Description Ness is seeking an Sr DevOps/Automation Engineer. This role will assist with building out an on-premises failover environment and onboarding of all critical Renaissance applications in clearing, settlement, and risk pillars.  Customer is required by regulators to demonstrate the ability to run all clearing and risk systems through internal...

  • Health Care Technical Project Manager

    4 days ago

    Halifax Regional Municipality, Canada NTT DATA Services Full time

    Req ID: 270685 NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Health Care Technical Project Manager to join our team in Halifax, Nova Scotia (CA-NS), Canada (CA). NTT...

  • DevOps Engineer

    4 days ago

    Halifax, Canada NTT DATA Full time

    Job Description NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a DevOps Engineer (Onsite) to join our team in Halifax, Nova Scotia (CA-NS), Canada (CA).Platform Solutions team...

  • Technical Architect

    4 days ago

    Halifax Regional Municipality, Canada NTT DATA Services Full time

    Req ID: 270686 NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Technical Architect (Canadian Healthcare experience is a must) to join our team in Halifax, Nova Scotia...

  • Health Care Business Analyst

    4 days ago

    Halifax Regional Municipality, Canada NTT DATA Services Full time

    Req ID: 270687  NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Health Care Business Analyst to join our team in Halifax, Nova Scotia (CA-NS), Canada (CA). NTT DATA’s...

  • Full Stack ReactJS and NextJS Developer

    4 days ago

    Halifax Regional Municipality, Canada NTT DATA Services Full time

    NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a [[Software Development Advisor - WebApps Sr Full Stack Developer ]] to join our team in [[Helifax]], [[Nova Scotia]],...

  • Integrated Resource Plan

    4 days ago

    Halifax Regional Municipality, Canada Halifax Water Full time

    Competition # HW24-62E Department Engineering and Information Services Primary Function The IRP Engineer, is an integral team member working under the direction of the Manager, Regional Infrastructure Planning to provide project management support for Integrated Resource Plan (IRP) updates, the Growth Servicing Study (GSS), and associated studies and...

  • Devops Engineer

    15 hours ago

    Halifax, Canada NTT DATA Services Full time

    NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a DevOps Engineer (Onsite) to join our team in Halifax, Nova Scotia (CA-NS), Canada (CA).Platform Solutions team is looking for...

  • Devops Engineer

    14 hours ago

    Halifax, Canada NTT DATA Services Full time

    NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a DevOps Engineer (Onsite) to join our team in Halifax, Nova Scotia (CA-NS), Canada (CA).Platform Solutions team is looking for...