Data Engineer

3 weeks ago

Ottawa, Canada CGI Full time

Position Description:

Security clearance: Reliability Clearance a MUST
Location: Ottawa, ON
Remote: Yes

Are you a data engineering professional interested in working within a talented and collaborative team developing Cloud, Data, and AI solutions for leading global clients?

Do you often find yourself in discussions about disparate and scattered data sources and feel the need to create robust data engineering infrastructure to remedy this disorder? If you have the technical expertise to build pipelines and enable data engineering or ETL within organizations, a genuine problem-solving aptitude, and the mindset required to collaborate with diverse clients and team members, we are looking for you.

Your future duties and responsibilities:

•Pipeline Construction: Build and maintain scalable and high-performance data pipelines using Azure Data Factory, Azure Databricks, or other Azure services to transport data seamlessly across systems.
•Data Storage and Management: Manage data storage in Azure, selecting appropriate storage solutions (like Azure Data Lake, Azure SQL Database) to ensure data is stored efficiently and securely.
•Data Cleaning and Transformation: Develop scripts or use ETL tools for data cleaning and transformation to prepare data for analysis, ensuring data quality and accessibility.
•Automation and Optimization: Automate pipelines and optimize data retrieval using Python and Azure Data Factory, Azure Data Bricks.
•Monitoring and Maintenance: Monitor data pipelines and performance, troubleshoot any issues, and ensure systems are up-to-date with the latest security patches.

• Strategic collaboration with clients to explore and deliver key data engineering solutions
• Delivery in areas of data preparation and transformations, as well as ETL or ELT development, whether on-premises or in the cloud
• Building data engineering pipelines on the cloud (Azure, AWS, GCP, etc.)
• Working in a professional environment with large, complex, and voluminous datasets, as well as scattered data sources
• Utilizing SQL or advanced SQL skills and Python skills as needed
• Gathering client requirements, coding, and implementing data solutions
• Implementing proof of concepts to demonstrate value, then packaging and scaling full-fledged data engineering both on-premises and in cloud environments
• Supporting and collaborating with other data engineers or data scientists on the team regarding technical knowledge

Required qualifications to be successful in this role:

• Python experience is a must
• 5 years or more of practical experience in data engineering
• Experience working on at least one modern cloud platform (Azure, AWS, GCP, etc.)
• Excellent communication and teamwork skills

Desirable:

• Experience in data engineering with ML projects
• Experience with pipeline management tools and data workflow tools such as Airflow, Jenkins, etc.
• Experience with a variety of tools such as Azure Data Factory, Google Dataflow, Qlik Compose, AWS Data Pipeline or Glue, Talend, Microsoft SSIS, IBM Datastage, Informatica

#LI-YH1

Skills:

Data Engineering English ETL MS SQL Server Python Amazon CloudFront French

  • Data Engineer

    3 days ago

    Ottawa, Canada Knewin Full time

    We are looking for an Intermediate Data Engineer to join our team! We are seeking a talented Data Engineer to contribute to the development and optimization of our payment processing systems. As an Intermediate Data Engineer, you will play a crucial role in designing, implementing, and maintaining data About the company PayFacto thinks and develops payment...

  • Data Engineer

    4 days ago

    Ottawa, Canada Knewin Full time

    We are looking for an Intermediate Data Engineer to join our team! We are seeking a talented Data Engineer to contribute to the development and optimization of our payment processing systems. As an Intermediate Data Engineer, you will play a crucial role in designing, implementing, and maintaining data About the company PayFacto thinks and develops payment...

  • Data Engineer

    3 days ago

    Ottawa, Canada Knewin Full time

    We are looking for an Intermediate Data Engineer to join our team! We are seeking a talented Data Engineer to contribute to the development and optimization of our payment processing systems. As an Intermediate Data Engineer, you will play a crucial role in designing, implementing, and maintaining data About the company PayFacto thinks and develops payment...

  • Data Engineer

    3 days ago

    Ottawa, Canada Knewin Full time

    We are looking for an Intermediate Data Engineer to join our team! We are seeking a talented Data Engineer to contribute to the development and optimization of our payment processing systems. As an Intermediate Data Engineer, you will play a crucial role in designing, implementing, and maintaining data About the company PayFacto thinks and develops payment...

  • Data Engineer

    4 weeks ago

    Ottawa, Canada Brainhunter Full time

    Data Engineer - #61261About the Job: Mindwire is currently seeking a Data Engineer to work for our valued Crown corporation client.The position is remote with the option of a Hybrid work environment (Ottawa/Toronto). Responsibilities: Converts historical data from SAS database to Parquet. Works closely with teams to develop and transition ongoing production...

  • Senior Data Engineer

    4 weeks ago

    Ottawa, Canada CB Canada Full time

    Senior Data EngineerOn behalf of our public sector client, we are seeking a Senior Data Engineer. Remote work at present. Onsite work in Ottawa may be required at a later date.Job Description:The Senior Data Engineer Service Provider will be responsible for leading the delivery of data on data and analytics platform. These services are at the forefront of...

  • Sr. Data Engineer

    4 weeks ago

    Ottawa, Canada Brainhunter Full time

    Senior Data Engineer - #61271About the Job: Mindwire is currently seeking a Senior Data Engineer to work for our valued Crown Corporation client.This position is remote however the consultant may be required to go on-site one-two times throughout the contract duration. Responsibilities: Proven design, build and implementation of batch and real-time data...

  • Security Data Engineer

    4 weeks ago

    Ottawa, Canada Coradix Technology Consulting LTD Full time

    Security Data Engineer Date posted: Oct 17 2023 Job description Reference # : JP-13825 Location: Remote Category: Security Data Engineer Type: Contract CORADIX Technology Consulting is currently seeking a Security Data Engineer to support one of our valued Government of Canada clients with ground to cloud security assessments (SMAP...

  • Azure Data Engineer

    4 weeks ago

    Ottawa, Canada Enterprise Solutions, Inc. Full time

    Job Description: 10 years of Data Engineering experience. Proficient in Azure ADF data bricks data delta lake SQL python Spark and Snowflake Looking for strengths around data preparation layers and has experience with BIG data structured and non-structured data. Should have worked on critical projects within data transformation data migration and data...

  • Data Engineer

    4 weeks ago

    Ottawa, Canada Tiger Analytics Full time

    Tiger Analytics is a fast-growing advanced analytics consulting firm. Our consultants bring deep expertise in Data Science, Machine Learning and AI. We are the trusted analytics partner for multiple Fortune 500 companies, enabling them to generate business value from data. Our business value and leadership has been recognized by various market research...

  • Data Engineer

    6 days ago

    Ottawa, Canada Tiger Analytics Full time

    Tiger Analytics is a fast-growing advanced analytics consulting firm. Our consultants bring deep expertise in Data Science, Machine Learning and AI. We are the trusted analytics partner for multiple Fortune 500 companies, enabling them to generate business value from data. Our business value and leadership has been recognized by various market research...

  • Senior/Lead Data Engineer

    4 weeks ago

    Ottawa, Canada SegmentStream LTD Full time

    We are looking for a Senior Data Engineer to join the core product development team of SegmentStream and own the data & ETL architecture of our next-generation marketing analytics platform.If you are really passionate about AI & ML, enjoy working with the latest data technologies and tools, and want to make a great impact on our global success, you found the...

  • Senior/Lead Data Engineer

    4 days ago

    Ottawa, Canada SegmentStream LTD Full time

    We are looking for a Senior Data Engineer to join the core product development team of SegmentStream and own the data & ETL architecture of our next-generation marketing analytics platform.If you are really passionate about AI & ML, enjoy working with the latest data technologies and tools, and want to make a great impact on our global success, you found the...

  • Senior/Lead Data Engineer

    4 weeks ago

    Ottawa, Canada SegmentStream LTD Full time

    We are looking for a Senior Data Engineer to join the core product development team of SegmentStream and own the data & ETL architecture of our next-generation marketing analytics platform.If you are really passionate about AI & ML, enjoy working with the latest data technologies and tools, and want to make a great impact on our global success, you found the...

  • Senior/Lead Data Engineer

    4 weeks ago

    Ottawa, Canada SegmentStream LTD Full time

    We are looking for a Senior Data Engineer to join the core product development team of SegmentStream and own the data & ETL architecture of our next-generation marketing analytics platform.If you are really passionate about AI & ML, enjoy working with the latest data technologies and tools, and want to make a great impact on our global success, you found the...

  • Senior Data Engineer to develop data connections and processes for data models within an existi[...]

    1 week ago

    Ottawa, Canada S.i. Systems Full time

    Senior Data Engineer Job Description: Our public sector client is looking for a Senior Data Engineer to develop data connections and processes for data models within an existing data infrastructure. Our client is modernizing its IM/IT environment to support digital operations and enable technology excellence in service to Canadians. There is a requirement to...

  • Senior Data Engineer to develop data connections and processes for data models within an existi[...]

    1 month ago

    Ottawa, Canada S.i. Systems Full time

    Senior Data Engineer Job Description: Our public sector client is looking for a Senior Data Engineer to develop data connections and processes for data models within an existing data infrastructure. Our client is modernizing its IM/IT environment to support digital operations and enable technology excellence in service to Canadians. There is a requirement to...

  • Senior Data Engineer to develop data connections and processes for data models within an existi[...]

    4 days ago

    Ottawa, Canada S.i. Systems Full time

    Senior Data Engineer Job Description: Our public sector client is looking for a Senior Data Engineer to develop data connections and processes for data models within an existing data infrastructure. Our client is modernizing its IM/IT environment to support digital operations and enable technology excellence in service to Canadians. There is a requirement to...

  • Senior Data Engineer to develop data connections and processes for data models within an existi[...]

    1 week ago

    Ottawa, Canada S.i. Systems Full time

    Senior Data Engineer Job Description: Our public sector client is looking for a Senior Data Engineer to develop data connections and processes for data models within an existing data infrastructure. Our client is modernizing its IM/IT environment to support digital operations and enable technology excellence in service to Canadians. There is a requirement to...

  • Software Engineer

    4 weeks ago

    Ottawa, Canada Huawei Full time

    Our team has an immediate permanent opening for a Software Engineer. Responsibilities: Explore and leverage advanced technologies to build the next-generation elastic, composable and service-oriented software architecture for Huawei’s data communication products (switch/router/IOT). Solve technical challenges in the areas, including but not limited to,...