Data Engineer

1 week ago


Ottawa, Ontario, Canada CGI Full time

Position Description:

Security clearance: Reliability Clearance a MUST
Location: Ottawa, ON
Remote: Yes

Are you a data engineering professional interested in working within a talented and collaborative team developing Cloud, Data, and AI solutions for leading global clients?

Do you often find yourself in discussions about disparate and scattered data sources and feel the need to create robust data engineering infrastructure to remedy this disorder? If you have the technical expertise to build pipelines and enable data engineering or ETL within organizations, a genuine problem-solving aptitude, and the mindset required to collaborate with diverse clients and team members, we are looking for you.

Your future duties and responsibilities:


•Pipeline Construction: Build and maintain scalable and high-performance data pipelines using Azure Data Factory, Azure Databricks, or other Azure services to transport data seamlessly across systems.

•Data Storage and Management: Manage data storage in Azure, selecting appropriate storage solutions (like Azure Data Lake, Azure SQL Database) to ensure data is stored efficiently and securely.

•Data Cleaning and Transformation: Develop scripts or use ETL tools for data cleaning and transformation to prepare data for analysis, ensuring data quality and accessibility.

•Automation and Optimization: Automate pipelines and optimize data retrieval using Python and Azure Data Factory, Azure Data Bricks.

•Monitoring and Maintenance: Monitor data pipelines and performance, troubleshoot any issues, and ensure systems are up-to-date with the latest security patches.

• Strategic collaboration with clients to explore and deliver key data engineering solutions

• Delivery in areas of data preparation and transformations, as well as ETL or ELT development, whether on-premises or in the cloud

• Building data engineering pipelines on the cloud (Azure, AWS, GCP, etc.)

• Working in a professional environment with large, complex, and voluminous datasets, as well as scattered data sources

• Utilizing SQL or advanced SQL skills and Python skills as needed

• Gathering client requirements, coding, and implementing data solutions

• Implementing proof of concepts to demonstrate value, then packaging and scaling full-fledged data engineering both on-premises and in cloud environments

• Supporting and collaborating with other data engineers or data scientists on the team regarding technical knowledge

Required qualifications to be successful in this role:


• Python experience is a must

• 5 years or more of practical experience in data engineering

• Experience working on at least one modern cloud platform (Azure, AWS, GCP, etc.)

• Excellent communication and teamwork skills

Desirable:

• Experience in data engineering with ML projects

• Experience with pipeline management tools and data workflow tools such as Airflow, Jenkins, etc.

• Experience with a variety of tools such as Azure Data Factory, Google Dataflow, Qlik Compose, AWS Data Pipeline or Glue, Talend, Microsoft SSIS, IBM Datastage, Informatica

#LI-KM1
#LI-YH1

Skills:

Data Engineering English ETL MS SQL Server Python Amazon CloudFront French
  • Data Engineer

    1 week ago


    Ottawa, Ontario, Canada Tomlinson Group of Companies Full time

    As a Data Engineer at Tomlinson, you will play a crucial role in collaborating with the Data Architect and AI team to develop and implement data integration strategies, build data pipelines, perform data modeling, ensure data governance, and plan scalable solutions. You will work with various business units to handle diverse data objects from disparate...


  • Ottawa, Ontario, Canada CB Canada Full time

    Senior Data EngineerOn behalf of our public sector client, we are seeking a Senior Data Engineer. Remote work at present. Onsite work in Ottawa may be required at a later date.Job Description:The Senior Data Engineer Service Provider will be responsible for leading the delivery of data on data and analytics platform. These services are at the forefront of...

  • Staff Data Engineer

    7 days ago


    Ottawa, Ontario, Canada Tree Trust Full time

    Data and Analytics, Ottawa, Canada / Canada - Remote SurveyMonkey is a global leader in online surveys and forms that empowers people with the insights they need to make decisions with speed and confidence. Our fast, intuitive feedback management platform connects millions of users worldwide with real-time AI-powered insights that drive meaningful...

  • Big Data Engineer

    7 days ago


    Ottawa, Ontario, Canada NewFound Recruiting Full time

    Our Client is currently looking for a Senior Data Engineer to join their team in Ottawa Must have a minimum College Diploma/Certificate with a concentration in Business, Administration, or Information Technology, or a combination of education and related experience.~10+ years of experience data engineering, developing, and implementing data and analytical...


  • Ottawa, Ontario, Canada Fullscript Full time

    Fullscript is making optimal care easy for everyone. Through our care delivery platform, health practitioners can seamlessly design personalized health plans, provide support and education tools, and effortlessly prescribe and manage the use of healthcare's best supplements — all in one place.Since 2011, Fullscript has enabled over 90,000 practitioners to...


  • Ottawa, Ontario, Canada Fullscript Full time

    Fullscript is making optimal care easy for everyone. Through our care delivery platform, health practitioners can seamlessly design personalized health plans, provide support and education tools, and effortlessly prescribe and manage the use of healthcare's best supplements — all in one place.Since 2011, Fullscript has enabled over 90,000 practitioners to...


  • Ottawa, Ontario, Canada Telesat Full time

    Telesat (NASDAQ andTSX:TSAT) is a leading global satellite operator, providing reliable and secure satellite-delivered communications solutions worldwide to broadcast, telecommunications, corporate and government customers for over 50 years. Backed by a legacy of engineering excellence, reliability and industry-leading customer service, Telesat has grown to...


  • Ottawa, Ontario, Canada SegmentStream LTD Full time

    We are looking for a Senior Data Engineer to join the core product development team of SegmentStream and own the data & ETL architecture of our next-generation marketing analytics platform. If you are really passionate about AI & ML, enjoy working with the latest data technologies and tools, and want to make a great impact on our global success, you found...

  • Solution Architect

    1 week ago


    Ottawa, Ontario, Canada Data Sentinel Full time

    Who you are You are a hands-on dynamic and personable individual with 2 to 4 years of software solution deployments with a containerized application. Ideally you will also have experience with various data sources (relational, file systems, NoSQL), Kafka and data inventory/data classification/data quality tools and or concepts. You want to grow your skills...


  • Ottawa, Ontario, Canada S I Systems Full time

    Senior Data Engineer to create, manage, and monitor data pipelines using Azure Data Factory and Azure Synapse for a Government clientOur valued public sector client requires two Senior Data Engineers to create, manage, and monitor data pipelines using Azure Data Factory and Azure Synapse for a Government client.Tasks:Azure Data Factory (ADF) and Azure...


  • Ottawa, Ontario, Canada Avanade Full time

    Our talented Data & AI Practice is made up of globally recognized experts - and there's room for more analytical and ambitious data professionals. If you're passionate about helping clients make better data-driven decisions to tackle their most complex business issues, let's talk. Take your skills to a new level and launch a career where you can truly do...


  • Ottawa, Ontario, Canada S.i. Systems Full time

    Our valued client is looking for a Senior Data Analytics Manager to assist in the hiring process of Data Engineers and Data Architects. This is a part-time position with an estimated 40-50 hours of work over the course of 2-3 months, with the option to work remotely.Responsibilities:Create practical evaluation criteriaAssess submitted practical...


  • Ottawa, Ontario, Canada IDX, A Converge Company Full time

    Converge Technology Solutions is a leading Cloud Partner in AWS, Azure, and GCP. We are looking to hire an experienced Public Cloud Delivery Engineer with deep expertise to support our customers with cloud adoption and help Converge secure new clients in AWS, Azure, and GCP. You'll work with entrepreneurs, start-ups, VC-backed, and large-scale companies...

  • Data Scientist

    1 week ago


    Ottawa, Ontario, Canada Thales Canada Inc., Defence and Security Full time

    Location: Ottawa, CanadaIn fast changing markets, customers worldwide rely on Thales. Thales is a business where brilliant people from all over the world come together to share ideas and inspire each other. In aerospace, transportation, defence, security and space, our architects design innovative solutions that make our tomorrow's possible.For decades,...

  • Technical Writer

    7 days ago


    Ottawa, Ontario, Canada NTT DATA Full time

    Company Overview:Company InfoJob ID: 279862We are currently looking for a Technical Writer to join our team in Ottawa, Ontario (CA-ON), Canada (CA).Role: Technical Writer(s) Level 2Location: RemoteLanguage: Bilingual (English/French)Security Clearance Required:ReliabilityHow You'll Make an Impact: We are seeking a Technical Writer with over 5 years of...

  • Programmer Analyst

    1 week ago


    Ottawa, Ontario, Canada NTT DATA Services Full time

    NTT DATA Services - Programmer Analyst - Ottawa, Ontario (CA-ON), CanadaHow You Can Contribute:We're seeking a Programmer Analyst with a focus on PowerBI, having 10+ years of experience to collaborate with stakeholders, implement new requirements, and maintain the Portfolio Dashboard.What We Offer You:Joining our team means more than just a job - it's an...

  • Data Scientist

    1 week ago


    Ottawa, Ontario, Canada Ciena Full time

    Ciena is committed to our people-first philosophy. Our teams enjoy a culture focused on prioritizing a personalized and flexible work environment that empowers an individual's passions, growth, wellbeing and belonging. We're a technology company that leads with our humanity—driving our business priorities alongside meaningful social, community, and...

  • Data Scientist

    7 days ago


    Ottawa, Ontario, Canada Ciena Full time

    Ciena is committed to our people-first philosophy. Our teams enjoy a culture focused on prioritizing a personalized and flexible work environment that empowers an individual's passions, growth, wellbeing and belonging. We're a technology company that leads with our humanity—driving our business priorities alongside meaningful social, community, and...


  • Ottawa, Ontario, Canada Randstad Canada Full time

    Are you a skilled communicator with a passion for data and analytics? Our client is seeking a Data and Analytics Content Writer to collaborate with Product Owners and Data Engineering Chapter members. You'll create and update process maps, standard operating procedures, and technical documentation, facilitating and presenting these materials to diverse...


  • Ottawa, Ontario, Canada RANOVUS Full time

    Social networking, machine learning, and big data analytics demand ever-increasing network connectivity. RANOVUS, with operations in Ottawa, Canada, Nuremberg, Germany, and San Jose, USA, is a solution provider for the next generation data center infrastructures. We aim to deliver advanced technology that minimizes environmental impact through lower power...