Data Engineer

3 weeks ago

Ottawa, Ontario, Canada ipvisibility Full time

Key Responsibilities

  • Design, develop, and maintain ETL jobs to ingest data into Data Lake and load data to datamarts.
  • Extract data to integrate with various business applications.
  • Parse unstructured and semi-structured data, including XML.
  • Design and develop efficient mapping and workflows to load data to Data Marts.
  • Map XML DTD schema in Python to create customized table definitions.
  • Write efficient queries and reports in Hive or Impala to extract data on an ad-hoc basis for data analysis.
  • Identify performance bottlenecks in ETL Jobs and tune their performance by enhancing or redesigning them.
  • Responsible for performance tuning of ETL mappings and queries.
  • Import tables and necessary lookup tables to facilitate the ETL process, required to process daily XML files, as well as large historical XML data files.

About the Role

This is a critical position that requires a strong understanding of ETL processes, data integration, and data engineering principles. The ideal candidate will have experience with Python, ETL tools, and data warehousing technologies.

Requirements

  • Strong understanding of ETL processes and data integration principles.
  • Experience with Python, ETL tools, and data warehousing technologies.
  • Ability to design, develop, and maintain ETL jobs and data pipelines.
  • Strong problem-solving skills and attention to detail.
  • Ability to work in a fast-paced environment and meet deadlines.

  • Data Architect Data Analytics

    4 weeks ago

    Ottawa, Ontario, Canada ECF Data, LLC Full time

    Job Title: Data Architect Data AnalyticsWe are seeking a highly skilled Data Architect Data Analytics to join our team at ECF Data, LLC. As a key member of our data engineering team, you will be responsible for designing, implementing, and maintaining scalable data pipelines and architectures.Key Responsibilities:Develop and maintain scalable data pipelines...

  • Data Architect Data Analytics

    4 weeks ago

    Ottawa, Ontario, Canada ECF Data, LLC Full time

    Job Title: Data Architect Data AnalyticsWe are seeking a highly skilled Data Architect Data Analytics to join our team at ECF Data, LLC. As a key member of our data engineering team, you will be responsible for designing, implementing, and maintaining scalable data pipelines and architectures.Key Responsibilities:Develop and maintain scalable data pipelines...

  • Data Management Specialist

    3 weeks ago

    Ottawa, Ontario, Canada Data Sentinel Full time

    About YouWe are seeking a highly skilled and experienced Data Management Specialist to join our team at Data Sentinel. As a key member of our delivery team, you will be responsible for working with our clients on deployments and solutions with our technology.ResponsibilitiesResponsible for the successful installation, configuration, and deployment of Data...

  • Data Management Specialist

    2 months ago

    Ottawa, Ontario, Canada Data Sentinel Full time

    About YouWe are seeking a highly skilled and dynamic individual to join our delivery team as a Data Management Specialist. As a key member of our team, you will be responsible for working with our clients on deployments and solutions with our technology.You will be part of our high-growth software company that has developed a sensitive information...

  • Data Management Specialist

    2 months ago

    Ottawa, Ontario, Canada Data Sentinel Full time

    About YouWe are seeking a highly skilled and dynamic individual to join our delivery team as a Data Management Specialist. As a key member of our team, you will be responsible for working with our clients on deployments and solutions with our technology.You will be part of our high-growth software company that has developed a sensitive information...

  • Data Management Specialist

    1 month ago

    Ottawa, Ontario, Canada Data Sentinel Full time

    About the Role You will be responsible for working with our clients on deployments and solutions with our technology. Data Sentinel is a high-growth software company that has developed a sensitive information intelligence platform that helps businesses to identify, inventory, categorize, track and trace sensitive data with the enterprise. We help companies...

  • Data Management Specialist

    1 month ago

    Ottawa, Ontario, Canada Data Sentinel Full time

    About the Role You will be responsible for working with our clients on deployments and solutions with our technology. Data Sentinel is a high-growth software company that has developed a sensitive information intelligence platform that helps businesses to identify, inventory, categorize, track and trace sensitive data with the enterprise. We help companies...

  • Data Management Specialist

    1 month ago

    Ottawa, Ontario, Canada Data Sentinel Full time

    About YouWe are seeking a highly skilled and dynamic individual to join our delivery team as a Solution Architect. As a key member of our team, you will be responsible for working with our clients on deployments and solutions with our technology.You will be part of our high-growth software company that has developed a sensitive information intelligence...

  • Data Management Specialist

    1 month ago

    Ottawa, Ontario, Canada Data Sentinel Full time

    About YouWe are seeking a highly skilled and dynamic individual to join our delivery team as a Solution Architect. As a key member of our team, you will be responsible for working with our clients on deployments and solutions with our technology.You will be part of our high-growth software company that has developed a sensitive information intelligence...

  • Data Management Specialist

    3 weeks ago

    Ottawa, Ontario, Canada Data Sentinel Full time

    About YouWe are seeking a highly skilled and dynamic individual to join our delivery team as a Solution Deployment Expert. As a key member of our team, you will be responsible for working with our clients on deployments and solutions with our technology.You will be part of our high-growth software company that has developed a sensitive information...

  • Data Management Specialist

    3 weeks ago

    Ottawa, Ontario, Canada Data Sentinel Full time

    About YouWe are seeking a highly skilled and dynamic individual to join our delivery team as a Solution Deployment Expert. As a key member of our team, you will be responsible for working with our clients on deployments and solutions with our technology.You will be part of our high-growth software company that has developed a sensitive information...

  • Data Management Solutions Architect

    2 months ago

    Ottawa, Ontario, Canada Data Sentinel Full time

    About the RoleWe are seeking a highly skilled Data Management Solutions Architect to join our team at Data Sentinel. As a key member of our delivery team, you will be responsible for working with our clients to deploy and implement our sensitive information intelligence platform.Key ResponsibilitiesDeployment and Configuration: Responsible for the successful...

  • Data Management Solutions Architect

    2 months ago

    Ottawa, Ontario, Canada Data Sentinel Full time

    About the RoleWe are seeking a highly skilled Data Management Solutions Architect to join our team at Data Sentinel. As a key member of our delivery team, you will be responsible for working with our clients to deploy and implement our sensitive information intelligence platform.Key ResponsibilitiesDeployment and Configuration: Responsible for the successful...

  • Data Management Solutions Specialist

    6 days ago

    Ottawa, Ontario, Canada Data Sentinel Full time

    Who We Are Looking ForYou are a dynamic and personable individual with 2 to 4 years of software solution deployments with a containerized application. Ideally, you will also have experience with various data sources (relational, file systems, NoSQL), Kafka, and data inventory/data classification/data quality tools and concepts. You want to grow your skills...

  • Cloud-Based Data Governance Expert

    2 months ago

    Ottawa, Ontario, Canada Data Sentinel Full time

    About the RoleWe are seeking a highly skilled Data Management Solutions Architect to join our team at Data Sentinel. As a key member of our delivery team, you will be responsible for working with our clients to deploy and implement our sensitive information intelligence platform.Key ResponsibilitiesDeployment and Configuration: Responsible for the successful...

  • Cloud-Based Data Governance Expert

    2 months ago

    Ottawa, Ontario, Canada Data Sentinel Full time

    About the RoleWe are seeking a highly skilled Data Management Solutions Architect to join our team at Data Sentinel. As a key member of our delivery team, you will be responsible for working with our clients to deploy and implement our sensitive information intelligence platform.Key ResponsibilitiesDeployment and Configuration: Responsible for the successful...

  • Data Engineer

    1 month ago

    Ottawa, Ontario, Canada Thales Group Full time

    Job Title: Data EngineerThales is seeking a highly skilled Data Engineer to join our team in Ottawa, Canada. As a Data Engineer, you will play a key role in designing, building, and maintaining our data platforms to support our naval platforms in-service support programs.Key Responsibilities:Design and implement data architecture to meet business...

  • Data Engineer

    1 month ago

    Ottawa, Ontario, Canada Thales Group Full time

    Job Title: Data EngineerThales is seeking a highly skilled Data Engineer to join our team in Ottawa, Canada. As a Data Engineer, you will play a key role in designing, building, and maintaining our data platforms to support our naval platforms in-service support programs.Key Responsibilities:Design and implement data architecture to meet business...

  • Data Engineer

    4 weeks ago

    Ottawa, Ontario, Canada Tomlinson Group of Companies Full time

    Job Title: Data EngineerAs a Data Engineer at Tomlinson Group of Companies, you will play a pivotal role in driving data-driven insights and innovation across the organization. Our team is dedicated to developing and implementing data integration strategies, building data pipelines, and ensuring data governance practices are followed.Key...

  • Data Engineer

    4 weeks ago

    Ottawa, Ontario, Canada Tomlinson Group of Companies Full time

    Job Title: Data EngineerAs a Data Engineer at Tomlinson Group of Companies, you will play a pivotal role in driving data-driven insights and innovation across the organization. Our team is dedicated to developing and implementing data integration strategies, building data pipelines, and ensuring data governance practices are followed.Key...