Data Engineer
2 weeks ago
About the Job:
Mindwire is currently seeking a Data Engineer to work for our valued Crown corporation client.
The position is remote with the option of a Hybrid work environment (Ottawa/Toronto).
Responsibilities: Converts historical data from SAS database to Parquet. Works closely with teams to develop and transition ongoing production process of analytical assets (currently coded in SAS and stored as SAS datasets) to be coded using Python (leveraging Pyspark) and stored in Parquet. Recommends improvements and enhancements to conversion processes and ongoing production of analytical assets. Prepares documentation required related to the results of the conversion (e.g. differences in converted data that will impact use by analysts). Coaches and mentors staff in data conversion techniques. Requirements and Qualifications: 5 years’ experience with version control using Git, including branching, merging, and collaborating with teams to manage code repositories effectively. Extensive knowledge of SQL for querying and manipulating databases, with a solid understanding of database design and optimization (5 Years’ Experience). High level of expertise in data engineering processes, including data extraction, transformation, and loading (ETL), utilizing Informatica tools to create efficient and robust data pipelines. Extensive programming experience in Python, with the ability to develop complex applications, scripts, and data processing tasks using a wide range of libraries and frameworks. Proficient usage of Jupyter Notebooks as an integrated development environment for data analysis, data visualization, and interactive code execution, fostering efficient and reproducible workflows. Extensive hands-on experience with Apache Spark, including the ability to design, optimize, and manage large-scale data processing and analytics pipelines. In-depth knowledge of Apache Parquet file format for columnar storage, including its benefits and optimal usage in big data processing scenarios.
-
Data Engineer
2 weeks ago
Ottawa, Canada CGI Full timePosition Description: Security clearance: Reliability Clearance a MUST Location: Ottawa, ON Remote: Yes Are you a data engineering professional interested in working within a talented and collaborative team developing Cloud, Data, and AI solutions for leading global clients? Do you often find yourself in discussions about disparate and scattered...
-
Senior Data Engineer
2 weeks ago
Ottawa, Canada CB Canada Full timeSenior Data EngineerOn behalf of our public sector client, we are seeking a Senior Data Engineer. Remote work at present. Onsite work in Ottawa may be required at a later date.Job Description:The Senior Data Engineer Service Provider will be responsible for leading the delivery of data on data and analytics platform. These services are at the forefront of...
-
Sr. Data Engineer
2 weeks ago
Ottawa, Canada Brainhunter Full timeSenior Data Engineer - #61271About the Job: Mindwire is currently seeking a Senior Data Engineer to work for our valued Crown Corporation client.This position is remote however the consultant may be required to go on-site one-two times throughout the contract duration. Responsibilities: Proven design, build and implementation of batch and real-time data...
-
Security Data Engineer
2 weeks ago
Ottawa, Canada Coradix Technology Consulting LTD Full timeSecurity Data Engineer Date posted: Oct 17 2023 Job description Reference # : JP-13825 Location: Remote Category: Security Data Engineer Type: Contract CORADIX Technology Consulting is currently seeking a Security Data Engineer to support one of our valued Government of Canada clients with ground to cloud security assessments (SMAP...
-
Azure Data Engineer
2 weeks ago
Ottawa, Canada Enterprise Solutions, Inc. Full timeJob Description: 10 years of Data Engineering experience. Proficient in Azure ADF data bricks data delta lake SQL python Spark and Snowflake Looking for strengths around data preparation layers and has experience with BIG data structured and non-structured data. Should have worked on critical projects within data transformation data migration and data...
-
Analytics Engineer
3 weeks ago
Ottawa, Canada Definity Careers Full timeThe Analytics Engineer spearheads the development and delivery of innovative analytical solutions in collaboration with business stakeholders and technical teams across the organization. The Analytics Engineer reports to the Director, Data Leadership as a key member of a high-performing Data and Analytics team focused on delivering impactful insights...
-
Data Engineer
2 weeks ago
Ottawa, Canada Mindpal Full timeWe are looking for experienced Data Engineers with knowledge of Snowflake platform.Responsibilities:Creating and managing data in the Snowflake environmentDesigning and implementing ETL (Extract, Transform, Load) solutions for transferring data between various sources and platformsOptimizing the performance of Snowflake databases, including designing and...
-
Analytics Engineer
2 weeks ago
Ottawa, Canada Definity Full timeJob Description The Analytics Engineer spearheads the development and delivery of innovative analytical solutions in collaboration with business stakeholders and technical teams across the organization. The Analytics Engineer reports to the Director, Data Leadership as a key member of a high-performing Data and Analytics team...
-
Data Engineer
2 weeks ago
Ottawa, Canada Tiger Analytics Full timeTiger Analytics is a fast-growing advanced analytics consulting firm. Our consultants bring deep expertise in Data Science, Machine Learning and AI. We are the trusted analytics partner for multiple Fortune 500 companies, enabling them to generate business value from data. Our business value and leadership has been recognized by various market research...
-
Senior/Lead Data Engineer
2 weeks ago
Ottawa, Canada SegmentStream LTD Full timeWe are looking for a Senior Data Engineer to join the core product development team of SegmentStream and own the data & ETL architecture of our next-generation marketing analytics platform.If you are really passionate about AI & ML, enjoy working with the latest data technologies and tools, and want to make a great impact on our global success, you found the...
-
Senior/Lead Data Engineer
2 weeks ago
Ottawa, Canada SegmentStream LTD Full timeWe are looking for a Senior Data Engineer to join the core product development team of SegmentStream and own the data & ETL architecture of our next-generation marketing analytics platform.If you are really passionate about AI & ML, enjoy working with the latest data technologies and tools, and want to make a great impact on our global success, you found the...
-
Senior/Lead Data Engineer
2 weeks ago
Ottawa, Canada SegmentStream LTD Full timeWe are looking for a Senior Data Engineer to join the core product development team of SegmentStream and own the data & ETL architecture of our next-generation marketing analytics platform.If you are really passionate about AI & ML, enjoy working with the latest data technologies and tools, and want to make a great impact on our global success, you found the...
-
Ottawa, Canada S I Systems Full timeSenior Data Engineer to assess and qualify disparate data and define data models to present data of provider and clinic service locations province-wide- SOW20240430MB1/ 2/ May 7th Job Type: Contract Positions to fill: 1 Start Date: May 21, 2024 Job End Date: Dec 23, 2024 Pay Rate: Hourly: Negotiable Job ID: 137314 S.i Systems healthcare client is...
-
Ottawa, Canada S I Systems Full timeSenior Data Engineer to assess and qualify disparate data and define data models to present data of provider and clinic service locations province-wide- SOW20240430MB1/ 2/ May 7th Job Type: Contract Positions to fill: 1 Start Date: May 21, 2024 Job End Date: Dec 23, 2024 Pay Rate: Hourly: Negotiable Job ID: 137314 S.i Systems healthcare client is...
-
Ottawa, Canada S I Systems Full timeSenior Data Engineer to assess and qualify disparate data and define data models to present data of provider and clinic service locations province-wide- SOW20240430MB1/ 2/ May 7th Job Type: Contract Positions to fill: 1 Start Date: May 21, 2024 Job End Date: Dec 23, 2024 Pay Rate: Hourly: Negotiable Job ID: 137314 S.i Systems healthcare client is...
-
Software Engineer
2 weeks ago
Ottawa, Canada Huawei Full timeOur team has an immediate permanent opening for a Software Engineer. Responsibilities: Explore and leverage advanced technologies to build the next-generation elastic, composable and service-oriented software architecture for Huawei’s data communication products (switch/router/IOT). Solve technical challenges in the areas, including but not limited to,...
-
Senior/Lead Data Engineer
2 weeks ago
Ottawa, ON, Canada SegmentStream LTD Full timeWe are looking for a Senior Data Engineer to join the core product development team of SegmentStream and own the data & ETL architecture of our next-generation marketing analytics platform. If you are really passionate about AI & ML, enjoy working with the latest data technologies and tools, and want to make a great impact on our global success, you found...
-
Data Analyst
6 days ago
Ottawa, Canada TechInsights Full time**OUR STORY** **THE OPPORTUNITY** TechInsights is looking for a Data Analyst to work closely with the Architecture and Engineering teams. In this role you will, design and implement structured and unstructured data systems, ETL flows, and Business Intelligence (BI) based dashboards for both internal reporting and end-customer deliverables. As the Data...
-
Ottawa, ON, Canada S I Systems Full timeSenior Data Engineer to assess and qualify disparate data and define data models to present data of provider and clinic service locations province-wide- SOW20240430MB1/ 2/ May 7th Job Type: Contract Positions to fill: 1 Start Date: May 21, 2024 Job End Date: Dec 23, 2024 Pay Rate: Hourly: Negotiable Job ID: 137314 S.i Systems healthcare...
-
Data Modeler
6 days ago
Ottawa, Canada TechInsights Full time**OUR STORY** **THE OPPORTUNITY**: The Data Modeler will be reporting to the Manager, Data and working within an Agile scrum team. The Data Modeler will be closely collaborating with internal customers to define and implement structured data systems, ETL flows, and Business Intelligence (BI) content for end-customers within the TechInsights platform. The...
