Sr. Data Engineer
7 days ago
Job Description
The Senior Data Engineer will be responsible for leading the delivery of data on data and analytics platform. These services are at the forefront of building out data engineering practice cloud-native technologies. The Senior Data Engineer Service Provider must have experience in leading, designing, implementing, and collaborating with stakeholders to achieve the best results for our clients..
Specific Project Requirements:
- Increase the overall speed in which data is onboarded to the Data and Analytics platform.
- Building robust data pipelines to enable larger data consumption on the Data and Analytics Platform
- Increase the overall quality of data pipeline development through DevSecOps
• Proven design, build and implementation of batch and real-time data pipelines. Driven by automated repeatable delivery of data that aligns to enterprise data governance standards.
• Experience in developing and proposing design patterns that conform to requirements. Responsible to ensure the proposed design, optimally addresses access and query patterns; data consumption and adheres to internal architecture standards.
• Experienced collaboration working with various stakeholders across the business, data scientists and IT. Working closely building relationships, refining data requirements to meet various data and analytics initiatives and data consumption requirements
Top Skills Required:
• Programming experience in Spark using modern languages such as Python, Scala
• Experience working with modern data architectures like Azure Data Lake Storage, Azure Databricks, Azure Synapse (formerly SQL Data Warehouse) and Delta Lakes
• Experience leading Data Engineering principles within an organization/team.
Other Skills Required:
• Experience working with Integration patterns and technologies such as Azure Event Hub, Function App and C#
• Knowledge and expertise of database modeling techniques: Data Vaults, Star, Snowflake, 3NF, etc.
• Experience working with streaming data architecture and technologies for real-time: Spark Streaming, Kafka, Flink, Storm
• Experience working with relational and non-relational database technologies: SQL Server, Oracle, Cassandra, MongoDB, CosmosDB, HBase
• Experience working with source code and configuration management environments such as Azure DevOps, Git, Maven, Nexus
Assets:
• Experience within Azure environment
• Strong Python, Scala and Spark experience
• Experience modernizing data platforms.
• Experience with Azure Functions and C#
• 2 to 3 projects developing Data Vault
-
Sr. Systems Engineer
7 days ago
Ottawa, Ontario, Canada 293fea1f-cc61-42fd-a359-00b7443872e0 Full time $110,000 - $140,000 per yearMarshall Canada is seeking a Sr. Systems Engineer to join our team in Ottawa, ON. Reporting to the Sr. Manager, Systems Engineering, this role is responsible to support and lead systems engineering activities critical to the performance, reliability, and scalability of Marshall products and solutions. This role will also act as a technical leader and mentor,...
-
Sr. Structural Engineer
5 days ago
Ottawa, Ontario, Canada Insight Global Full time $90,000 - $120,000 per yearRequired Skills & ExperienceBachelor's or Master's degree in Structural/Civil EngineeringMore than 5 years' experience in structural design, preferably in renewable energy projectsProfessional Engineer (P.Eng.)Proficiency in structural analysis software (STAAD Pro, Risa3D, LPile).Familiarity with AutoCAD/Revit for design documentationJob SummaryInsight...
-
Sr. Systems Engineer
7 days ago
Ottawa, Ontario, Canada Marshall Full time $1,100,000 - $1,450,000 per yearMarshall Canada is seeking a Sr. Systems Engineer to join our team in Ottawa, ON. Reporting to the Sr. Manager, Systems Engineering, this role is responsible to support and lead systems engineering activities critical to the performance, reliability, and scalability of Marshall products and solutions. This role will also act as a technical leader and...
-
Data Engineer
7 days ago
Ottawa, Ontario, Canada Tulloch Full time $120,000 - $180,000 per yearCome Join Us"We want to build an organization where everyone loves their job and their leaders care for them."Over the last 30 years, TULLOCH has built a robust multi-disciplinary consulting engineering firm recognized Canada-wide for its strengths in the diverse service offerings and commitment to excellence. TULLOCH's innovative use of emerging...
-
Data Engineer
5 days ago
Ottawa, Ontario, Canada TULLOCH Full time $120,000 - $260,000 per yearCome Join Us "We want to build an organization where everyone loves their job and their leaders care for them." Over the last 30 years, TULLOCH has built a robust multi-disciplinary consulting engineering firm recognized Canada-wide for its strengths in the diverse service offerings and commitment to excellence. TULLOCH's innovative use of emerging...
-
Data Engineer
5 days ago
Ottawa, Ontario, Canada TULLOCH Full time $120,000 - $180,000 per yearCome Join Us "We want to build an organization where everyone loves their job and their leaders care for them." Over the last 30 years, TULLOCH has built a robust multi-disciplinary consulting engineering firm recognized Canada-wide for its strengths in the diverse service offerings and commitment to excellence. TULLOCH's innovative use of emerging...
-
Data Pipeline Engineer
3 days ago
Ottawa, Ontario, Canada Ribbon Communications Full time $80,000 - $120,000 per yearJOB TITLE Data Pipeline Engineer – Ribbon Analytics (Full Time)ABOUT RIBBON COMMUNICATIONSRibbon Communications is a global leader in real-time communications, transforming networks to secure IP and cloud-based architectures for consumers and businesses worldwide. Learn more at OPPORTUNITYRibbon Communications is looking for a Data Pipeline Engineer to...
-
Lead Data Engineer
5 days ago
Ottawa, Ontario, Canada Quantexa Full time $120,000 - $180,000 per yearWhat We're All About.It isn't often you get to be part of a tech company that, since 2016, has been innovating the data analytics market in ways no-one else can. Our technology started out in FinTech, helping tackle serious criminal activity. Now, its potential is virtually limitless. Working at Quantexa isn't just intellectually stimulating. We're a real...
-
Data Engineer
5 days ago
Ottawa, Ontario, Canada Tiger Analytics Full time $120,000 - $180,000 per yearTiger Analytics is a fast-growing advanced analytics consulting firm. Our consultants bring deep expertise in Data Science, Machine Learning and AI. We are the trusted analytics partner for multiple Fortune 500 companies, enabling them to generate business value from data. Our business value and leadership has been recognized by various market research...
-
Senior Project Engineer
7 days ago
Ottawa, Ontario, Canada Marshall Group Full time $120,000 - $180,000 per yearMarshall Canada is seeking a Sr. Project Engineer to join our team in Ottawa, ON. Reporting to the Sr. Engineering Manager, The Sr. Project Engineer is responsible to lead and manage Marshall Land Systems Canada's engineering projects, as well as develop and maintain systems engineering management plans.Your responsibilities in the role:Accountable for the...