Tech Lead- Data Engineer
2 days ago
LeverageTek is actively seeking a
Tech Lead – Data Engineer
for a 4-month contract with its Ottawa-based customer.
Work Location
Ottawa or Toronto
Key Tasks
- Provide leadership and guidance to staff. Supervise, coach, coordinate and monitor work, workload and performance of staff to ensure quality, continuous learning opportunities, and on-time completion of departmental deliverables and commitments. Will be required to provide input to annual performance management reviews.
- Participates in the recruitment and evaluation of Information Access and Delivery staff, as well as the selection of external contractors as required.
- Acts as Technical Leader on new and operational projects and leads/coordinates design and development activities related to data pipelines focusing on analytical and BI needs of the organization. Activities include participation in requirements identification and feasibility analysis, generation of technical solutions and design, coding, testing, quality assurance, implementation and all supporting project artefacts and documentation. Such as Technical Design Document (TDD), source to target mapping document and unit/system integration testing strategies.
- Collaborates with Architecture & Standards on creating frameworks, reference implementations and coding standard practices to be incorporated to the Architecture Blueprint. Gathers, analyses, and draws conclusions from large, diverse data sets to identify problems and contribute to decision-making in service of secure, stable application development.
- Develops data pipelines, visualizations and the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources. Works with assigned Information Technology and Services (ITS) project team/program area and provides leadership and technical guidance to other ITS staff in the development of system designs and automated information flows/processes based on user requirements and specifications for system implementations, enhancements and/or customisations.
- Ensures other Information Technology and Services (ITS) resources receive adequate information to perform their assigned project related tasks; coordinates and ensures timely delivery of these assigned task deliverables.
- Responsible for updating project status and change request reporting, facilitates the maintenance of project plans, issue identification and resolution management, risk mitigation and resource management.
Key Qualifications
- Extensive experience in a senior technical leadership role with the ability to supervise and mentor staff.
- Experience in designing, developing and deploying large scale Data Integration/ETL solutions
- Profound knowledge and experience in developing PySpark data pipelines
Qualifications
- Demonstrated expertise in Data Warehouse/ETL architecture, data model principles and methodologies including Kimball and Inmon. Familiarity with data warehouse project development lifecycle is highly desirable.
- Experience with AWS EMR clusters
- High knowledge of shell scripting.
- Experience with Apache Airflow
- Exposure to Business Intelligence tools, Qlik Sense preferred, and demonstrates a good understanding of the entire BI production suite.
- Practical Experience in development of logical/physical data models for data warehouse and data mart tables, including star schema and 3NF implementations is an asset.
- Ability to work on multiple projects concurrently and prioritize tasks based on changing events.
- Experience and knowledge of Quality Assurance methods and protocols for ETL/DW.
- Have hands-on experience building applications with large data sets
- Be able to implement the proposed technical solution using the Cloud Technology stack (AWS, Redshift, S3).
- Exposure to agile methodologies such as CI/CD, Application Resiliency, and Security.
- Ability to work on multiple projects concurrently and prioritize tasks based on changing events.
- Experience and knowledge of Quality Assurance methods and protocols for data pipelines and BI Web Applications.
- Excellent interpersonal, facilitation, presentation and communication skills, with the ability to communicate complex issues and processes in simple user terminology.
About LeverageTek Staffing Solutions
Founded in 2003, LeverageTek provides end-to-end, cross-functional staffing solutions throughout North America. We are a trusted partner to leading private and public sector organizations and experts in talent solutions that create optimal business outcomes.
Don't let our name fool you. Our roots are in technology, but we are also a proven leader in accounting and finance, sales and marketing, human resources, supply chain, and legal talent acquisition. We offer contract and permanent staffing, executive search, talent mapping, management consultancy, and contractor payroll management.
LeverageTek is an equal opportunity employer. We offer a welcoming and inclusive environment in service to one another, our customers, the candidates we represent, and the diverse communities we call home. We do all of this with kindness, empathy, and respect for each other. LeverageTek is committed to employment equity and creating a diverse and inclusive workplace. We welcome applications from all qualified individuals regardless of race, religion, gender, national origin, age, disability, and marital status.
Accessibility accommodations are available upon request
-
Lead Data Engineer
7 days ago
Ottawa, Ontario, Canada Quantexa Full time $120,000 - $180,000 per yearWhat We're All About.It isn't often you get to be part of a tech company that, since 2016, has been innovating the data analytics market in ways no-one else can. Our technology started out in FinTech, helping tackle serious criminal activity. Now, its potential is virtually limitless. Working at Quantexa isn't just intellectually stimulating. We're a real...
-
Field Application Engineer
2 weeks ago
Ottawa, Ontario, Canada High Tech Genesis Full time $80,000 - $120,000 per yearWE'RE HIRINGAt HTG, you'll push boundaries with the latest tech and collaborate with a team that loves what they do. Be part of a design services company that is amongst the companies that lead the world in technology and innovation.Your next chapter starts here.In this role you will;Serve as a technical specialist supporting customers deploying advanced...
-
Compliance Engineer
3 days ago
Ottawa, Ontario, Canada High Tech Genesis Full time $100,000 - $150,000 per yearWE'RE HIRINGAt HTG, you'll push boundaries with the latest tech and collaborate with a team that loves what they do. Be part of a design services company that is amongst the companies that lead the world in technology and innovation.Your next chapter starts here.In this role, you will:Collaborate with cross-functional engineering and product teams to plan...
-
Compliance Engineer
2 days ago
Ottawa, Ontario, Canada High Tech Genesis Full time $120,000 - $180,000 per yearWE'RE HIRING At HTG, you'll push boundaries with the latest tech and collaborate with a team that loves what they do. Be part of a design services company that is amongst the companies that lead the world in technology and innovation. Your next chapter starts here. In this role, you will: • Collaborate with cross-functional engineering and product...
-
Network Engineer
2 days ago
Ottawa, Ontario, Canada High Tech Genesis Full time $80,000 - $120,000 per yearWE'RE HIRING At HTG, you'll push boundaries with the latest tech and collaborate with a team that loves what they do. Be part of a design services company that is amongst the companies that lead the world in technology and innovation. Your next chapter starts here. In this role, you will: • Provide 2nd and 3rd Tier consultation/troubleshooting to...
-
Senior Cloud FinOps Analyst
2 days ago
Ottawa, Ontario, Canada High Tech Genesis Full time $120,000 - $180,000 per yearWE'RE HIRINGAt HTG, you'll push boundaries with the latest tech and collaborate with a team that loves what they do. Be part of a design services company that is amongst the companies that lead the world in technology and innovation.Your next chapter starts here.In this role, you will:Own the FinOps data layer: Build and govern CUR/usage pipelines leveraging...
-
Embedded Software Engineer
2 days ago
Ottawa, Ontario, Canada High Tech Genesis Full timeWE'RE HIRINGAt HTG, you'll push boundaries with the latest tech and collaborate with a team that loves what they do. Be part of a design services company that is amongst the companies that lead the world in technology and innovation.Your next chapter starts here.In this role, you will:Develop, and maintain software solutions in C and Python.Write automation...
-
DevSecOps Engineer
1 week ago
Ottawa, Ontario, Canada High Tech Genesis Full time $80,000 - $120,000 per yearWE'RE HIRINGAt HTG, you'll push boundaries with the latest tech and collaborate with a team that loves what they do. Be part of a design services company that is amongst the companies that lead the world in technology and innovation.We're seeking an DevSecOps Engineer to accelerate how we build, test, and secure software. You'll craft secure CI/CD pipelines...
-
Sr. Data Engineer
1 week ago
Ottawa, Ontario, Canada Alquemy Full time $80,000 - $120,000 per yearJob Description The Senior Data Engineer will be responsible for leading the delivery of data on data and analytics platform. These services are at the forefront of building out data engineering practice cloud-native technologies. The Senior Data Engineer Service Provider must have experience in leading, designing, implementing, and collaborating with...
-
Resource Manager
2 days ago
Ottawa, Ontario, Canada High Tech Genesis Full time $80,000 - $120,000 per yearWE'RE HIRINGAt HTG, you'll push boundaries with the latest tech and collaborate with a team that loves what they do. Be part of a design services company that is amongst the companies that lead the world in technology and innovation.Your next chapter starts here.In this role, you will:Gaining a deep understanding of the technical requirements and nuances of...