Data Engineer/Lead
4 months ago
Responsibilities:
- Develop a comprehensive technical plan for the migration, including data ingestion, transformation, storage, and access control in Azure's Data Factory and data lake
- Design and implement scalable and efficient data pipelines to ensure smooth data movement from multiple sources using Azure Databricks
- Developing scalable and re-usable frameworks for ingesting data sets
- Ensure data quality and integrity throughout the entire data pipeline, implementing robust data validation and cleansing mechanisms
- Working with event-based/streaming technologies to ingest and process data
- Provide technical guidance and support to the team, resolving any technical challenges or issues that may arise during the migration and post-migration phases
- Stay up to date with the latest advancements in cloud computing, data engineering, and analytics technologies, and recommend best practices and industry standards for implementing the data lake solution.
Requirements:
- Min. 4 years of Experience working with Azure Databricks
- Experience in Data Modelling & Source System Analysis
- Familiarity with PySpark.
- Mastery of SQL.
- Knowledge of components: Informatica, Azure Data Factory, Azure Data Lake, Azure SQL DW, Azure SQL.
- Experience with Python programming language used for data Engineering purposes
- Ability to conduct data profiling, cataloguing, and mapping for technical design and construction of technical data flows.
- Experience in data visualization/exploration tools.
- Providing Technical leadership and guidance to Teams
- Strong problem-solving skills and the ability to translate business requirements into actionable data science solutions
- Excellent communication skills, with the ability to effectively convey complex ideas to technical and non-technical stakeholders
- Strong team player with excellent interpersonal and collaboration skills
- Ability to manage multiple projects simultaneously and deliver high-quality results within specified timelines.
Education:
- Bachelor’s degree/University degree or equivalent experience.
-
Data Engineering Lead
4 weeks ago
Toronto, Canada Tactable Full timeA Data Engineering Lead at Tactable drives the development and implementation of scalable data pipelines, utilizing Python, data storage solutions, and ETL tools. This role requires expertise in designing and maintaining automation workflows to boost team efficiency.Key ResponsibilitiesDevelop and lead data engineering projects from inception to...
-
Data Engineering Lead
4 weeks ago
Toronto, Canada Finance Professionals Inc. Full timeFinance Professionals Inc.Salary: $120,000 - $180,000 per yearAbout the RoleWe are seeking an experienced Data Engineering Lead to join our team at Finance Professionals Inc. in Downtown, Toronto. This is a hybrid role with 3 days onsite and offers a chance to work with a dynamic team on challenging projects.Job DescriptionThis is a 1-year contract...
-
Data Migration Technical Lead
4 weeks ago
Toronto, Canada NTT DATA Full time**Req ID**: 303681 We are currently seeking a Data Migration Technical Lead to join our team in Toronto, Ontario (CA-ON), Canada (CA). **Job Requirements** - 10+ years of experience in large Data Migration efforts, SAP Data Migration, ETL and LTMC experience, and 2 years in S/4 HANA Data Migration preferred - 3 - 4 full cycle data migration experience -...
-
Data Engineering Lead
4 weeks ago
Toronto, Canada Tata Consultancy Services Full timeTata Consultancy Services (TCS) is a leading IT services company with over 55 years of experience in partnering with top businesses worldwide.Salary: $120,000 - $180,000 per year, depending on location and experience.Job Overview:We are seeking an experienced Data Engineering Lead to join our team. In this role, you will be responsible for designing,...
-
Senior Data Engineering Lead
6 days ago
Toronto, Canada Premium Stairs & Railings Inc. Full timeAbout Our Company:Premium Stairs & Railings Inc. is a leading manufacturer of high-quality staircases and railings. We are seeking a highly skilled and experienced Senior Data Engineering Lead to lead our data engineering team.Job Summary:We offer a competitive salary, benefits package, and opportunities for professional growth and development. The...
-
Data Engineering Lead
4 weeks ago
Toronto, Canada GalaxEons Full timeGalaxEons seeks a seasoned Data Engineering Lead to spearhead the development of optimal data pipelines. About the RoleThe successful candidate will be responsible for creating and maintaining robust data architectures, implementing data products, and ensuring data quality and integrity. Key ResponsibilitiesDesign and develop scalable data pipelines...
-
Data Engineering Lead
4 weeks ago
Toronto, Canada Quantum World Technologies Inc. Full timeWe are seeking a skilled Data Engineering Lead to join our team at Quantum World Technologies Inc. in Toronto, ON Canada.As a key member of our data engineering team, you will play a crucial role in designing and implementing scalable data pipelines on cloud providers, preferably AWS.The ideal candidate will have at least 8+ years of experience in data...
-
Data Engineering Lead
1 month ago
Old Toronto, Canada Tiger Analytics, LLC Full timeTiger Analytics, LLC is a pioneering analytics consulting firm. We collaborate with prominent Fortune 100 companies to unlock business value from data insights.We seek an exceptional professional with a balanced blend of business acumen and technical expertise in Data Engineering and reporting solutions.Key Responsibilities:This role demands a strong focus...
-
Data Migration Technical Lead
2 months ago
Toronto, Canada NTT DATA Full timeJob Description: Job Requirements - 10+ years of experience in large Data Migration efforts, SAP Data Migration, ETL and LTMC experience, and 2 years in S/4 HANA Data Migration preferred - 3 - 4 full cycle data migration experience - Extensive experience in ETL using SAP BODS and SAP IS with respect to SAP Master / Transaction Data Objects in SAP FICO, SAP...
-
Lead Data Engineering Specialist
4 weeks ago
Toronto, Canada Compunnel Inc. Full timeCompunnel Inc. is seeking a highly skilled Lead Data Engineering Specialist to join our team in Toronto, Ontario.The ideal candidate will have 8+ years of experience in data engineering with AWS, Glue, Lambda, SQL, Python, Dovps, and Redshift.We are looking for an expert who can design and implement data pipelines on cloud providers, preferably AWS. The...
-
Old Toronto, Canada Data Privacy Full timeWe are seeking a highly skilled Data Scientist to join our team at TD, a leading global financial institution. The successful candidate will be part of the AI2 Data Scientist Associate Program, a 1-year intensive training program designed for new graduates.The role involves working on comprehensive training, mentorship, and real-world project opportunities...
-
Lead Data Engineer
1 month ago
Toronto, Ontario, Ontario, Canada Cygnus Professionals Inc. Full timeTitle: Sr. Data Engineer LeadLocation: Toronto, OntarioJob Description :8+ years of experience in Data Engineer with AWS, Glue, Lambda, SQL, Python, Dovps, Redshift.Must have working knowledge in designing and implementing data pipelines on any of the cloud providers (AWS is preferred). Must be able to work with large volumes of data coming from various...
-
Data Engineer Lead Opportunity
1 month ago
Toronto, Ontario, Canada Randstad Full timeAbout the RoleWe are pleased to offer a Data Engineer contract opportunity with a leading employer in Toronto. As a hybrid role, you will work onsite twice a week, with Wednesday as your anchor day.AdvantagesYou will have the opportunity to work with a prominent employer in the local market.Potential for contract extension and conversion.Key DetailsThis is...
-
Associate Data Scientist
2 months ago
Old Toronto, Canada Data Privacy Full timep>TD, one of the world's leading global financial institutions, provides a dynamic environment with the AI2 Data Scientist Associate Program. This 1-year intensive program is designed for new graduates, featuring comprehensive training, mentorship, and real-world project opportunities within TD's various business lines.Perform data queries and prepare data...
-
Data Engineer Lead
6 days ago
Toronto, Ontario, Canada Lorven Technologies Inc. Full timeData Engineer Lead - Advanced Analytics**Company Overview**Lorven Technologies Inc. is a leading technology company that specializes in data-driven solutions.**Salary Range**$80,000 - $120,000 per year**Job Description**We are seeking an experienced Data Engineer Lead to join our advanced analytics team.As a Data Engineer Lead, you will be responsible for...
-
Data Engineering Team Lead
4 days ago
Toronto, Canada OANDA Full timeAbout OANDAOANDA is revolutionising the world of currency trading by providing innovative trading experiences, currency data and analytics solutions.We are a forward-thinking company that strives to transform how our customers can meet all their currency needs. Our vision is to empower individuals and businesses with cutting-edge technology and expert...
-
Senior Data Engineering Lead
3 weeks ago
Old Toronto, Canada Gradient Ascent AI Full timeWe are seeking an experienced Senior Data Engineering Lead to spearhead the development and implementation of large-scale data solutions. As a key member of our team, you will be responsible for managing a team of engineers and driving the launch of critical projects.Key Responsibilities:Lead cross-functional teams to design, develop, and deploy scalable...
-
Cloud Data Engineer Lead
6 days ago
Toronto, Canada E-Solutions Full timeJob DescriptionE-Solutions is seeking a highly experienced Cloud Data Engineer Lead to join our team in Toronto, Canada. This role requires a strong background in designing and developing complex data-intensive applications using Java, Python, and other programming languages.We offer a competitive salary of $175,000 per year, commensurate with...
-
Senior Cloud Data Engineering Lead
1 month ago
Toronto, Ontario, Canada Scotiabank Full timeJob OverviewWe are seeking an experienced Senior Cloud Data Engineering Lead to join our team at Scotiabank in Toronto, Canada.Salary: $175,000 - $225,000 per yearAbout the RoleThis is a leadership position that requires strong technical expertise and business acumen. As a Senior Cloud Data Engineering Lead, you will be responsible for designing, building,...
-
Lead Engineer- Data Engineering
3 weeks ago
Old Toronto, Canada Celestica Full timeh3>Senior SIPI Lead Engineer, Hardware DesignSkip to contentSummaryThe Signal and Power Integrity Engineer will play a critical role in the planning of digital PCB designs, simulation, lab verification, and troubleshooting signal integrity issues on completed designs. They will also be expected to help with design review of critical PCBs for signal integrity...