Data Engineer/Lead
1 week ago
Get AI-powered advice on this job and more exclusive features.Develop a comprehensive technical plan for the migration, including data ingestion, transformation, storage, and access control in Azure's Data Factory and data lakeDesign and implement scalable and efficient data pipelines to ensure smooth data movement from multiple sources using Azure DatabricksDeveloping scalable and re-usable frameworks for ingesting data setsEnsure data quality and integrity throughout the entire data pipeline, implementing robust data validation and cleansing mechanismsWorking with event-based/streaming technologies to ingest and process dataProvide technical guidance and support to the team, resolving any technical challenges or issues that may arise during the migration and post-migration phasesStay up to date with the latest advancements in cloud computing, data engineering, and analytics technologies, and recommend best practices and industry standards for implementing the data lake solution.Requirements:Min. 4 years of Experience working with Azure DatabricksExperience in Data Modelling & Source System AnalysisFamiliarity with PySpark.Mastery of SQL.Experience with Python programming language used for data Engineering purposesAbility to conduct data profiling, cataloguing, and mapping for technical design and construction of technical data flows.Experience in data visualization/exploration tools.Providing Technical leadership and guidance to TeamsStrong problem-solving skills and the ability to translate business requirements into actionable data science solutionsExcellent communication skills, with the ability to effectively convey complex ideas to technical and non-technical stakeholdersStrong team player with excellent interpersonal and collaboration skillsAbility to manage multiple projects simultaneously and deliver high-quality results within specified timelines.Education:Bachelor’s degree/University degree or equivalent experience.Seniority levelSeniority levelMid-Senior levelEmployment typeEmployment typeFull-timeJob functionJob functionInformation TechnologyIndustriesIT Services and IT ConsultingReferrals increase your chances of interviewing at Kumaran Systems by 2xSign in to set job alerts for “Data Engineer” roles.Software Engineer, Backend (All Levels / All Teams)Software Engineer I, Entry Level (Fall 2024-Spring 2025) - TorontoToronto, Ontario, Canada CA$58.00-CA$60.00 15 hours agoWe’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI. #J-18808-Ljbffr
-
Manager, Data Centre Facilities Engineering
2 weeks ago
Toronto, ON MW G, Canada NTT DATA Full time $120,000 - $180,000 per yearMake an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it's a place where you can grow, belong and thrive.Your day at NTT DATAThe Manager, Data...
-
Data Engineer Lead
4 weeks ago
Toronto, Canada Compunnel, Inc. Full timeWe are seeking a Data Engineer Lead with strong expertise in relational and NoSQL databases, big data technologies, and cloud-native architectures. The ideal candidate will lead data engineering initiatives, design scalable solutions, and guide the team in implementing best practices. Key Responsibilities Lead the design and development of data pipelines and...
-
Data Engineer Lead
4 weeks ago
Toronto, Canada Compunnel, Inc. Full timeWe are seeking a Data Engineer Lead with strong expertise in relational and NoSQL databases, big data technologies, and cloud-native architectures. The ideal candidate will lead data engineering initiatives, design scalable solutions, and guide the team in implementing best practices. Key Responsibilities Lead the design and development of data pipelines and...
-
Data Engineer Lead
4 weeks ago
Toronto, Canada Compunnel, Inc. Full timeWe are seeking a Data Engineer Lead with strong expertise in relational and NoSQL databases, big data technologies, and cloud-native architectures. The ideal candidate will lead data engineering initiatives, design scalable solutions, and guide the team in implementing best practices. Key Responsibilities Lead the design and development of data pipelines and...
-
Data Engineer Lead
4 weeks ago
Toronto, Canada Compunnel, Inc. Full timeWe are seeking a Data Engineer Lead with strong expertise in relational and NoSQL databases, big data technologies, and cloud-native architectures. The ideal candidate will lead data engineering initiatives, design scalable solutions, and guide the team in implementing best practices. Key Responsibilities - Lead the design and development of data...
-
Lead Data Engineer
6 days ago
Toronto, Canada Gala Solutions Inc Full timeJob Title: Lead Data Engineer / Data Architect Location: Canada (Hybrid Toronto) About the Role: We are seeking an experienced Lead Data Engineer / Data Architect to spearhead the design, development, and implementation of our enterprise data platform. This role will be instrumental in shaping and driving our data engineering roadmap, ensuring...
-
Lead Data Engineer
4 days ago
Toronto, Canada Gala Solutions Full timeJob Title: Lead Data Engineer / Data Architect Location: Canada (Hybrid Toronto) About the Role: We are seeking an experienced Lead Data Engineer / Data Architect to spearhead the design, development, and implementation of our enterprise data platform. This role will be instrumental in shaping and driving our data engineering roadmap, ensuring scalability,...
-
Lead Data Engineer
4 days ago
Toronto, Canada Mastercard Full timeOur Purpose Mastercard powers economies and empowers people in 200+ countries and territories worldwide. Together with our customers, we’re helping build a sustainable economy where everyone can prosper. We support a wide range of digital payments choices, making transactions secure, simple, smart and accessible. Our technology and innovation, partnerships...
-
Lead Data Engineer
4 days ago
Toronto, Canada Mastercard Full timeOur Purpose Mastercard powers economies and empowers people in 200+ countries and territories worldwide. Together with our customers, we’re helping build a sustainable economy where everyone can prosper. We support a wide range of digital payments choices, making transactions secure, simple, smart and accessible. Our technology and innovation, partnerships...
-
Lead Data Engineer
6 days ago
Toronto, Canada Gala Solutions Full timeJob Title: Lead Data Engineer / Data ArchitectLocation: Canada (Hybrid Toronto)About the Role:We are seeking an experienced Lead Data Engineer / Data Architect to spearhead the design, development, and implementation of our enterprise data platform. This role will be instrumental in shaping and driving our data engineering roadmap, ensuring scalability,...
