Data Engineer/Lead

2 months ago

Toronto Ontario, Ontario, Canada Kumaran Systems Full time

Responsibilities:

  • Develop a comprehensive technical plan for the migration, including data ingestion, transformation, storage, and access control in Azure's Data Factory and data lake
  • Design and implement scalable and efficient data pipelines to ensure smooth data movement from multiple sources using Azure Databricks
  • Developing scalable and re-usable frameworks for ingesting data sets
  • Ensure data quality and integrity throughout the entire data pipeline, implementing robust data validation and cleansing mechanisms
  • Working with event-based/streaming technologies to ingest and process data
  • Provide technical guidance and support to the team, resolving any technical challenges or issues that may arise during the migration and post-migration phases
  • Stay up to date with the latest advancements in cloud computing, data engineering, and analytics technologies, and recommend best practices and industry standards for implementing the data lake solution.


Requirements:

  • Min. 4 years of Experience working with Azure Databricks
  • Experience in Data Modelling & Source System Analysis
  • Familiarity with PySpark.
  • Mastery of SQL.
  • Knowledge of components: Informatica, Azure Data Factory, Azure Data Lake, Azure SQL DW, Azure SQL.
  • Experience with Python programming language used for data Engineering purposes
  • Ability to conduct data profiling, cataloguing, and mapping for technical design and construction of technical data flows.
  • Experience in data visualization/exploration tools.
  • Providing Technical leadership and guidance to Teams
  • Strong problem-solving skills and the ability to translate business requirements into actionable data science solutions
  • Excellent communication skills, with the ability to effectively convey complex ideas to technical and non-technical stakeholders
  • Strong team player with excellent interpersonal and collaboration skills
  • Ability to manage multiple projects simultaneously and deliver high-quality results within specified timelines.



Education:

  • Bachelor’s degree/University degree or equivalent experience.

  • Senior Data Engineer

    4 weeks ago

    Old Toronto, Ontario, Canada Data Engineer Jobs Full time

    About This RoleWe are seeking a highly skilled Senior Data Engineer to join our Analytics Engineering team. As a key member of this team, you will be responsible for designing and building scalable data models and ETL pipelines to support business decisions.Key Responsibilities:Collaborate with data scientists to design data models and answer questions.Work...

  • Data Engineer

    3 months ago

    Toronto, Ontario, Ontario, Canada Tactable Full time

    A Data Engineer at Tactable is a professional with a deep understanding of python, data pipelines, and various types of data storage. In this role, you’ll take the lead in building data pipelines used to ingest the information that fuels models and trading systems.Responsibilities:Work with proprietary tools and technologies including time series...

  • Data Engineering Lead

    4 days ago

    Toronto, Ontario, Canada Ripple Full time

    Unlock Your Potential as a Data Engineering LeadRipple, a pioneer in decentralized technologies, is seeking an exceptional data engineering lead to join our team. As a key player in shaping our data infrastructure, you will play a crucial role in driving innovation and growth.About RippleWe're revolutionizing the way value moves across borders, leveraging...

  • Data Engineering Lead

    1 month ago

    Toronto, Ontario, Canada Royal Bank of Canada> Full time

    Job SummaryAs a key member of our data engineering team, you will play a crucial role in leading the delivery of data products to improve decision making, driven by data, and empowered by technology. Your primary focus will be on designing, implementing, and maintaining robust data infrastructure and pipelines to support our organization's data needs and...

  • Staff Data Engineer

    1 month ago

    Old Toronto, Ontario, Canada NTT DATA, Inc. Full time

    Job Title: Staff Data EngineerWe are seeking a highly skilled Staff Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing and implementing tailored data solutions to meet customer needs and use cases.Key Responsibilities:Provide thought leadership and recommend the most appropriate technologies...

  • Data Engineering Lead

    4 weeks ago

    Toronto, Ontario, Canada Synpulse Schweiz AG Full time

    About the RoleWe are seeking a highly skilled and motivated Principal Analytics Engineer to join our dynamic team. As a key member of our data engineering team, you will lead the design, development, and implementation of data and AI solutions tailored to the unique needs of our financial services clients.Key ResponsibilitiesLead the design, development, and...

  • Data Engineer

    2 months ago

    Toronto, Ontario, Ontario, Canada Anson McCade Full time

    Data EngineerDay Rate: Up to $800 (CAD)Duration: 6 weeks extending to 1 year+Location: Toronto - RemoteStart Date: October 15th - 21st The Opportunity:The UK’s #1 Digital Solutions Provider seeks a talented Data Engineer specializing in Informatica Cloud to support a complex Data Transformation program for a North American-based healthcare company. The...

  • Senior Data Engineer

    2 weeks ago

    Toronto, Ontario, Ontario, Canada Apex Systems Full time

    Senior Data EngineerApex Systems is a global IT services provider, and our staffing practice has an opening infor a Senior Data Engineer specializing specifically with experience in GCP, SQL and data engineering.Client: Enterprise RetailTerms: 6-month possibility with extensionLocation: Hybrid TorontoPosition Responsibilities: Work closely with in-house...

  • Data Engineering Lead

    4 weeks ago

    Toronto, Ontario, Canada Scotiabank Full time

    Are you a data engineering expert looking for a new challenge? We're seeking a highly skilled Data Engineering Lead to join our team at Scotiabank.Key Responsibilities:Lead data initiatives from intake to solution design, development, testing, and productionization of data processes.Develop and implement data ingestion pipelines and DevOps processes to move...

  • Data Engineer Lead

    4 weeks ago

    Toronto, Ontario, Canada Royal Bank of Canada Full time

    Job Title: Lead Data EngineerJob Summary:We are seeking a highly skilled Lead Data Engineer to join our team at Royal Bank of Canada. As a Lead Data Engineer, you will be responsible for providing technical expertise and assistance with the Extraction, Loading, and Transformation of unstructured datasets.Key Responsibilities:Provide technical expertise and...

  • Data Engineering Lead

    1 week ago

    Toronto, Ontario, Canada National Bank Full time

    Senior Data Engineer Job DescriptionWe are seeking a highly skilled Senior Data Engineer to join our Data Solutions team at National Bank.Job SummaryThe successful candidate will be responsible for designing, developing, and maintaining robust data pipelines that extract, transform, and load (ETL) data from various sources and store in our data warehouse....

  • Lead Data Engineer

    1 month ago

    Toronto, Ontario, Canada Scotiabank Full time

    About the RoleWe are seeking a highly skilled Lead Data Engineer to join our team at Scotiabank. As a key member of our technology team, you will play a critical role in designing and implementing cutting-edge data solutions that drive business growth and innovation.Key ResponsibilitiesLead the design and implementation of data engineering solutions,...

  • Data Engineer

    2 weeks ago

    Toronto, Ontario, Ontario, Canada Raise Full time

    Senior Data Engineer (Warehouse/Platforms)Location: Toronto, ON - Hybrid (1 day a week in office- No specific days)Contract Length: 3 month with Possibility of extension.We at Raise are hiring a Senior Data Engineer (Warehouse/Platforms) for one of our top clients. After establishing themselves as an industry leader, they’re now expanding their team to...

  • Data Engineering Lead

    4 days ago

    Toronto, Ontario, Canada Lorven Technologies Full time

    About Lorven TechnologiesWe are a leading technology firm based in Ontario, Canada.Salary:$125,000 - $180,000 per yearJob DescriptionWe are seeking an experienced Data Engineer to lead our big data team.Key ResponsibilitiesDesign and implement scalable big data solutions using Scala, Java, Hive, HDFS, Unix shell scripting, SQL, and Snowflake.Develop and...

  • Data Analytics Engineering Lead

    7 days ago

    Toronto, Ontario, Canada Scotiabank Full time

    At Scotiabank, we're looking for a talented Data Analytics Engineering Lead to join our team. This is an exciting opportunity to work with industry leaders and contribute to the development of cutting-edge data analytics solutions.About the RoleWe're seeking a seasoned technical expert with a passion for data engineering and analytics. As a Data Analytics...

  • Data Engineer

    2 weeks ago

    Toronto, Ontario, Ontario, Canada Banting AI Full time

    About Banting AIBanting AI is harnessing the power of advanced AI to reshape the future of healthcare. We believe that by optimizing clinical research and unlocking the full potential of healthcare data, we can accelerate the path to life-saving treatments. Our mission is ambitious: to build technology that empowers and accelerates clinical research and...

  • Data Engineering Lead

    3 weeks ago

    Toronto, Ontario, Canada World Education Services Full time

    Job Summary:The Data Engineering Lead will be responsible for designing, developing, and maintaining our data architecture, with a focus on Snowflake and ETL processes. The ideal candidate will have a deep background in data engineering, expertise with Snowflake's cloud data platform, and highly proficient in ETL tools and methodologies.Key...

  • Senior Data Engineering Lead

    3 weeks ago

    Toronto, Ontario, Canada Synpulse Schweiz AG Full time

    We are seeking a highly skilled Senior Data Engineering Lead to join our dynamic team at Synpulse Schweiz AG. As a key member of our data engineering team, you will be responsible for designing, developing, and implementing robust, scalable, and efficient data solutions tailored to the unique needs of our financial services clients.About the Role:Lead the...

  • Data Engineering Technical Lead

    4 weeks ago

    Old Toronto, Ontario, Canada Electronic Arts Inc. Full time

    Job Title: Data Engineering Technical LeadAs a key member of our Product Engineering team, you will play a crucial role in developing high-scale central data products that align with our strategic goals. You will manage a team of focused data engineers, guide technical execution, and set the strategic direction for engineering projects.Key...

  • Lead Data Engineer: Scalable Data Architectures

    3 days ago

    Toronto, Ontario, Canada Scotiabank Full time

    About the RoleWe seek a seasoned Lead Data Engineer with deep expertise in Google Cloud Platform (GCP) to join our growing Wealth Data engineering team within Global Wealth Engineering (GWE). This team delivers operational data solutions to various stakeholders within Wealth Management.ResponsibilitiesDesign, build, and maintain scalable data architectures...