Data Engineer

13 hours ago

Toronto, Canada Soar Consultants Full time

DESCRIPTIONWe are currently looking for a Data Engineer for a client in Toronto. They are looking for someone with expreience working with Azure, DataBricks and experience working in the Banking/Finance sectors.  RESPONSIBILITIES● Analyze and understand business requirements related to data and information, with a particular focus on the financial services industry.● Design data integration and ETL processes using tools such as Databricks, Spark, Hadoop, and Hive, following a holistic, scalable, pragmatic, and effective approach to data processing.● Ingest and transform data in Databricks for batch and near real-time processing using technologies such as PySpark and SparkSQL, while leveraging orchestration tools like Azure Data Factory within the broader Microsoft Azure ecosystem.Design and implement data pipelines integrated with Continuous Integration/Continuous Delivery (CI/CD) frameworks as required (DevOps).● Develop automated unit-testing to ensure data quality and reliability.● Develop design and operational documentation for job schedules and data pipelines.● Produce estimates for data analysis and mapping, design, development, and testing.● Ensure compliance with business, data, and technical requirements.● Comply with client’s enterprise architecture standards, policies, and procedures are followed. REQUIREMENTS● Minimum 5 years experience in Information Technology, participating in complex projects.● Minimum Bachelors degree in Computer Science.● Strong communication skills.● Strong knowledge in data analysis, database development, big data, data lakehouse, data warehousing life cycle and data integration methodologies.● Strong SQL knowledge of using in Databricks workspace and Delta Lake features .● Strong programming skills in Pyspark and Apache Spark Architecture.● Experience with DLT for building reliable and maintainable data pipelines for streaming data using Databricks Structured Streaming.● Strong understanding of at least one major cloud provider (e.g., AWS, Azure, or GCP) and its data-related services is essential. This includes knowing about services for data storage (like S3 or Azure Blob Storage) and how they integrate with Databricks.● Designing schemas for databases and understanding concepts like the medallion architecture (Bronze, Silver, Gold layers) and slowly changing dimensions (SCD)● Familiarity with concepts of data quality, security, and governance, often utilizing Databricks's Unity Catalog.● Knowledge of ETL development using SSIS, Informatica, Data Stage● Knowledge of and experience with Copilots and LLMs to gain higher productivity● Strong knowledge of Oracle, Microsoft SQL databases.● Knowledgeable in both relational and dimensional data modeling (with both Kimball and Inmon approaches).● Experience in .NET development and UNIX shell scripting (nice to have).● Good overall business knowledge in financial industries (i.e. one or more in retail banking, commercial banking, capital markets, wealth management, insurance, pension fund, and fintech).● Ability to work independently and excel in a team environment.● Preferably as Databricks Certified Data Engineer Associate. 

  • Principal Data Engineer

    24 minutes ago

    Toronto, Canada JamLabs Data Science Full time

    Why JamLabs? At JamLabs, we're not just another data consultancy. We're a Toronto-based firm founded by leading engineers and data scientists, with deep roots in capital markets and cloud engineering. Our mission is to transform data into strategic assets for financial services firms, driving growth and innovation through tailored solutions.About the RoleYou...

  • Principal Data Engineer

    5 hours ago

    Toronto, Canada JamLabs Data Science Full time

    Why JamLabs? At JamLabs, we're not just another data consultancy. We're a Toronto-based firm founded by leading engineers and data scientists, with deep roots in capital markets and cloud engineering. Our mission is to transform data into strategic assets for financial services firms, driving growth and innovation through tailored solutions. About the Role...

  • Principal Data Engineer

    5 hours ago

    Toronto, Ontario, Canada JamLabs Data Science Full time

    About the CompanyWhy JamLabs? At JamLabs, we're not just another data consultancy. We're a Toronto-based firm founded by leading engineers and data scientists, with deep roots in capital markets and cloud engineering. Our mission is to transform data into strategic assets for financial services firms, driving growth and innovation through tailored...

  • Presales Engineer

    3 weeks ago

    Toronto, Canada Data Mavericks Full time

    A leading data solutions company is seeking a Presales Engineer to assist in closing complex deals by collaborating with sales and delivering compelling value-based demonstrations. The ideal candidate will have strong experience in consultative sales and a broad understanding of data technologies. Responsibilities include leading discovery conversations,...

  • Presales Engineer

    5 hours ago

    Toronto, Canada Data Mavericks Full time

    A leading data solutions company is seeking a Presales Engineer to assist in closing complex deals by collaborating with sales and delivering compelling value-based demonstrations. The ideal candidate will have strong experience in consultative sales and a broad understanding of data technologies. Responsibilities include leading discovery conversations,...

  • Presales Engineer

    21 minutes ago

    Toronto, Canada Data Mavericks Full time

    A leading data solutions company is seeking a Presales Engineer to assist in closing complex deals by collaborating with sales and delivering compelling value-based demonstrations. The ideal candidate will have strong experience in consultative sales and a broad understanding of data technologies. Responsibilities include leading discovery conversations,...

  • Applications Engineer

    5 hours ago

    Toronto, Canada The Engineer UK Full time

    Overview Job Title: Applications Engineer (UPS) Location: Scarborough Salary: Competitive Job type: Full Time - Permanent We want all our colleagues to grow and build careers with Dale. We invest in our people for the future. Many of our team members have been with us for over 30 years and some of our management team began their careers as apprentices. As we...

  • Senior Software Engineer

    5 hours ago

    Toronto, Canada VAST Data Full time

    Join to apply for the Senior Software Engineer role at VAST Data . VAST Data is looking for a Core Database Developer (Database Internals) to join our growing team. This is a great opportunity to be part of one of the fastest‑growing infrastructure companies in history, at the center of the revolution in artificial intelligence and the creation of a...

  • Senior Software Engineer

    22 minutes ago

    Toronto, Canada VAST Data Full time

    Join to apply for the Senior Software Engineer role at VAST Data.VAST Data is looking for a Core Database Developer (Database Internals) to join our growing team. This is a great opportunity to be part of one of the fastest‑growing infrastructure companies in history, at the center of the revolution in artificial intelligence and the creation of a...

  • In-person Instructor, Data Science and Data Literacy

    4 hours ago

    Toronto, Canada Data Society Full time

    We Are: At Data Society Group, we provide the highest quality, leading-edge, industry-tailored data and AI training and solutions for Fortune 1,000 companies and federal, state, and local governmental organizations. We partner with our clients to educate, equip, and empower their workforce with the skills they need to achieve their goals and expand their...