Senior Data Engineer – Big Data

7 days ago


Toronto, Ontario, Canada AstraNorth Full time $120,000 - $180,000 per year


• Exp Required: 10

  • Engineer

  • Skills Required: Agile Way of Working Digital : Python Digital : Bigdata and Hadoop Ecosystem - MapR PL/SQL

  • Job Description: Required Technical Skills-10 years of experience in designing and implementing the applications.

  • 8 year of experience in Spark, Scala, and Java

  • 8 years of experience in SQL Server RDBMS.

  • Knowledge of Containerization, OpenShift and Docker.

  • Cloud knowledge like data bricks and snowflake.

  • Experience with Linux and Cloud Technologies like Open Shift would be an asset.

  • Experience with Continuous Build and Integration Process.

  • Experience with data models and entity re-lationships.

  • Nice to have Spring Boot, and Angular Responsibilities-Contributing to low level design of the components.-

  • Build the code, automated unit testing using Junit or similar framework.

  • Contribute to design and code reviews.

  • Contribute to implementation deployment plans.

  • Assist business with user acceptance testing.

  • Triage the defects and provide fixes. Java, Spark, Scala, SQL, Big Data RE-SOURCE FOR Senior Data Engineer Must-have · Experience with SQL Server Back-End devel-opment including: SQL Scripts, Stored-Procedures, Dynamic Stored-Procedures·

  • Experience devel-opment Python scripts and libraries

  • Experience with Agile development, GitHub, SSMS, Dataiku

  • Experience working with databases such as SQL Server, HDFS

  • Experience with DBMS Data Model-ling, ERD, Data Pipelines and DQ rules Implementation

  • Experience to Implement complex logic from Business Requirements using both SQL Stored Procedures and/or Python

  • Experience to produce Architecture Design and Technical documents for all Layers such as Front-End UI, API End Points, and Back-End Stored Procedures.

  • Nice-to-have Experience ETL Workflow and Python/SQL and Dataiku Rec-ipes using Dataiku Platform

  • Experience designing front-end solutions with , OpenShift, API End-Points (APIGEE)

  • Experience with HR systems & workflow management tools such as Workday, SAP, Ser-viceNow

  • Experience developing Tableau Dashboard and reusable Work Books.

  • Good knowledge of API Endpoints development using Python Language

Job Types: Full-time, Fixed term contract

Work Location: Hybrid remote in Toronto, ON


  • Big Data Developer

    4 days ago


    Toronto, Ontario, Canada Triton Digital Full time $120,000 - $180,000 per year

    We are open to candidates in Ontario or Quebec.Are you passionate about new technologies and looking to be part of a software development team that is constantly striving for innovation in a warm, relaxed, and stimulating environment?We are looking for aBig Data Developer / Machine Learning Engineerto join our "Audience" team.Our success depends on our...


  • Toronto, Ontario, Canada Vybog Full time $120,000 - $180,000 per year

    OverviewAre you interested in building the next-generation platform that handlespetabytes of dataand powersdata insight creationusing cutting-edgedata science technologies?Are you excited about leveragingBig Data,AI / Machine Learning, andData Analyticsto deliver actionable insights?We are adynamic team of top-notch engineersdedicated to making a dent in...


  • Toronto, Ontario, Canada NTT DATA Full time $80,000 - $120,000 per year

    NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Senior Quality Engineer - Remote to join our team in Toronto, Ontario (CA-ON), Canada (CA). Job Description:Senior Quality Engineer...


  • Toronto, Ontario, Canada CISPL Full time $110,000 - $135,000 per year

    Big Data Platform EngineerPosition OverviewWe are looking for someone armed with a strong tool-kit to develop and maintain technical solutions that adhere to engineering and architectural design principles while meeting business requirements. You'll be a technology owner providing technical expertise with a focus on efficiency, reliability, scalability, and...

  • Big Data Developer

    7 days ago


    Toronto, Ontario, Canada fc71e8c5-deda-48e9-b38c-23c0611c543b Full time $70,000 - $120,000 per year

    Job OverviewWe are seeking a dynamic and innovative Big Data Developer to join our data engineering team. In this role, you will harness the power of large-scale data processing and analytics to drive strategic insights and support business growth. Your expertise in big data technologies, cloud platforms, and data integration will be crucial in designing,...


  • Toronto, Ontario, Canada Data SEA Consulting Full time $60,000 - $80,000 per year

    Data SEA Consulting - Associate Co-op – Data Analytics & EngineeringCompany DescriptionAt Data SEA Consulting, we help mid-sized businesses unlock the power of their data. Our clients — from private equity funds to independent business owners — rely on us to design and implement modern analytics solutions that drive measurable value. We develop...


  • Toronto, Ontario, Canada Data Theorem Full time $120,000 - $180,000 per year

    RemoteFull TimeExperiencedData Theorem is an exciting company focused on creating a more secure world for data. Rooted in a strong engineer first culture, every employee has an impact on product and direction. We are searching for exceptional talent pursuing an opportunity to grow and take ownership of the projects that resonate most with them.As a Senior...


  • Toronto, Ontario, Canada Data Theorem Full time $80,000 - $140,000 per year

    Data Theorem is an exciting company focused on creating a more secure world for data. Rooted in a strong engineer first culture, every employee has an impact on product and direction. We are searching for exceptional talent pursuing an opportunity to grow and take ownership of the projects that resonate most with them.As a Senior Frontend Engineer, you will...


  • Toronto, Ontario, Canada Professional Staffing Full time $120,000 - $180,000 per year

    Position Title: Senior Data EngineerLocation:Downtown Toronto, Ontario, Canada (On-site, 5 Days In-Office)Position Type:Full-time (Contract)About the CompanyJoin a fast-growing Private Equity Firm at the forefront of innovation in specialized financing solutions Our client is a dynamic, fast-paced organization managing a significant portfolio of assets under...


  • Toronto, Ontario, Canada Data Intellect Full time $120,000 - $180,000 per year

    Company DescriptionAt Data Intellect it has never been just about data or technology, they are our tools. It's about human intellect, collaboration and providing solutions for the most complex of challenges.We do this by living the [DI] code:We are Problem Solvers who are Humble, possess a Can-do Attitude with a focus on Togetherness."We are not big on egos,...