Big Data Engineer

1 week ago

Toronto, Canada Teranet Inc. Full time

Big Data Engineer (Contract - 1 year)



Who We Are



Teranet is Canada’s leader in the delivery and transformation of statutory registry services with extensive expertise in land and commercial registries. We also market insightful property and data solutions, as well as practice management automation to thousands of customers in the real estate, financial services, government, utilities, and legal markets.



To learn more about who we are visit our website: www.teranet.ca



About the Role



Teranet is seeking an experienced Contract Big Data Engineer for its Data Analytics team. In this role, you will be working in collaboration with data product owners, data analysts and other data engineers to design, create/modify data pipelines and data models for data delivery, AI development, and BI data insight visualizations. You will be responsible for configuring tooling and frameworks that support data ingestion from various databases (Oracle, MS SQL server, PostgreSQL), testing to ensure the accuracy and quality of data ingestion and data pipeline input/output as well as the curation of data so that it is available to support various use cases. You will also collaborate with Teranet’s various infrastructure teams to ensure proper data access controls are in place, data is properly secured, and access activities are auditable.



What You’ll Be Doing



  • Participate in planning with business product owners, data analysts and identify tasks for the data analytics team.
  • Design and develop programs for setting up data pipelines, curate data for the enterprise-wide usage, prepare data models for specific use case.
  • Develop test objectives, test plan and success criteria (connectivity, data replication, auto fail-over, peak load performance etc.).
  • Work with infrastructure, security, and networking teams to ensure connectivity requirements are met for data pipelines sources and targets.
  • Tuning of data ingestion and replication to meet performance targets.
  • Configure the CDC framework as required to create daily/weekly/monthly data snapshots within acceptable performance targets.
  • Design and implement technology best practices, guidelines, and repeatable processes. Create design, test plan, and confluence documentation.
  • Able to self-direct, prioritize and perform assignments with minimum supervision



About You



  • 5+ years of experience with Hadoop, Hive, Spark, Python, Bash, Linux
  • Deep Hive/Spark/SQL knowledge, development, and testing experience
  • Expert Python/Spark/Shell development and coding best practices skills
  • Extensive experience in developing ETLs and processing large datasets
  • Experience with Airflow data pipeline implementation
  • Excellent day-to-day working knowledge of Git with exposure to Azure DevOps
  • Experience building data models to support BI data visualizations using Tableau
  • Knowledge of CDC based data ingestion setup, preferably using HVR
  • Familiarity with AWS services such as S3, EKS, and Kubectl is highly beneficial
  • Experience with Terraform, and CI/CD tools is a plus
  • Excellent written and verbal communication skills




Why Teranet



We are an innovator in electronic registry services and solutions who operate advanced and secure registration systems globally.But we’re so much more than that



Our Extraordinary People.

Together, we are passionate, driven, resourceful, and authentic.



Growth Opportunities.

We not only encourage a culture of openly talking about our career aspirations but one where we truly invest in the continuous learning, development, and growth of our people.



Our Work Environment.

We believe in cultivating a work environment that makes our people feel comfortable, engaged, appreciated, and happy.



Company Culture & Core Values

Our company culture and core values are the core of our identity. They define who we are, how we engage with each other and our clients, and how we conduct business every day.



At Teranet, we are committed to fostering an inclusive, accessible environment, where all employees and customers feel valued, respected, and supported. We are dedicated to building a workforce that reflects the diversity of our customers and the communities in which we live and serve. If you require accommodation during the recruitment and selection process, please let us know and we will work with you to meet your needs.



Come As You Are. We Like You that Way

  • Big Data Engineer

    1 day ago

    Toronto, Canada Tata Consultancy Services Full time

    About the RoleWe are seeking a highly skilled Big Data Engineer to join our team. As a Data Engineer, you will play a critical role in designing and building scalable data streaming platforms and warehouses that serve as the foundation for our products.Key Responsibilities:Collaborate with the development team to design and implement data streaming platforms...

  • Senior Data Engineer: Driving Business Growth with Data Insights

    4 weeks ago

    Old Toronto, Canada Data Engineer Jobs Full time

    As a Senior Data Engineer at Mozilla, you will play a pivotal role in shaping the company's data strategy and driving business growth through informed decision-making.About the RoleWe are seeking an experienced data engineer to join our Analytics Engineering team. In this role, you will work closely with data scientists to design and implement scalable data...

  • Big Data Architect

    3 weeks ago

    Toronto, Ontario, Canada Astra North Infoteck Inc. Full time

    Job Description for Big Data LeadOverviewAstra North Infoteck Inc. is seeking an experienced Big Data Lead to lead our team in designing and implementing cutting-edge big data solutions. The ideal candidate will have a strong background in data quality, architecture, and engineering, with experience in leading teams and driving results.Key...

  • Big Data Solutions Engineer

    5 days ago

    Toronto, Canada Tata Consultancy Services Full time

    About the RoleWe are seeking a highly skilled Big Data Solutions Engineer to join our team at Tata Consultancy Services. As a key member of our Big Data practice, you will be responsible for designing and developing high-quality deliverables that meet business requirements.The ideal candidate will have hands-on experience with programming languages such as...

  • Senior Big Data Engineer

    3 days ago

    Toronto, Canada Tata Consultancy Services Full time

    About the Role: As a Senior Big Data Engineer at Tata Consultancy Services, you will play a critical part in designing and implementing end-to-end data solutions on Databricks. With our cutting-edge platform and expertise in cloud-based technologies, you will work closely with cross-functional teams to deliver high-quality data pipelines, ensuring...

  • Big Data Engineer

    7 days ago

    Toronto, Ontario, Canada Teranet Inc. Full time

    Job Title: Big Data Engineer - Data ArchitectWe are seeking an experienced Contract Big Data Engineer to join our Data Analytics team at Teranet Inc. in Canada.About the Role:This is a contract position, with a duration of 1 year. As a Big Data Engineer - Data Architect, you will work collaboratively with data product owners, data analysts, and other data...

  • Lead Data Architect in Big Data Engineering

    4 weeks ago

    Toronto, Ontario, Canada Royal Bank of Canada Full time

    Job OverviewRoyal Bank of Canada (RBC) is a leading Canadian bank seeking an experienced Manager, Data Engineering to join its Canadian Banking Operations Data and Analytics Center of Excellence. This role offers the opportunity to lead the development and maintenance of automated data pipelines and infrastructure.About the RoleWe are looking for a skilled...

  • Data Engineer with Expertise in Cloud and Big Data

    3 weeks ago

    Toronto, Ontario, Canada Astra North Infoteck Inc. Full time

    Job Title: Data Engineer with Expertise in Cloud and Big DataAstra North Infoteck Inc. is seeking an experienced Data Engineer to lead the development of our big data solutions.We are offering a competitive salary of $140,000 - $180,000 per year, depending on experience and qualifications.About the Role:We are looking for a skilled engineer who can design,...

  • Senior Data Engineer

    1 week ago

    Toronto, Ontario, Canada Royal Bank of Canada Full time

    About the OpportunityRoyal Bank of Canada is seeking an experienced Senior Data Engineer to join our Financial Crime Technologies team in Toronto. This is a full-time position with a salary of approximately $145,000 per year.Job DescriptionWe are looking for a skilled data engineer to lead the development of high-performing applications built on cloud...

  • Big Data Engineer for Cloud Platforms

    5 days ago

    Toronto, Canada Tata Consultancy Services Full time

    Tata Consultancy Services, a leading IT services company, is seeking an experienced Big Data Engineer to join our team in Canada.As a key member of our data engineering team, you will design, develop, and deploy scalable data pipelines using Databricks, leveraging your expertise in cloud platforms (Azure, AWS, or GCP) and Apache Spark.With a strong focus on...

  • Big Data Engineer for Petabyte Scale Systems

    3 weeks ago

    Toronto, Ontario, Canada Amazon Development Centre Canada ULC Full time

    Discover a rewarding opportunity as a Big Data Engineer at Amazon Development Centre Canada ULC. We are seeking an experienced software engineer to join our team and contribute to building the next generation of our Traffic Ingestion and Application platform.About the RoleThis position involves designing and developing software products that provide...

  • Big Data Specialist

    6 days ago

    Toronto, Canada Infotek Consulting Services Inc. Full time

    At Infotek Consulting Services Inc., we are seeking an experienced Data Engineer to work on a key initiative for US Fed Liquidity Remediation. This role is part of our Big Data/Java team.Key Responsibilities:Design and implement scalable data processing systems using Java and Big Data technologiesCollaborate with the development team to develop and maintain...

  • M Mozilla Senior Data Engineer

    2 months ago

    Old Toronto, Canada Data Engineer Jobs Full time

    To learn the Hiring Ranges for this position, please select your location from the Apply Now dropdown menu.The Mozilla Corporation is wholly owned by the non-profit 501(c) Mozilla Foundation. This means we aren't beholden to any shareholders --- only to our mission. Along with thousands of volunteer contributors and collaborators all over the world,...

  • Big Data Solutions Architect

    7 days ago

    Toronto, Ontario, Canada First Derivative Full time

    Capital Markets Big Data Engineer OpportunityWe are seeking a highly skilled Big Data Engineer to join our team at First Derivative, the world's largest Capital Markets dedicated consultancy. As a Big Data Engineer, you will have the opportunity to work on mission-critical projects, collaborate with experienced professionals, and contribute to the...

  • Big Data Engineer

    6 months ago

    Toronto, Canada TSX Inc. Full time

    Venture outside the ordinary - TMX Careers The TMX group of companies includes leading global exchanges such as the Toronto Stock Exchange, Montreal Exchange, and numerous innovative organizations enhancing capital markets. United as a global team, we’re connecting cross-functionally, traversing industries and geographies, moving opportunity into...

  • Big Data Engineer

    1 week ago

    Toronto, ON, Canada Teranet Inc. Full time

    Big Data Engineer (Contract - 1 year) Who We Are Teranet is Canada’s leader in the delivery and transformation of statutory registry services with extensive expertise in land and commercial registries. We also market insightful property and data solutions, as well as practice management automation to thousands of customers in the real estate, financial...

  • Big Data Engineer

    1 week ago

    Toronto, ON, Canada Teranet Inc. Full time

    Big Data Engineer (Contract - 1 year) Who We Are Teranet is Canada’s leader in the delivery and transformation of statutory registry services with extensive expertise in land and commercial registries. We also market insightful property and data solutions, as well as practice management automation to thousands of customers in the real estate, financial...

  • Senior Big Data Developer

    5 days ago

    Toronto, Ontario, Canada CorGTA Full time

    Job Opportunity for a Data EngineerWe are currently looking for a highly skilled Data Engineer to work with one of our Toronto-based Fortune 1000 clients on a hybrid remote contract basis.About the Role:The successful candidate will have extensive experience as a Data Engineer, with a strong background in working with Python, DBT, and Big Query. Experience...

  • Data Engineer Lead

    2 weeks ago

    Toronto, Ontario, Canada Royal Bank of Canada Full time

    Company OverviewRoyal Bank of Canada is a leading financial institution seeking an experienced Data Engineer to join its US Cash Management Technology team. This role offers a unique opportunity to build and enhance market-leading data capabilities using Azure Big Data technologies.

  • Data Architect for Big Data Engineering

    1 week ago

    Toronto, Ontario, Canada Teranet Inc. Full time

    Teranet Inc. is Canada's leader in the delivery and transformation of statutory registry services.We are an innovator in electronic registry services and solutions who operate advanced and secure registration systems globally.We are seeking a highly experienced Contract Big Data Engineer to join our Data Analytics team.In this role, you will work...