Big Data Developer

2 weeks ago

Mississauga Ontario, Peel region, Canada Hays Full time

Software Engineer - Big data

Salary: 100-110 CAD


Job Description


Your new company

Our client, a leading global chemistry company across US, Canada, Asia and Europe, is going through a Digital Transformation. They are building a Digital Hub for the global business in Toronto city, therefore we are hiring multiple technology talents with ambition to join the digital hub. Our client has earned various awards, including being recognized by Mediacorp as a Top Employer in Canada and the GTA in 2023, and for many consecutive years prior. Most recently, our client was thrilled to receive two awards for the first time – Forbes 2022 Canada’s Best Employers for Diversity as well as one of Canada’s Top Employers for Young People in 2023.


Your new role


  • Designing, implementing and maintaining data distribution strategies using Unity Catalog with Azure Databricks and Azure Data Factory.
  • Maintaining and monitoring data distribution across various platforms and systems with Azure Data Factory.
  • Developing, extending and optimizing our data distribution pipeline.
  • Implementing quality control measures to ensure accuracy and consistency of data.
  • Collaborating with the data science team to understand their data needs and provide suitable solutions.
  • Troubleshooting data-related issues and optimize data distribution for performance and scalability.
  • Developing and maintaining technical documentation related to data distribution processes.
  • Testing new features and improvements in Unity Catalog, Azure Databricks, Azure Data Factory and suggest their implementation if beneficial.


What you'll need to succeed

A Bachelor´s degree in computer science, Information Technology, Engineering, Business, or related fields.

  • Minimum 3-4 years related working experience as DataOps Engineer using Azure, Python, Azure Data Factory and Databricks.
  • Experience in Agile way of working with a DevOps mindset.
  • Strong knowledge in automation & scripting with tools like Azure DevOps pipelines, Azure Data Factory, etc.
  • In-depth know how with Big Data concepts and Databricks.
  • Strong software engineering and development skills to maintain and extend our Data Distribution Pipeline.
  • Knowledge on Unity Catalog for Data Distribution through Databricks.
  • Experience with event streaming, message brokers and other event driven architectures (Kafka, RabbitMQ, etc.) and familiarity with Big Data concepts.
  • Managing and operating solutions via command line utilities and working to improve automation and enlist modern practices (DevOps, CI/CD, Terraform ,etc.).
  • Integration knowledge between Data Catalog Collibra and Big Data Platforms.
  • Strong interpersonal, written, and verbal communication skills to effectively collaborate and convey technical information.


What you'll get in return

The total rewards that you receive as a employee go way beyond a paycheck. From competitive health and insurance plans to robust retirement benefits that include company-matching contributions, to making sure you never stop learning, they believe investing in you is investing in their success. Working for a large, global organization, you’ll have a chance to grow professionally and personally, expand your network and build a rewarding and dynamic career. They also provide engaging learning and development opportunities to help you make the most of your talents and your role.


What you need to do now

If you're interested in this role, forward an up-to-date copy of your CV in word document, or call us now.

If this job isn't quite right for you but you are looking for a new position, please contact us for a confidential discussion on your career

  • Big Data Consultant

    3 weeks ago

    Mississauga, Ontario, Peel region, Canada Nexus Systems Group Full time

    Big Data Consultant (LLM/AI)Our client is seeking an experienced Big Data Consultant for LLM/AI project. Required experience: - Experience hydrating an AWS Data Lake. - Proven hands’ on experience implementing Large Language Models (LLM). - Strong communication skills. - Experience with parsing and understanding code while language is not fixed – Python...

  • Java/Big Data Developer

    3 months ago

    Mississauga, Ontario, Peel region, Canada Synechron Full time

    Role: Java/Big Data DeveloperMississauga, ON (hybrid/3 days in a week) - Must Have:10+ years application development experience in Java and Spring Framework.5+ years application development experience in Hadoop, Spark and Java/Scala.5+ years in developing and optimizing Big Data applications using Java/Scala and Spark on Cloudera/HDP.Experience in...

  • Data Analyst

    3 weeks ago

    Mississauga, Ontario, Peel region, Canada Tata Consultancy Services Full time

    About TCS:Tata Consultancy Services is an IT services, consulting, and business solutions organization that has been partnering with many of the world’s largest businesses in their transformation journeys for over 55 years. Its consulting-led, cognitive powered portfolio of business, technology, and engineering services and solutions is delivered through...

  • Database Developer

    2 weeks ago

    Mississauga, Ontario, Peel region, Canada NexGen Tech Solutions Full time

    Position: Database Developer Location: Mississauga, ON (Hybrid)Experience: 5+ Years Type: Full time/C2H/ContractWe are seeking a skilled and detail-oriented Database Developer to help design, develop, and maintain our database systems. The ideal candidate will have extensive experience working with database management systems (DBMS), data modeling, and...

  • Data Architect

    2 months ago

    Mississauga, Ontario, Peel region, Canada Quantum Technology Recruiting Inc. Full time

    Position: Data ArchitectType: Fulltime Perm (Flexible Salary)Location: Hybrid (three days onsite per week, between the Mississauga and downtown Toronto office)You will be part of our Data Strategy and Engineering team to architect large scale data driven engagements and provide direction as the subject matter expert in Azure, AWS and SQL Server Data...

  • Data Engineer II

    3 weeks ago

    Brampton, Ontario, C6S, Peel region, Canada Loblaw Companies Ltd - Head Office Full time

    Referred applicants should not apply directly to this role.All referred applicants must first be submitted through Workday by a current Loblaw Colleague.Come make your difference in communities across Canada, where authenticity, trust and making connections is valued - as we shape the future of Canadian retail, together. Our unique position as one of the...

  • Data Engineer

    3 weeks ago

    Mississauga, Ontario, Peel region, Canada Synechron Full time

    Position : Data EngineerLocation : Mississauga, ONExperience : 8 plus yearsType : Hybrid (2-3 days from office)Job Description: We are seeking an experienced Data Engineer with a strong background in Snowflake and SQL to join our technology team. The ideal candidate will be responsible for developing, optimizing, and maintaining our Snowflake data warehouse...

  • Data Engineer

    3 months ago

    Mississauga, Ontario, Peel region, Canada Synechron Full time

    Role: Datawarehouse SpecialistLocation: Mississauga, ON ( 3 days Hybrid)Experience:8+yearsJob Type: FulltimeResponsibilities:Strong understanding or Snowflake on Azure Architecture, design, implementation and operationalization of large-scale data and analytics solutions on Snowflake Cloud Data Warehouse.Hands-on development experience with Snowflake...

  • Data Engineer II

    3 weeks ago

    Brampton, Ontario, C6S, Peel region, Canada Loblaw Companies Ltd - Head Office Full time

    Les candidats référés ne doivent pas postuler directement pour ce poste. Toutes les références de candidats doivent d’abord être soumises dans Workday par un collègue de Loblaw actuel.L’utilisation du masculin à pour but d’alléger le texteVenez faire votre différence dans les communautés à travers le Canada, où l'authenticité, la...

  • Senior Data Engineer

    2 weeks ago

    Mississauga, Ontario, Peel region, Canada RAPS Consulting Inc Full time

    Role: Senior Data Engineer We are seeking an experienced Data Engineer with a strong background in Snowflake and SQL to join our technology team. The ideal candidate will be responsible for developing, optimizing, and maintaining our Snowflake data warehouse environment to support financial data analysis and reporting needs. The role requires a deep...

  • Data Engineer

    3 weeks ago

    Mississauga, Ontario, Peel region, Canada Synechron Full time

    We areAt Synechron, we believe in the power of digital to transform businesses for the better. Our global consulting firm combines creativity and innovative technology to deliver industry-leading digital solutions. Synechron’s progressive technologies and optimization strategies span end-to-end Artificial Intelligence, Consulting, Digital, Cloud & DevOps,...

  • Data Engineer with Python

    3 months ago

    Mississauga, Ontario, Peel region, Canada Synechron Full time

    Role: Python Data Engineer(Databricks/Pyspark, SQL, Azure)Mississauga, ON (hybrid/3 days in a week)Overview:Looking for an Integration engineer responsible for daily support and project based development of credit risk management systems. ETL developers are responsible for designing and creating the data warehouse and all related extraction, transformation...

  • Azure Data Architect

    3 weeks ago

    Mississauga, Ontario, Peel region, Canada PEOPLE FORCE CONSULTING INC Full time

    Job Title : Data Architect - AzureLocation: Mississauga/Downtown Toronto (Onsite Hybrid -three days onsite per week)Duration : Full TimeMandatory skills:- AzureAzure Data LakeAzure Data BricksAzure Data FactoryData ArchitectData background- Data Modeler/Data engineerJob Description :-You will be part of our Data Strategy and Engineering team to architect...

  • Azure Data Architect

    2 weeks ago

    Mississauga, Ontario, Peel region, Canada PEOPLE FORCE CONSULTING INC Full time

    Job Title : Data Architect - AzureLocation: Mississauga/Downtown Toronto (Onsite Hybrid -three days onsite per week)Duration : Full TimeMandatory skills:-AzureSynapseAzure Data LakeAzure Data BricksAzure Data FactoryData ArchitectData background- Data Modeler/Data engineerJob Description :-You will be part of our Data Strategy and Engineering team to...

  • SQL Developer

    3 weeks ago

    Mississauga, Ontario, Peel region, Canada Synechron Full time

    We areAt Synechron, we believe in the power of digital to transform businesses for the better. Our global consulting firm combines creativity and innovative technology to deliver industry-leading digital solutions. Synechron’s progressive technologies and optimization strategies span end-to-end Artificial Intelligence, Consulting, Digital, Cloud & DevOps,...

  • SQL Developer

    3 weeks ago

    Mississauga, Ontario, Peel region, Canada Synechron Full time

    Our Challenge:We are looking for a Database Developer who will be responsible for creating, administering and troubleshooting computer databases that can process large amounts of information and keep it secure. Duties include using code and web architecture to design data systems, analyze and maintain existing databases and implement new user...

  • Senior BI Developer

    3 weeks ago

    Mississauga, Ontario, Peel region, Canada Synechron Full time

    Position : Senior BI DeveloperLocation : Mississauga, ON / Montreal, QCExperience : 8 plus yearsType : Hybrid (2-3 days from office)Synechron Inc. is seeking a BI Developer to join our team in Mississauga, ON / Montreal, QC.Additional Information* The base salary for this position will vary based on geography and other factors. In accordance with law, the...

  • Senior Database Developer

    3 weeks ago

    Mississauga, Ontario, Peel region, Canada Synechron Full time

    Responsibilities:Design, develop, and optimize complex SQL scripts, stored procedures, packages, and functions.Develop and maintain conceptual, logical, and physical data models that support business requirements and regulatory standards.Implement and manage data integration processes using cloud-based tools and services.Utilize your expertise in investment...

  • Senior Business Intelligence Developer

    3 weeks ago

    Mississauga, Ontario, Peel region, Canada Synechron Full time

    Job Summary:We are seeking a skilled BI Developer with a strong background in data warehousing, advanced SQL, and analytics to join our dynamic team. The ideal candidate will have hands-on experience with Snowflake integration, Python programming, and Power BI. Familiarity with API development, especially using PowerShell and REST APIs, is a plus. Experience...

  • ServiceNow Sr. developer

    2 weeks ago

    Mississauga, Ontario, Peel region, Canada HCLTech Full time

    Looking for a ServiceNow Developer join the team. Working Location: Toronto, OntarioJob Desciptions: Utilize your expertise in ServiceNow platform development to design, develop, and configure new modules, applications, and integrations with third-party systems.Strong knowledge in ServiceNow development using most of the ServiceNow tools and features such as...