Senior Big Data Engineer and DevOps Expert

14 hours ago


Mississauga, Ontario, Canada Galactic Minds INC Full time

Job Overview:

Galactic Minds INC is seeking a highly skilled Senior Big Data Engineer and DevOps Expert to join our team.

Salary: The estimated salary for this role is $140,000 - $160,000 per year, depending on experience and location.

Job Description:

We are looking for a seasoned professional with expertise in big data technologies, including Hadoop, Spark, Snowflake, and cloud platforms such as AWS or Google Cloud. The ideal candidate will have a strong background in software engineering, data analytics, and DevOps practices.

Key Responsibilities:

  • Design, develop, and implement large-scale big data solutions using Hadoop, Spark, and other related technologies.
  • Work closely with cross-functional teams to ensure seamless integration of data engineering efforts with business requirements.
  • Collaborate with data scientists to develop and deploy machine learning models using Python/Pyspark/Scala.
  • Implement containerization and DevOps practices using Docker, Kubernetes, and CI/CD tools.
  • Ensure high-quality code and adherence to software engineering principles.
  • Stay up-to-date with industry trends and emerging technologies in big data and cloud computing.

Requirements:

  • 8+ years of experience in big data technologies, including Hadoop, Spark, and Snowflake.
  • 3+ years of experience in Spark and related technologies.
  • 2+ years' experience in Snowflake and related technologies.
  • 2+ years of experience working on Google or AWS cloud developing data solutions.
  • Hands-on experience with Python/Pyspark/Scala and basic libraries for machine learning.
  • Experience with containerization and related technologies (e.g., Docker, Kubernetes).
  • Experience with all aspects of DevOps (source control, continuous integration, deployments, etc.).
  • 1 year Hadoop administration experience preferred.
  • 1+ year of SAS experience preferred.
  • Comprehensive knowledge of the principles of software engineering and data analytics.
  • Advanced knowledge of the Hadoop ecosystem and Big Data technologies.
  • Knowledge of agile (Scrum) development methodology is a plus.
  • Strong development/automation skills.
  • Proficient in programming in Java or Python with prior Apache Beam/Spark experience a plus.
  • System level understanding - Data structures, algorithms, distributed storage & compute.
  • Can-do attitude on solving complex business problems, good interpersonal and teamwork skills.

Benefits:

  • Competitive salary range ($140,000 - $160,000 per year)
  • Opportunities for career growth and professional development
  • Collaborative and dynamic work environment
  • Recognition and rewards for outstanding performance


  • Mississauga, Ontario, Canada Open Systems Technologies Full time

    Job Title: Senior Big Data EngineerWe are seeking a highly skilled Senior Big Data Engineer to join our team at Open Systems Technologies. The ideal candidate will have extensive experience in big data development using Python and PySpark, with a strong focus on building and optimizing large-scale data processing applications.The successful candidate will...


  • Mississauga, Ontario, Canada Droisys Full time

    Company OverviewDroisys is a cutting-edge technology company dedicated to empowering businesses to accelerate their digital transformation initiatives. By leveraging our deep technical expertise and Agile methodologies, we help organizations modernize their systems of engagement and simplify human-technology interaction.Estimated Salary: $130 CAD per annum +...


  • Mississauga, Ontario, Canada Themesoft Inc. Full time

    **Job Title:** Data Engineering Expert - Cloud Architect**Location:** Mississauga, ON (Locals Only)**Estimated Salary:** CAD 130,000 + BenefitsWe are seeking a highly skilled Data Engineering Expert - Cloud Architect to join our team at Themesoft Inc. in Mississauga, ON. As a key member of our data engineering team, you will be responsible for designing and...


  • Mississauga, Ontario, Canada Droisys Full time

    We are seeking a highly skilled Data Engineering Expert to join our team at Droisys, a leading innovation technology company. As a Senior Big Data Engineer, you will play a key role in designing and developing Big data solutions using Hadoop or Snowflake.Key Responsibilities:Partner with domain experts, product managers, analysts, and data scientists to...

  • Big Data Engineer

    3 weeks ago


    Mississauga, Ontario, Canada Dexian Full time

    Job Title:Big Data EngineerAbout the Role:We are seeking an experienced Big Data Engineer to join our team in Mississauga, ON. The successful candidate will have a strong background in building and optimizing large-scale data processing applications.Key Responsibilities:Design, develop, and optimize large-scale data processing applications using...


  • Mississauga, Ontario, Canada Dexian Full time

    Job Overview: We are seeking a highly skilled Senior Big Data Engineer to join our team at Dexian, a leading provider of staffing, IT, and workforce solutions. As a key member of our data engineering team, you will be responsible for designing, developing, and deploying large-scale big data processing applications using PySpark and the Spark ecosystem.


  • Mississauga, Ontario, Canada Open Systems Technologies Full time

    Job SummaryWe are seeking a highly skilled Big Data Developer to join our team at Open Systems Technologies. This is a 12-month contract with the possibility of extension.About UsOpen Systems Technologies is a leading provider of IT solutions and services. Our mission is to deliver cutting-edge technology that drives business growth and success.The RoleThis...


  • Mississauga, Ontario, Canada Galactic Minds INC Full time

    At Galactic Minds INC, we are seeking an experienced Data Engineer to lead our big data initiatives. As a key member of our team, you will design, develop, and deploy scalable data processing systems using technologies like Hadoop, Spark, and Snowflake.The ideal candidate should have a strong background in data engineering with at least 8 years of experience...


  • Mississauga, Ontario, Canada Synechron Full time

    About SynechronSynechron is a global consulting firm that combines creativity and innovative technology to deliver industry-leading digital solutions. Our progressive technologies and optimization strategies span end-to-end Artificial Intelligence, Consulting, Digital, Cloud & DevOps, Data, and Software Engineering, servicing an array of noteworthy financial...


  • Mississauga, Ontario, Canada Dexian Full time

    Job OverviewWe are seeking a highly skilled Senior Data Engineering Specialist to join our team at Dexian. This role will involve designing and implementing large-scale data processing applications using PySpark.About the RoleThis is a 12+ month contract with possible extension, located in Mississauga, ON. As a Senior Data Engineering Specialist, you will be...


  • Mississauga, Ontario, Canada Synechron Full time

    About SynechronEstablished in 2001, Synechron is a global digital consulting firm with a strong foundation in the financial services industry. With over 14,700 employees across 58 offices in 21 countries, our organization has grown significantly while maintaining its core values.We offer a wide range of services, including Consulting, Data, Digital, Cloud &...


  • Mississauga, Ontario, Canada Synechron Full time

    Role OverviewSynechron is seeking an experienced Big Data Engineer to join our team in Mississauga, ON / Montreal, QC. The ideal candidate will design, implement and optimize large-scale data pipelines using Databricks.


  • Mississauga, Ontario, Canada Dexian Full time

    About the Role: We are seeking a highly skilled Senior Data Engineer to join our team in Mississauga, ON. As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining large-scale data processing applications using PySpark.Job Summary:Design, develop, and deploy scalable big data processing applications...


  • Mississauga, Ontario, Canada F. Hoffmann-La Roche Gruppe Full time

    Job OverviewWe are seeking a Senior DevOps Engineer to join our team in Mississauga, Ontario. This role will involve collaborating with developers, product owners, and other DevOps team members to design and deploy algorithms on various environments.


  • Mississauga, Ontario, Canada KUBRA Data Transfer Ltd Full time

    Our company, KUBRA Data Transfer Ltd, is seeking a seasoned Product Engineering Senior Manager to spearhead the development of our diverse product portfolio. This pivotal role involves leading cross-functional software engineering teams, working closely with Product Managers, and managing other Engineering Managers. The ideal candidate will excel in...

  • Big Data Engineer

    4 weeks ago


    Mississauga, Ontario, Canada IT Connex Full time

    About the JobWe are seeking an experienced Big Data engineer for a financial client who can leverage PySpark to design and optimize large-scale data processing systems.Key Requirements:6-8 years of experience in big data development using PySpark and Spark EcosystemExtensive experience with PySpark/Python programming languagesSolid understanding of Hadoop,...


  • Mississauga, Ontario, Canada IT Connex Full time

    About the Job Opportunity at IT ConnexWe are looking for a highly skilled Big Data Developer to join our team and contribute to building large-scale data processing systems for our financial clients.Key ResponsibilitiesDesign, develop, and optimize large-scale data processing systems using PySpark and the Spark ecosystemCollaborate with cross-functional...


  • Mississauga, Ontario, Canada Synechron Full time

    Company OverviewSynechron is a global consulting firm that combines creativity and innovative technology to deliver industry-leading digital solutions. Our progressive technologies and optimization strategies span end-to-end Artificial Intelligence, Consulting, Digital, Cloud & DevOps, Data, and Software Engineering, servicing an array of noteworthy...


  • Mississauga, Ontario, Canada KUBRA Data Transfer Ltd Full time

    We are seeking an experienced Site Reliability Engineer to join our team as a Senior Technical Operations Manager at KUBRA Data Transfer Ltd.As a seasoned professional with a passion for enhancing platform stability, reliability, and efficiency, you will guide our DevOps team in optimizing our customer experience management platforms.The ideal candidate...


  • Mississauga, Ontario, Canada Synechron Full time

    At Synechron, we harness the power of digital to transform businesses for the better. Our global consulting firm combines creativity and innovative technology to deliver industry-leading digital solutions. We span end-to-end Artificial Intelligence, Consulting, Digital, Cloud & DevOps, Data, and Software Engineering, servicing a range of notable financial...