Bigdata Platform Infrastructure engineer

3 weeks ago


Toronto, Canada Themesoft Inc. Full time

Position : Bigdata Platform Infrastructure engineer

Location : Toronto – Hybrid


Job Description:


Candidate will be responsible for admin, monitoring and maintaining the Bigdata platform and infrastructure, Hadoop clusters, configuration management etc.


  • Proficient operating Cloudera/Hortonworks Hadoop, HDFS/HBase/Yarn/Ranger/Spark/ZK, Ambari, Dremio, Druid, Airflow
  • A strong grasp of fundamental concepts of Linux (Redhat), data engineering, network, warehouses, operational databases, messaging, and data management
  • Good knowledge with Azure Databricks, Azure Data Factory, ADLS.
  • Working knowledge of data migration from HDFS to ADLS using ADF.
  • Experience with configuration management tools such as Salt, Ansible.
  • Strong scripting skills with experience of platform automation using python/bash with version control system Git/Bitbucket


Regards

Patrick Fernandez

Strategic Recruitment Manager - Talent Acquisition Group



  • Toronto, Canada Themesoft Inc. Full time

    Position: Bigdata Platform Infrastructure engineerLocation: Toronto – HybridJob Description:Proficient operating Cloudera/Hortonworks Hadoop, HDFS/HBase/Yarn/Ranger/Spark/ZK, Ambari, Dremio, Druid, AirflowA strong grasp of fundamental concepts of Linux (Redhat), data engineering, network, warehouses, operational databases, messaging, and data...


  • Toronto, Canada Themesoft Inc. Full time

    Position : Bigdata Platform Infrastructure engineer Location : Toronto – Hybrid Job Description: Proficient operating Cloudera/Hortonworks Hadoop, HDFS/HBase/Yarn/Ranger/Spark/ZK, Ambari, Dremio, Druid, Airflow A strong grasp of fundamental concepts of Linux (Redhat), data engineering, network, warehouses, operational databases, messaging, and data...


  • Toronto, Canada Themesoft Inc. Full time

    Position: Bigdata Platform Infrastructure engineerLocation: Toronto – HybridJob Description:Proficient operating Cloudera/Hortonworks Hadoop, HDFS/HBase/Yarn/Ranger/Spark/ZK, Ambari, Dremio, Druid, AirflowA strong grasp of fundamental concepts of Linux (Redhat), data engineering, network, warehouses, operational databases, messaging, and data...

  • Platform Engineer

    1 week ago


    Toronto, Ontario, Canada State Street Full time

    Who we are looking forAs a key member for the Platform engineering team part of Data Services platform; you will be responsible to drive automation in the platform. We are looking for an engineering focused and experienced Engineer with strong grounding on Public cloud concepts preferably Azure (any other Cloud vendor is a plus), principles, Infrastructure...

  • Platform Engineer

    1 week ago


    Toronto, Canada State Street Full time

    Who we are looking forAs a key member for the Platform engineering team part of Data Services platform; you will be responsible to drive automation in the platform. We are looking for an engineering focused and experienced Engineer with strong grounding on Public cloud concepts preferably Azure (any other Cloud vendor is a plus), principles, Infrastructure...

  • Platform Engineer

    3 weeks ago


    Toronto, Canada Unreal Gigs Full time

    About UsWe're revolutionizing the way analysts evaluate and act on deals by simplifying the review process for potential opportunities. Through cutting-edge language models, we provide a platform that not only organizes information but also offers comparative insights against existing portfolios and industry benchmarks. With our vision to automate various...

  • Platform Engineer

    2 weeks ago


    Toronto, Canada Unreal Gigs Full time

    About UsWe're revolutionizing the way analysts evaluate and act on deals by simplifying the review process for potential opportunities. Through cutting-edge language models, we provide a platform that not only organizes information but also offers comparative insights against existing portfolios and industry benchmarks. With our vision to automate various...


  • Toronto, Canada Themesoft Inc. Full time

    Position : Big Data Engineer Location : Toronto – Hybrid Job Description : Must have Spark, Hadoop, Hbase, Kafka, Yarn, Airflow, Cloud Good to have (Dynatrace, Splunk, DB/unix), Nice to have (Dremio else equivalent experience of working in Databricks) Good knowledge with Azure Databricks, Azure Data Factory, ADLS Admin, monitoring the Bigdata platform and...


  • Toronto, Canada Themesoft Inc. Full time

    Position: Big Data EngineerLocation: Toronto – HybridJob Description:Must have Spark, Hadoop, Hbase, Kafka, Yarn, Airflow, CloudGood to have (Dynatrace, Splunk, DB/unix),Nice to have (Dremio else equivalent experience of working in Databricks)Good knowledge with Azure Databricks, Azure Data Factory, ADLSAdmin, monitoring the Bigdata platform and...


  • Toronto, Canada Themesoft Inc. Full time

    Position: Big Data EngineerLocation: Toronto – HybridJob Description:Must have Spark, Hadoop, Hbase, Kafka, Yarn, Airflow, CloudGood to have (Dynatrace, Splunk, DB/unix),Nice to have (Dremio else equivalent experience of working in Databricks)Good knowledge with Azure Databricks, Azure Data Factory, ADLSAdmin, monitoring the Bigdata platform and...


  • Toronto, Canada Guidepoint Full time

    :   Guidepoint’s Engineering team thrives on problem solving and creating happier users. As Guidepoint works to achieve its mission of making individuals, businesses, and the world smarter through personalized knowledge-sharing solutions, the engineering team is taking on challenges to improve our internal CRM system and create new products to optimize...

  • Big Data Developer

    1 week ago


    Toronto, Canada Hays Full time

    Job Title: Sr. Bigdata DeveloperRate: 50-60 CAD/HourJob Overview: We are seeking a highly skilled Sr. Bigdata Developer to join our team. As a Sr. Bigdata Developer, you will be responsible for developing and maintaining our big data infrastructure, including Spark, Scala, Hive, Hadoop, SQL, and UNIX. You will work closely with our team of data scientists...

  • Big Data Developer

    1 week ago


    Toronto, Canada Hays Full time

    Job Title: Sr. Bigdata DeveloperRate: 50-60 CAD/HourJob Overview: We are seeking a highly skilled Sr. Bigdata Developer to join our team. As a Sr. Bigdata Developer, you will be responsible for developing and maintaining our big data infrastructure, including Spark, Scala, Hive, Hadoop, SQL, and UNIX. You will work closely with our team of data scientists...

  • Big Data Developer

    7 days ago


    Toronto, Canada Hays Full time

    Job Title: Sr. Bigdata Developer Rate: 50-60 CAD/Hour Job Overview: We are seeking a highly skilled Sr. Bigdata Developer to join our team. As a Sr. Bigdata Developer, you will be responsible for developing and maintaining our big data infrastructure, including Spark, Scala, Hive, Hadoop, SQL, and UNIX. You will work closely with our team of data...


  • Toronto, Canada Themesoft Inc. Full time

    Position: Big Data EngineerLocation: Toronto – HybridJob Description:Must have Spark, Hadoop, Hbase, Kafka, Yarn, Airflow, CloudGood to have (Dynatrace, Splunk, DB/unix),Nice to have (Dremio else equivalent experience of working in Databricks)Good knowledge with Azure Databricks, Azure Data Factory, ADLSAdmin, monitoring the Bigdata platform and...


  • Toronto, Canada Themesoft Inc. Full time

    Position: Big Data EngineerLocation: Toronto – HybridJob Description:Must have Spark, Hadoop, Hbase, Kafka, Yarn, Airflow, CloudGood to have (Dynatrace, Splunk, DB/unix),Nice to have (Dremio else equivalent experience of working in Databricks)Good knowledge with Azure Databricks, Azure Data Factory, ADLSAdmin, monitoring the Bigdata platform and...


  • Old Toronto, Canada Philip Morris International Full time

    MAKE HISTORY WITH US! At PMI, we’ve chosen to do something incredible. We’re totally transforming our business and building our future on one clear purpose – to deliver a smoke-free future. With huge change, comes huge opportunity. So, wherever you join us, you’ll enjoy the freedom to dream up and deliver better, brighter solutions and the space to...


  • Old Toronto, Canada Philip Morris International Full time

    MAKE HISTORY WITH US! At PMI, we’ve chosen to do something incredible. We’re totally transforming our business and building our future on one clear purpose – to deliver a smoke-free future. With huge change, comes huge opportunity. So, wherever you join us, you’ll enjoy the freedom to dream up and deliver better, brighter solutions and the space to...


  • Old Toronto, Canada Philip Morris International Full time

    MAKE HISTORY WITH US! At PMI, we’ve chosen to do something incredible. We’re totally transforming our business and building our future on one clear purpose – to deliver a smoke-free future. With huge change, comes huge opportunity. So, wherever you join us, you’ll enjoy the freedom to dream up and deliver better, brighter solutions and the space to...


  • Old Toronto, Canada Philip Morris International Full time

    MAKE HISTORY WITH US! At PMI, we’ve chosen to do something incredible. We’re totally transforming our business and building our future on one clear purpose – to deliver a smoke-free future. With huge change, comes huge opportunity. So, wherever you join us, you’ll enjoy the freedom to dream up and deliver better, brighter solutions and the space to...