Bigdata Platform Infrastructure engineer

1 month ago


Toronto, Canada Themesoft Inc. Full time

Position : Bigdata Platform Infrastructure engineer

Location : Toronto – Hybrid


Job Description:


  • Proficient operating Cloudera/Hortonworks Hadoop, HDFS/HBase/Yarn/Ranger/Spark/ZK, Ambari, Dremio, Druid, Airflow
  • A strong grasp of fundamental concepts of Linux (Redhat), data engineering, network, warehouses, operational databases, messaging, and data management
  • Good knowledge with Azure Databricks, Azure Data Factory, ADLS.
  • Working knowledge of data migration from HDFS to ADLS using ADF.
  • Experience with configuration management tools such as Salt, Ansible.
  • Strong scripting skills with experience of platform automation using python/bash with version control system Git/Bitbucket


Regards

Patrick Fernandez

Strategic Recruitment Manager - Talent Acquisition Group


  • Platform Engineer

    1 week ago


    Toronto, Ontario, Canada State Street Full time

    Who we are looking forAs a key member for the Platform engineering team part of Data Services platform; you will be responsible to drive automation in the platform. We are looking for an engineering focused and experienced Engineer with strong grounding on Public cloud concepts preferably Azure (any other Cloud vendor is a plus), principles, Infrastructure...

  • Platform Engineer

    1 month ago


    Toronto, Ontario, Canada State Street Full time

    Who we are looking forAs a key member for the Platform engineering team part of Data Services platform; you will be responsible to drive automation in the platform. We are looking for an engineering focused and experienced Engineer with strong grounding on Public cloud concepts preferably Azure (any other Cloud vendor is a plus), principles, Infrastructure...

  • Platform Engineer

    1 month ago


    Toronto, Canada State Street Full time

    Who we are looking forAs a key member for the Platform engineering team part of Data Services platform; you will be responsible to drive automation in the platform. We are looking for an engineering focused and experienced Engineer with strong grounding on Public cloud concepts preferably Azure (any other Cloud vendor is a plus), principles, Infrastructure...


  • Toronto, Canada Themesoft Inc. Full time

    Position : Big Data Engineer Location : Toronto – Hybrid Job Description : Must have Spark, Hadoop, Hbase, Kafka, Yarn, Airflow, Cloud Good to have (Dynatrace, Splunk, DB/unix), Nice to have (Dremio else equivalent experience of working in Databricks) Good knowledge with Azure Databricks, Azure Data Factory, ADLS Admin, monitoring the Bigdata platform...


  • Toronto, Canada Themesoft Inc. Full time

    Position : Big Data Engineer Location : Toronto – Hybrid Job Description : Must have Spark, Hadoop, Hbase, Kafka, Yarn, Airflow, Cloud Good to have (Dynatrace, Splunk, DB/unix), Nice to have (Dremio else equivalent experience of working in Databricks) Good knowledge with Azure Databricks, Azure Data Factory, ADLS Admin, monitoring the Bigdata...


  • Toronto, Canada Hopper Full time

    About the job We are looking for a senior Site Reliability Engineer to join the Platform Infrastructure team at Hopper. We manage a large infrastructure in Google Cloud that is used by hundreds of engineers worldwide to provide a first class experience to millions of end users around the world.If the traits described below sounds like you, this role might...


  • Toronto, Canada Hopper Full time

    About the job We are looking for a senior Site Reliability Engineer to join the Platform Infrastructure team at Hopper. We manage a large infrastructure in Google Cloud that is used by hundreds of engineers worldwide to provide a first class experience to millions of end users around the world.If the traits described below sounds like you, this role might...


  • Toronto, Canada Themesoft Inc. Full time

    Position : Big Data Engineer Location : Toronto – HybridJob Description :Must have Spark, Hadoop, Hbase, Kafka, Yarn, Airflow, Cloud Good to have (Dynatrace, Splunk, DB/unix), Nice to have (Dremio else equivalent experience of working in Databricks) Good knowledge with Azure Databricks, Azure Data Factory, ADLS Admin, monitoring the Bigdata platform and...


  • Toronto, Canada Themesoft Inc. Full time

    Position: Big Data EngineerLocation: Toronto – HybridJob Description:Must have Spark, Hadoop, Hbase, Kafka, Yarn, Airflow, Cloud Good to have (Dynatrace, Splunk, DB/unix), Nice to have (Dremio else equivalent experience of working in Databricks) Good knowledge with Azure Databricks, Azure Data Factory, ADLS Admin, monitoring the Bigdata platform and...

  • Platform Engineer

    1 month ago


    Toronto, Canada Unreal Gigs Full time

    About UsWe're revolutionizing the way analysts evaluate and act on deals by simplifying the review process for potential opportunities. Through cutting-edge language models, we provide a platform that not only organizes information but also offers comparative insights against existing portfolios and industry benchmarks. With our vision to automate various...

  • Platform Engineer

    1 week ago


    Toronto, Canada Unreal Gigs Full time

    About UsWe're revolutionizing the way analysts evaluate and act on deals by simplifying the review process for potential opportunities. Through cutting-edge language models, we provide a platform that not only organizes information but also offers comparative insights against existing portfolios and industry benchmarks. With our vision to automate various...

  • Platform Engineer

    1 week ago


    Toronto, Canada Unreal Gigs Full time

    About UsWe're revolutionizing the way analysts evaluate and act on deals by simplifying the review process for potential opportunities. Through cutting-edge language models, we provide a platform that not only organizes information but also offers comparative insights against existing portfolios and industry benchmarks. With our vision to automate various...

  • Platform Engineer

    1 month ago


    Toronto, Canada Unreal Gigs Full time

    About UsWe're revolutionizing the way analysts evaluate and act on deals by simplifying the review process for potential opportunities. Through cutting-edge language models, we provide a platform that not only organizes information but also offers comparative insights against existing portfolios and industry benchmarks. With our vision to automate various...


  • Toronto, Canada Apex Systems Full time

    Cloud Platform Engineer Apex Systems is a global IT services provider, and our staffing practice has an opening for an AWS Cloud Platform Engineer with a strong understanding of CDK as well as scripting, strong understanding of AWS cloud infrastructure, and solid Serverless Engineering expertise to


  • Toronto, Canada Themesoft Inc. Full time

    Position: Big Data EngineerLocation: Toronto – HybridJob Description:Must have Spark, Hadoop, Hbase, Kafka, Yarn, Airflow, CloudGood to have (Dynatrace, Splunk, DB/unix),Nice to have (Dremio else equivalent experience of working in Databricks)Good knowledge with Azure Databricks, Azure Data Factory, ADLSAdmin, monitoring the Bigdata platform and...


  • Toronto, Canada Themesoft Inc. Full time

    Position : Big Data Engineer Location : Toronto – Hybrid Job Description : Must have Spark, Hadoop, Hbase, Kafka, Yarn, Airflow, Cloud Good to have (Dynatrace, Splunk, DB/unix), Nice to have (Dremio else equivalent experience of working in Databricks) Good knowledge with Azure Databricks, Azure Data Factory, ADLS Admin, monitoring the Bigdata platform and...


  • Toronto, Canada Themesoft Inc. Full time

    Position: Big Data EngineerLocation: Toronto – HybridJob Description:Must have Spark, Hadoop, Hbase, Kafka, Yarn, Airflow, CloudGood to have (Dynatrace, Splunk, DB/unix),Nice to have (Dremio else equivalent experience of working in Databricks)Good knowledge with Azure Databricks, Azure Data Factory, ADLSAdmin, monitoring the Bigdata platform and...


  • Toronto, Canada Insight Global Full time

    12 month contract One of Insight Global's large clients is looking for an intermediate Infrastructure Engineer (Linux/Azure) to join their team. This individual will design, implement, and maintain the client's Linux and Azure cloud infrastructure to help ensure optimal performance, scalability, Automation, DevOps and security. This individual would need to...


  • Toronto, Canada Insight Global Full time

    12 month contract One of Insight Global's large clients is looking for an intermediate Infrastructure Engineer (Linux/Azure) to join their team. This individual will design, implement, and maintain the client's Linux and Azure cloud infrastructure to help ensure optimal performance, scalability, Automation, DevOps and security. This individual would need to...


  • Toronto, Canada MLSE Full time

    Job DescriptionMLSE is seeking a Cloud Platform Engineer to join our group. Working closely with development and product teams, the successful candidate will be responsible for building and operating MLSE cloud platforms and services using AWS, Microsoft Azure and data center technologies.Build and operate MLSE’s cloud platform and services across AWS,...