Bigdata Platform Infrastructure engineer
4 weeks ago
Position: Bigdata Platform Infrastructure engineer
Location: Toronto – Hybrid
Job Description:
Candidate will be responsible for admin, monitoring and maintaining the Bigdata platform and infrastructure, Hadoop clusters, configuration management etc.
- Proficient operating Cloudera/Hortonworks Hadoop, HDFS/HBase/Yarn/Ranger/Spark/ZK, Ambari, Dremio, Druid, Airflow
- A strong grasp of fundamental concepts of Linux (Redhat), data engineering, network, warehouses, operational databases, messaging, and data management
- Good knowledge with Azure Databricks, Azure Data Factory, ADLS.
- Working knowledge of data migration from HDFS to ADLS using ADF.
- Experience with configuration management tools such as Salt, Ansible.
- Strong scripting skills with experience of platform automation using python/bash with version control system Git/Bitbucket
Regards
Patrick Fernandez
Strategic Recruitment Manager - Talent Acquisition Group
-
Platform Engineer
3 weeks ago
Toronto, Ontario, Canada State Street Full timeWho we are looking forAs a key member for the Platform engineering team part of Data Services platform; you will be responsible to drive automation in the platform. We are looking for an engineering focused and experienced Engineer with strong grounding on Public cloud concepts preferably Azure (any other Cloud vendor is a plus), principles, Infrastructure...
-
Platform Engineer
3 weeks ago
Toronto, Canada State Street Full timeWho we are looking forAs a key member for the Platform engineering team part of Data Services platform; you will be responsible to drive automation in the platform. We are looking for an engineering focused and experienced Engineer with strong grounding on Public cloud concepts preferably Azure (any other Cloud vendor is a plus), principles, Infrastructure...
-
Big Data Administrator
7 days ago
Toronto, Canada Themesoft Inc. Full timePosition : Big Data Engineer Location : Toronto – Hybrid Job Description : Must have Spark, Hadoop, Hbase, Kafka, Yarn, Airflow, Cloud Good to have (Dynatrace, Splunk, DB/unix), Nice to have (Dremio else equivalent experience of working in Databricks) Good knowledge with Azure Databricks, Azure Data Factory, ADLS Admin, monitoring the Bigdata platform...
-
Big Data Administrator
1 week ago
Toronto, Canada Themesoft Inc. Full timePosition : Big Data Engineer Location : Toronto – Hybrid Job Description : Must have Spark, Hadoop, Hbase, Kafka, Yarn, Airflow, Cloud Good to have (Dynatrace, Splunk, DB/unix), Nice to have (Dremio else equivalent experience of working in Databricks) Good knowledge with Azure Databricks, Azure Data Factory, ADLS Admin, monitoring the Bigdata...
-
Site Reliability Engineer
4 days ago
Toronto, Canada Hopper Full timeAbout the job We are looking for a senior Site Reliability Engineer to join the Platform Infrastructure team at Hopper. We manage a large infrastructure in Google Cloud that is used by hundreds of engineers worldwide to provide a first class experience to millions of end users around the world.If the traits described below sounds like you, this role might...
-
Big Data Administrator
1 week ago
Toronto, Canada Themesoft Inc. Full timePosition : Big Data Engineer Location : Toronto – HybridJob Description :Must have Spark, Hadoop, Hbase, Kafka, Yarn, Airflow, Cloud Good to have (Dynatrace, Splunk, DB/unix), Nice to have (Dremio else equivalent experience of working in Databricks) Good knowledge with Azure Databricks, Azure Data Factory, ADLS Admin, monitoring the Bigdata platform and...
-
Big Data Administrator
7 days ago
Toronto, Canada Themesoft Inc. Full timePosition: Big Data EngineerLocation: Toronto – HybridJob Description:Must have Spark, Hadoop, Hbase, Kafka, Yarn, Airflow, Cloud Good to have (Dynatrace, Splunk, DB/unix), Nice to have (Dremio else equivalent experience of working in Databricks) Good knowledge with Azure Databricks, Azure Data Factory, ADLS Admin, monitoring the Bigdata platform and...
-
Platform Engineer
4 weeks ago
Toronto, Canada Unreal Gigs Full timeAbout UsWe're revolutionizing the way analysts evaluate and act on deals by simplifying the review process for potential opportunities. Through cutting-edge language models, we provide a platform that not only organizes information but also offers comparative insights against existing portfolios and industry benchmarks. With our vision to automate various...
-
Platform Engineer
4 weeks ago
Toronto, Canada Unreal Gigs Full timeAbout UsWe're revolutionizing the way analysts evaluate and act on deals by simplifying the review process for potential opportunities. Through cutting-edge language models, we provide a platform that not only organizes information but also offers comparative insights against existing portfolios and industry benchmarks. With our vision to automate various...
-
Big Data Administrator
2 weeks ago
Toronto, Canada Themesoft Inc. Full timePosition: Big Data EngineerLocation: Toronto – HybridJob Description:Must have Spark, Hadoop, Hbase, Kafka, Yarn, Airflow, CloudGood to have (Dynatrace, Splunk, DB/unix),Nice to have (Dremio else equivalent experience of working in Databricks)Good knowledge with Azure Databricks, Azure Data Factory, ADLSAdmin, monitoring the Bigdata platform and...
-
Big Data Administrator
2 weeks ago
Toronto, Canada Themesoft Inc. Full timePosition: Big Data EngineerLocation: Toronto – HybridJob Description:Must have Spark, Hadoop, Hbase, Kafka, Yarn, Airflow, CloudGood to have (Dynatrace, Splunk, DB/unix),Nice to have (Dremio else equivalent experience of working in Databricks)Good knowledge with Azure Databricks, Azure Data Factory, ADLSAdmin, monitoring the Bigdata platform and...
-
Big Data Administrator
2 weeks ago
Toronto, Canada Themesoft Inc. Full timePosition : Big Data Engineer Location : Toronto – Hybrid Job Description : Must have Spark, Hadoop, Hbase, Kafka, Yarn, Airflow, Cloud Good to have (Dynatrace, Splunk, DB/unix), Nice to have (Dremio else equivalent experience of working in Databricks) Good knowledge with Azure Databricks, Azure Data Factory, ADLS Admin, monitoring the Bigdata platform and...
-
Azure Platform Engineer
1 month ago
Toronto, Canada Guidepoint Full time: Guidepoint’s Engineering team thrives on problem solving and creating happier users. As Guidepoint works to achieve its mission of making individuals, businesses, and the world smarter through personalized knowledge-sharing solutions, the engineering team is taking on challenges to improve our internal CRM system and create new products to optimize...
-
Azure Platform Engineer
4 days ago
Toronto, Canada Tactable Full timeThe Role A Platform Engineer at Tactable is a seasoned professional with deep understanding of Azure cloud infrastructure, automation principles, and a security-first mindset. In this role, you’ll take the lead in designing, implementing, and maintaining our cloud-based platforms and CI/CD pipeline
-
Big Data Administrator
6 days ago
Toronto, ON, Canada Themesoft Inc. Full timePosition : Big Data Engineer Location : Toronto – Hybrid Job Description : Must have Spark, Hadoop, Hbase, Kafka, Yarn, Airflow, Cloud Good to have (Dynatrace, Splunk, DB/unix), Nice to have (Dremio else equivalent experience of working in Databricks) Good knowledge with Azure Databricks, Azure Data Factory, ADLS Admin, monitoring the Bigdata...
-
Staff Platform Engineer
4 days ago
Toronto, Canada Ripple Labs Full timeAt Ripple, we're building a world where value moves like information does today. It's big, it's bold, and we're already doing it. Through our crypto solutions for financial institutions, businesses, governments and developers, we are improving the global financial system and creating greater economic fairness and opportunity for more people, in more places...
-
Staff Platform Engineer
3 days ago
Toronto, Canada Ripple Full timeAt Ripple, we’re building a world where value moves like information does today. It’s big, it’s bold, and we’re already doing it. Through our crypto solutions for financial institutions, businesses, governments and developers, we are improving the global financial system and creating greater economic fairness and opportunity for more people, in more...
-
Staff Platform Engineer
4 days ago
Toronto, Canada Ripple Labs Full timeAt Ripple, we're building a world where value moves like information does today. It's big, it's bold, and we're already doing it. Through our crypto solutions for financial institutions, businesses, governments and developers, we are improving the global financial system and creating greater economic fairness and opportunity for more people, in more places...
-
Azure Platform Engineer
4 days ago
Toronto, Canada Tactable Full timeThe Role A Platform Engineer at Tactable is a seasoned professional with deep understanding of Azure cloud infrastructure, automation principles, and a security-first mindset. In this role, you’ll take the lead in designing, implementing, and maintaining our cloud-based platforms and CI/CD pipelines, ensuring optimal performance, reliability, and...
-
Azure Platform Engineer
4 days ago
Toronto, Canada Tactable Full timeThe Role A Platform Engineer at Tactable is a seasoned professional with deep understanding of Azure cloud infrastructure, automation principles, and a security-first mindset. In this role, you’ll take the lead in designing, implementing, and maintaining our cloud-based platforms and CI/CD pipelines, ensuring optimal performance, reliability, and...