Big Data Administrator
3 weeks ago
**Roles and Responsibilities**:
- In a multi-cultural team installing, upgrading, configuring, maintaining and on a daily basis supervising/monitoring Hadoop clusters.
- The team also provides support to developers and integrators.
- Because security is key for us: setup security (Kerberos, AD, IDMP,SSL)
- As you don’t like to repeat the same task over and over: automate operations, installation and monitoring of the Hadoop Framework.
- Participate to the continuous evaluation of Hadoop infrastructure requirements and design/deploy solutions (high availability, big data clusters, hadoop in public cloud, etc)
- Because you always question yourself for the better: cluster Monitoring, Troubleshooting and Configuration
- As you know that evidences and traces are important in case of incident: manage and review Hadoop log files
- Part of a BigData feature team, key element of a Follow the Sun support it means you will work with Paris and Bangalore, deliver tasks of Agile Sprints and act upon incidents to ensure a 7/7 - 24/24 production.
**Minimum Requirements**:
- 4+ years of relevant professional experience in Unix and Linux Systems, server hardware, virtualization, RedHat
- At least 3 years of experience of Hadoop (HortonWorks or Cloudera)
- Proven experience with automation
- Knowledge of Ansible
- Excellent troubleshooting techniques
- Core HADOOP services ,HDFS, YARN, Kafka, Hbase, Hive, Spark, Ranger, SOLR, HUE, Knox, Kerberos, SSL, Linux, Shell programming.
**Job Types**: Full-time, Permanent
**Salary**: $50,000.00-$100,000.00 per year
**Benefits**:
- Dental care
- Employee assistance program
- Life insurance
- Paid time off
- Vision care
Schedule:
- 8 hour shift
- Day shift
- Monday to Friday
- No weekends
Supplemental pay types:
- Bonus pay
Ability to commute/relocate:
- Montréal, QC H3A 3M8: reliably commute or plan to relocate before starting work (required)
**Experience**:
- Hadoop: 3 years (preferred)
- Shell Scripting: 3 years (preferred)
- Linux: 3 years (preferred)
- Kafka: 3 years (preferred)
- HDFS: 3 years (preferred)
- Apache Hive: 3 years (preferred)
- HBase: 3 years (preferred)
- SSL: 3 years (preferred)
- Spark: 3 years (preferred)
- HUE: 3 years (preferred)
**Language**:
- French (required)
-
Big Data Expert
1 day ago
Canada Luxoft Full timeLuxoft is a leading provider of software development and consulting services, leveraging expertise in modern technologies to deliver complex solutions. We are currently seeking a talented Big Data Developer to join our team in Pune.Job DescriptionThe successful candidate will work closely with other teams globally to develop new functionality for our...
-
Big Data Developer
6 days ago
Canada Luxoft Full timeProject Description:During the 2008 financial crisis, many big banks failed or faced issues due to liquidity issues. Lack of liquidity can kill any financial institution over the night. That's why it's so critical to constantly monitor liquidity risks and properly maintain collaterals.We are looking for a number of talented developers, who would like to join...
-
Big Data Developer
1 day ago
Canada Luxoft Full timeProject Description: During the 2008 financial crisis, many big banks failed or faced issues due to liquidity issues. Lack of liquidity can kill any financial institution over the night. That's why it's so critical to constantly monitor liquidity risks and properly maintain collaterals. We are looking for a number of talented developers, who would like to...
-
Big Data Developer
4 days ago
Canada Luxoft Full timeProject Description:During the 2008 financial crisis, many big banks failed or faced issues due to liquidity issues. Lack of liquidity can kill any financial institution over the night. That's why it's so critical to constantly monitor liquidity risks and properly maintain collaterals.We are looking for a number of talented developers, who would like to join...
-
Senior Big Data Developer
2 days ago
Canada OptiSource Ltd Full timeCompany Overview">OptiSource Ltd is a professional and agile organization with a strong focus on innovation.">Job Description">We are seeking an experienced Data Engineer to join our team and contribute to the design, development, and maintenance of data pipelines, data stores, and infrastructure.">Responsibilities include:">">Building entity extraction...
-
Senior Big Data Developer
2 weeks ago
Canada Luxoft Full timeProject Description:During the 2008 financial crisis, many big banks failed or faced issues due to liquidity issues. Lack of liquidity can kill any financial institution over the night. That's why it's so critical to constantly monitor liquidity risks and properly maintain collaterals.We are looking for a number of talented developers, who would like to join...
-
Big Data Engineer
6 days ago
Canada Sage Recruiting Full timeWhy Join Our TeamWe're on a mission to empower individuals to take control of their financial lives. As a Senior Data Engineer, you'll play a critical role in designing, implementing, and optimizing our data infrastructure and pipelines.Your Key ResponsibilitiesDesign and develop complex Python and SQL queries.Build and maintain ETL processes and data...
-
Big Data Developer
2 weeks ago
Canada Luxoft Full timeResponsibilities:Building new components that will integrate with existing infrastructureBuilding components for data analysis and toolingLiaise with Bank internal development teams based in Canada and Poland to drive towards a world class applicationDeliver on time regulatory commitmentsBe proactive and ensure the software developed by the Team remains...
-
Big Data Engineer Lead
7 days ago
Canada Sage Recruiting Full timeAbout the Role:We are seeking a highly skilled Senior Data Engineer to join our dynamic team.The ideal candidate will have 5-7 years of experience in data engineering, working with very large data sets, and a strong background in AWS, Python, and SQL.Responsibilities:Design and implement complex data infrastructure and pipelines.Develop and optimize Python...
-
Remote Administrative Coordinator
7 days ago
Canada Smart Apartment Data Full timeAbout the RoleWe are seeking an experienced Executive Administrative Assistant to join our team at Smart Apartment Data. The ideal candidate will be responsible for providing high-level administrative support to the CEO and the Founder, leading and coordinating key projects, and maintaining an efficient flow of information between all levels.The successful...
-
Big Data and Analytics Professional
4 days ago
Canada TMF Group Full timeAbout the JobTMF Group is looking for a skilled Data Engineer to join our team. As a Data Engineer, you will be responsible for designing, implementing, and maintaining enterprise data solutions.Key ResponsibilitiesWork closely with cross-functional teams to design, implement, and maintain enterprise data solutionsDevelop and execute data ingestion pipelines...
-
Big Data Solutions Developer
1 day ago
Canada hireVouch Full timeDevelop and maintain scalable data pipelines using Python and SQL.Design and implement ETL processes for efficient data ingestion, transformation, and storage.Work extensively with AWS SageMaker to develop, train, and deploy machine learning models.Optimize data storage, retrieval, and performance in AWS Redshift.Collaborate with data scientists, analysts,...
-
Data Architect
2 weeks ago
Canada Tredence Inc. Full timeDatabricks ArchitectJob SummaryWe are seeking a highly skilled Databricks Architect to design, implement, and optimize data solutions on the Databricks platform. The ideal candidate will have deep expertise in cloud-based data engineering, big data processing, and analytics, and a strong understanding of data architecture principles. You will play a pivotal...
-
Data Intelligence Specialist
22 hours ago
Canada Luxoft Full timeWe are looking for a skilled Big Data Developer to join our team in Pune and contribute to the development of our Liquidity Risk platform. The platform is designed to help investment banks manage liquidity risks and maintain collaterals efficiently.About the RoleIn this role, you will work on developing new functionality for the Liquidity Risk platform,...
-
Big Data Developer
1 day ago
canada | ca Luxoft Full timeResponsibilities:Building new components that will integrate with existing infrastructureBuilding components for data analysis and toolingLiaise with Bank internal development teams based in Canada and Poland to drive towards a world class applicationDeliver on time regulatory commitmentsBe proactive and ensure the software developed by the Team remains...
-
Data Engineer for AI Solutions
4 days ago
Canada Quantiphi Full timeAbout Us: Quantiphi is an award-winning Applied AI and Big Data software company, driven by a deep desire to solve transformational business problems. Our signature approach combines groundbreaking machine-learning research with disciplined cloud and data-engineering practices to create breakthrough impact at unprecedented speed.Job Overview: We are seeking...
-
Data Engineering Specialist
6 days ago
Canada Luxoft Full timeAbout Us:Luxoft is a leading provider of software development services and innovative digital solutions.Job Description:We are seeking an experienced Data Engineering Specialist to join our team. The ideal candidate will have a strong background in big data technologies and be able to design, develop, and deploy scalable data systems.Responsibilities:Design,...
-
Big Data Transformation Expert
4 days ago
Canada Zortech Solutions Full time**Our Vision**We aim to transform the Gen-AI industry by harnessing the power of data and Generative AI technology.
-
Data Engineer
2 weeks ago
Canada Summer Full timeTitle: Data EngineerLocation: Remote CanadaAbout this Role: As a Data Engineer, you will play a crucial role in designing, building, and optimizing our data infrastructure. You'll be responsible for developing scalable data pipelines, implementing ETL processes, and ensuring the quality and integrity of our data. Your expertise will contribute to the success...
-
Data Engineer
1 week ago
Canada Summer Full timeTitle: Data Engineer Location: Remote Canada About this Role: As a Data Engineer, you will play a crucial role in designing, building, and optimizing our data infrastructure. You'll be responsible for developing scalable data pipelines, implementing ETL processes, and ensuring the quality and integrity of our data. Your expertise will contribute to the...