Kafka Administrator

1 month ago

Toronto, Canada CGI Full time

Location: Hybrid Toronto/Montreal

**Job Type**: Full-Time

We're hiring a skilled Kafka Administrator to join our dynamic team

**Insights you can act on**

While technology is at the heart of our clients’ digital transformation, we understand that people are at the heart of business success.

When you join CGI, you become a trusted advisor, collaborating with colleagues and clients to bring forward actionable insights that deliver meaningful and sustainable outcomes. We call our employees "members" because they are CGI shareholders and owners and owners who enjoy working and growing together to build a company we are proud of. This has been our Dream since 1976, and it has brought us to where we are today — one of the world’s largest independent providers of IT and business consulting services.

At CGI, we recognize the richness that diversity brings. We strive to create a work culture where all belong and collaborate with clients in building more inclusive communities. As an equal-opportunity employer, we want to empower all our members to succeed and grow. If you require an accommodation at any point during the recruitment process, please let us know. We will be happy to assist.

Ready to become part of our success story? Join CGI — where your ideas and actions make a difference.

**Your future duties and responsibilities**

As a Kafka Administrator, you play a pivotal role in ensuring the seamless migration and optimal functioning of our Kafka setup. Your responsibilities include:

- Evaluating the existing Kafka setup to comprehend required configurations, topics, partitions, and overall architecture.
- Collaborating with data engineering and architecture teams to define migration goals and requirements.
- Identifying potential issues or deprecated features impacting the migration.
- Establishing a robust backup strategy for Kafka data to mitigate risks during migration.
- Developing a comprehensive recovery plan for potential issues during or after migration.
- Defining a meticulous migration strategy, considering factors such as downtime, data consistency, and impacts on consumers.
- Creating a detailed migration roadmap with specific milestones.
- Communicating changes in consumer configurations or connection details.
- Developing a rollback plan in case of critical migration issues.
- Reviewing and validating rollback processes to ensure effectiveness.
- Facilitating knowledge transfer sessions to equip the team for managing the migrated environment.

**Required qualifications to be successful in this role**
- Education: Bachelor's degree or relevant experience.
- Bilingualism: English and French proficiency (asset).
- Deep understanding of Kafka configurations, topics, partitions, and overall architecture.
- Proven ability to collaborate with data engineering and architecture teams for migration planning.
- Keen eye for identifying potential issues impacting migration.
- Expertise in establishing backup strategies for Kafka data.
- Proficiency in developing recovery plans for migration issues.
- Skill in defining migration strategies considering downtime, data consistency, and consumer impacts.
- Experience in creating detailed migration roadmaps with specific milestones.
- Effective communication of changes in consumer configurations or connection details.
- Proactive development of rollback plans for critical migration issues.
- Ensuring the effectiveness of rollback processes through thorough review and validation.
- Facilitating knowledge transfer sessions to empower the team for managing the migrated environment.

Technical Proficiency:

- Apache Kafka
- Kafka MirrorMaker or Confluent Replicator
- Project management tools (e.g., Jira)
- Version control tools (e.g., Git)
- Monitoring tools (e.g., Prometheus, Grafana, Confluent Control Center)
- Logging tools (e.g., ELK Stack)
- Documentation platforms (e.g., Confluence, Google Docs)
- Kafka testing tools (e.g., KRaft)

  • Kafka Administrator

    4 weeks ago

    Toronto, Canada Tata Consultancy Services Full time

    **About TCS** TCS is an equal opportunity employer, and embraces diversity in race, nationality, ethnicity, gender, age, physical ability, neurodiversity, and sexual orientation, to create a workforce that reflects the societies we operate in. Our continued commitment to Culture and Diversity and is reflected in our people stories across our workforce...

  • Kafka Admin

    1 month ago

    Toronto, Canada Q1 Technologies Full time

    Configure and manage Kafka topics, partitions, and replication using Kraft, if applicable. - Manage access controls, security configurations, and authentication protocols for Kafka clusters across regions. - Collaborate with other teams to ensure the integration of Kafka with other data stores and messaging systems across regions. - Automate deployment and...

  • Kafka Admin

    1 day ago

    Toronto, Canada Zortech Solutions Full time

    " **Proficiency with Kafka-based streaming** - Strong knowledge of enterprise-level Kafka features (Confluent) - Hands-on experience in design, development, setup and troubleshooting of high-volume Kafka streams - Proficiency with server-side languages/frameworks - Java/J2EE/Spring. - Proficiency with API development using Spring Boot. - Familiarity with...

  • Principal Data Engineer

    5 days ago

    Toronto, Canada Index Exchange Full time

    We shaped the earliest forms of ad tech, and we’re looking for technical expertise to help shape its future. Our customers have unique problems that can only be solved at an internet scale, and that’s where the technical skills of our team make a real difference. Our exchange handles over 350 billion requests every day (for comparison Google serves an...

  • Big Data Administrator

    1 week ago

    Toronto, Canada Themesoft Inc. Full time

    Position : Big Data Engineer Location : Toronto – Hybrid Job Description : Must have Spark, Hadoop, Hbase, Kafka, Yarn, Airflow, Cloud Good to have (Dynatrace, Splunk, DB/unix), Nice to have (Dremio else equivalent experience of working in Databricks) Good knowledge with Azure Databricks, Azure Data

  • Big Data Administrator

    2 weeks ago

    Toronto, Canada Themesoft Inc. Full time

    Position: Big Data EngineerLocation: Toronto – HybridJob Description:Must have Spark, Hadoop, Hbase, Kafka, Yarn, Airflow, CloudGood to have (Dynatrace, Splunk, DB/unix),Nice to have (Dremio else equivalent experience of working in Databricks)Good knowledge with Azure Databricks, Azure Data Factory, ADLSAdmin, monitoring the Bigdata platform and...

  • Big Data Administrator

    2 weeks ago

    Toronto, Canada Themesoft Inc. Full time

    Position: Big Data EngineerLocation: Toronto – HybridJob Description:Must have Spark, Hadoop, Hbase, Kafka, Yarn, Airflow, CloudGood to have (Dynatrace, Splunk, DB/unix),Nice to have (Dremio else equivalent experience of working in Databricks)Good knowledge with Azure Databricks, Azure Data Factory, ADLSAdmin, monitoring the Bigdata platform and...

  • Big Data Administrator

    1 week ago

    Toronto, Canada Themesoft Inc. Full time

    Position : Big Data Engineer Location : Toronto – Hybrid Job Description : Must have Spark, Hadoop, Hbase, Kafka, Yarn, Airflow, Cloud Good to have (Dynatrace, Splunk, DB/unix), Nice to have (Dremio else equivalent experience of working in Databricks) Good knowledge with Azure Databricks, Azure Data Factory, ADLS Admin, monitoring the Bigdata...

  • Big Data Administrator

    1 week ago

    Toronto, Canada Themesoft Inc. Full time

    Position : Big Data Engineer Location : Toronto – Hybrid Job Description : Must have Spark, Hadoop, Hbase, Kafka, Yarn, Airflow, Cloud Good to have (Dynatrace, Splunk, DB/unix), Nice to have (Dremio else equivalent experience of working in Databricks) Good knowledge with Azure Databricks, Azure Data Factory, ADLS Admin, monitoring the Bigdata platform...

  • Big Data Administrator

    1 week ago

    Toronto, Canada Themesoft Inc. Full time

    Position : Big Data Engineer Location : Toronto – HybridJob Description :Must have Spark, Hadoop, Hbase, Kafka, Yarn, Airflow, Cloud Good to have (Dynatrace, Splunk, DB/unix), Nice to have (Dremio else equivalent experience of working in Databricks) Good knowledge with Azure Databricks, Azure Data Factory, ADLS Admin, monitoring the Bigdata platform and...

  • Big Data Administrator

    7 days ago

    Toronto, Canada Themesoft Inc. Full time

    Position: Big Data EngineerLocation: Toronto – HybridJob Description:Must have Spark, Hadoop, Hbase, Kafka, Yarn, Airflow, Cloud Good to have (Dynatrace, Splunk, DB/unix), Nice to have (Dremio else equivalent experience of working in Databricks) Good knowledge with Azure Databricks, Azure Data Factory, ADLS Admin, monitoring the Bigdata platform and...

  • Big Data Administrator

    1 week ago

    Toronto, ON, Canada Themesoft Inc. Full time

    Position: Big Data EngineerLocation: Toronto - HybridJob Description:Must have Spark, Hadoop, Hbase, Kafka, Yarn, Airflow, CloudGood to have (Dynatrace, Splunk, DB/unix),Nice to have (Dremio else equivalent experience of working in Databricks)Good knowledge with Azure Databricks, Azure Data Factory, ADLSAdmin, monitoring the Bigdata platform and...

  • Big Data Administrator

    2 weeks ago

    Toronto, Canada Themesoft Inc. Full time

    Position: Big Data EngineerLocation: Toronto – HybridJob Description:Must have Spark, Hadoop, Hbase, Kafka, Yarn, Airflow, CloudGood to have (Dynatrace, Splunk, DB/unix),Nice to have (Dremio else equivalent experience of working in Databricks)Good knowledge with Azure Databricks, Azure Data Factory, ADLSAdmin, monitoring the Bigdata platform and...

  • Big Data Administrator

    2 weeks ago

    Toronto, Canada Themesoft Inc. Full time

    Position : Big Data Engineer Location : Toronto – Hybrid Job Description : Must have Spark, Hadoop, Hbase, Kafka, Yarn, Airflow, Cloud Good to have (Dynatrace, Splunk, DB/unix), Nice to have (Dremio else equivalent experience of working in Databricks) Good knowledge with Azure Databricks, Azure Data Factory, ADLS Admin, monitoring the Bigdata platform and...

  • Big Data Administrator

    2 weeks ago

    Toronto, Canada Themesoft Inc. Full time

    Position: Big Data EngineerLocation: Toronto – HybridJob Description:Must have Spark, Hadoop, Hbase, Kafka, Yarn, Airflow, CloudGood to have (Dynatrace, Splunk, DB/unix),Nice to have (Dremio else equivalent experience of working in Databricks)Good knowledge with Azure Databricks, Azure Data Factory, ADLSAdmin, monitoring the Bigdata platform and...

  • Big Data Administrator

    1 week ago

    Toronto, ON, Canada Themesoft Inc. Full time

    Position: Big Data EngineerLocation: Toronto – HybridJob Description:Must have Spark, Hadoop, Hbase, Kafka, Yarn, Airflow, CloudGood to have (Dynatrace, Splunk, DB/unix),Nice to have (Dremio else equivalent experience of working in Databricks)Good knowledge with Azure Databricks, Azure Data Factory, ADLSAdmin, monitoring the Bigdata platform and...

  • Big Data Administrator

    1 week ago

    Toronto, ON, Canada Themesoft Inc. Full time

    Position: Big Data EngineerLocation: Toronto – HybridJob Description:Must have Spark, Hadoop, Hbase, Kafka, Yarn, Airflow, CloudGood to have (Dynatrace, Splunk, DB/unix),Nice to have (Dremio else equivalent experience of working in Databricks)Good knowledge with Azure Databricks, Azure Data Factory, ADLSAdmin, monitoring the Bigdata platform and...

  • Big Data Administrator

    7 days ago

    Toronto, ON, Canada Themesoft Inc. Full time

    Position : Big Data Engineer Location : Toronto – Hybrid Job Description : Must have Spark, Hadoop, Hbase, Kafka, Yarn, Airflow, Cloud Good to have (Dynatrace, Splunk, DB/unix), Nice to have (Dremio else equivalent experience of working in Databricks) Good knowledge with Azure Databricks, Azure Data Factory, ADLS Admin, monitoring the Bigdata...

  • Senior Infrastructure Developer

    1 month ago

    Toronto, Canada Air Tek Inc Full time

    About Us Air-tek is a Canadian based software company focused on modernizing the airline industry and dealing with its most important and valuable issues. Our diverse team is helping to automate the most critical operations processes within airlines to ensure that billions of passengers seamlessly arrive at their final destination. Our software has been in...

  • Senior Infrastructure Developer

    1 month ago

    Toronto, Canada Air Tek Inc Full time

    About Us Air-tek is a Canadian based software company focused on modernizing the airline industry and dealing with its most important and valuable issues. Our diverse team is helping to automate the most critical operations processes within airlines to ensure that billions of passengers seamlessly arrive at their final destination. Our software has been in...