Senior Streaming Engineer

5 months ago

Toronto, Canada Rackspace Full time
About the Role: We are seeking a highly skilled and experienced Senior Big Data Engineer to join our dynamic team. The ideal candidate will have a strong background in developing and scaling both stream and batch processing systems, and a solid understanding of public cloud technologies, especially GCP. This role involves working in a remote environment, requiring excellent communication skills and the ability to solve complex problems independently and creatively. What you will be doing Build a reusable, and reliable code for stream and batch processing systems at scale. This includes working with technologies like Pub/Sub, Kafka, Kinesis, DataFlow, Flink, Hadoop, Pig, Hive, and Spark. Implementing automation/DevOps best practices for CI/CD, IaC, Containerization, etc.

Requirements:

Experience in building a reusable, and reliable code for stream and batch processing systems at scale. Expertise in public cloud services, particularly in GCP. Experience with GCP managed services and understanding of cloud-based messaging/stream processing systems are critical. Data Proc, Cloud Composer, GCS, DataFlow. Experienced in Infrastructure and Applied DevOps principles in daily work. Utilize tools for continuous integration and continuous deployment (CI/CD), and Infrastructure as Code (IaC) like Terraform to automate and improve development and release processes. Has knowledge in containerization technologies such as Docker and Kubernetes to enhance the scalability and efficiency of applications. Ability to tackle complex challenges and devise effective solutions. Use critical thinking to approach problems from various angles and propose innovative solutions. Worked effectively in a remote setting, maintaining strong written and verbal communication skills. Collaborate with team members and stakeholders, ensuring clear understanding of technical requirements and project goals. Proven experience in engineering stream/batch processing systems at scale. Strong programming abilities in Java and Python. Hands-on experience in public cloud platforms, particularly GCP. Additional experience with other cloud technologies is advantageous.

Must Have:

Strong Java 11-17 experience Dataflow (Managed Apache Beam) Pub/Sub Google Associate Cloud Engineer Certification or other Google Cloud Professional level certification 4+ years of experience in customer-facing software/technology or consulting 4+ years of experience with “on-premises to cloud” migrations or IT transformations 4+ years of experience building, and operating solutions built on GCP (ideally) or AWS/Azure Technical degree: Computer Science, software engineering or related #LI-VM1#LI-Canada#LI-Toronto#Rackspace About Rackspace Technology We are the multicloud solutions experts. We combine our expertise with the world’s leading technologies — across applications, data and security — to deliver end-to-end solutions. We have a proven record of advising customers based on their business challenges, designing solutions that scale, building and managing those solutions, and optimizing returns into the future. Named a best place to work, year after year according to Fortune, Forbes and Glassdoor, we attract and develop world-class talent. Join us on our mission to embrace technology, empower customers and deliver the future. More on Rackspace Technology Though we’re all different, Rackers thrive through our connection to a central goal: to be a valued member of a winning team on an inspiring mission. We bring our whole selves to work every day. And we embrace the notion that unique perspectives fuel innovation and enable us to best serve our customers and communities around the globe. We welcome you to apply today and want you to know that we are committed to offering equal employment opportunity without regard to age, color, disability, gender reassignment or identity or expression, genetic information, marital or civil partner status, pregnancy or maternity status, military or veteran status, nationality, ethnic or national origin, race, religion or belief, sexual orientation, or any legally protected characteristic. If you have a disability or special need that requires accommodation, please let us know.

  • Data Streaming Engineer

    7 days ago

    Toronto, Ontario, Canada Amazon Full time

    We are seeking a highly skilled Data Streaming Engineer to join our team at Amazon Advertising. With a strong background in software development and design, you will be responsible for building and operating novel solutions for the most advanced brands and advertisers working with Amazon.Company OverviewAmazon Advertising operates at the intersection of...

  • Senior Software Engineer

    2 months ago

    Toronto, Ontario, Canada beBee Professionals Full time

    Streaming Services Development SpecialistAt beBee Professionals, we are looking for a talented Streaming Services Development Specialist to join our team in Toronto. As a key member of our team, you will be responsible for developing and maintaining streaming services for our clients.Key Responsibilities:* Design and develop streaming services using various...

  • Senior Cloud Architect

    4 weeks ago

    Toronto, Ontario, Canada Rackspace Full time

    About the Role:We're seeking a skilled Senior Streaming Engineer to join our team. This role involves working on stream and batch processing systems, utilizing technologies like Pub/Sub, Kafka, Kinesis, DataFlow, Flink, Hadoop, Pig, Hive, and Spark. As a Senior Streaming Engineer, you'll be responsible for building reusable and reliable code for stream and...

  • Senior Data Engineer: Driving Business Growth with Data Insights

    3 weeks ago

    Old Toronto, Canada Data Engineer Jobs Full time

    As a Senior Data Engineer at Mozilla, you will play a pivotal role in shaping the company's data strategy and driving business growth through informed decision-making.About the RoleWe are seeking an experienced data engineer to join our Analytics Engineering team. In this role, you will work closely with data scientists to design and implement scalable data...

  • M Mozilla Senior Data Engineer

    2 months ago

    Old Toronto, Canada Data Engineer Jobs Full time

    To learn the Hiring Ranges for this position, please select your location from the Apply Now dropdown menu.The Mozilla Corporation is wholly owned by the non-profit 501(c) Mozilla Foundation. This means we aren't beholden to any shareholders --- only to our mission. Along with thousands of volunteer contributors and collaborators all over the world,...

  • Teaching Stream Professor of Engineering Business

    3 weeks ago

    Toronto, Ontario, Canada University of Toronto Full time

    About the OpportunityThe University of Toronto's Faculty of Applied Science and Engineering invites applications for a full-time teaching stream appointment in engineering business and entrepreneurship. The successful candidate will teach courses within the Business Minor and Entrepreneurship Certificate, support curriculum integration, and pursue...

  • Assistant Professor, Teaching Stream

    4 weeks ago

    Old Toronto, Canada University of Toronto Full time

    b>Job Category: Faculty - Teaching Stream (continuing) Faculty/Division: Faculty of Applied Science & Engineering Department: Institute for Studies in Trans-Disciplinary Engineering Education and Practice Campus: St. George (Downtown Toronto) The Institute of Transdisciplinary Studies in Engineering Education and Practice (ISTEP) in the Faculty of Applied...

  • Senior Software Engineer

    4 weeks ago

    Toronto, Ontario, Canada Twitch Full time

    About TwitchWe're a live streaming platform where thousands of communities come together for whatever, every day. We're about community, inside and out, and we're on a quest to empower live communities.About the RoleWe're building the future of interactive video, and our Video Client Engineering team is looking for experienced engineers who have worked on...

  • Senior Cloud Data Engineering Lead

    7 days ago

    Toronto, Ontario, Canada Scotiabank Full time

    Job OverviewWe are seeking an experienced Senior Cloud Data Engineering Lead to join our team at Scotiabank in Toronto, Canada.Salary: $175,000 - $225,000 per yearAbout the RoleThis is a leadership position that requires strong technical expertise and business acumen. As a Senior Cloud Data Engineering Lead, you will be responsible for designing, building,...

  • Senior Leader, Engineering Operations

    2 months ago

    Toronto, Ontario, Canada Amazon Full time

    Lead the Way in Campaign Reporting and AnalyticsAre you a seasoned leader with a passion for driving innovation and excellence in campaign reporting and analytics? Do you have a proven track record of managing high-performing engineering teams and delivering cutting-edge technology solutions?Amazon is seeking a talented Senior Manager to lead our Reporting...

  • Senior Cloud Data Engineer, Transformation Expert

    3 weeks ago

    Toronto, Ontario, Canada Scotiabank Full time

    OverviewAt Scotiabank, we are seeking a Senior Cloud Data Engineer to lead our data transformation efforts and drive innovation using Google Cloud Platform (GCP) technologies.Estimated Salary Range:$120,000 - $180,000 per yearJob DescriptionA career as a Senior Cloud Data Engineer at Scotiabank means you will be working on designing, building, and...

  • Senior Quality Engineer Automation Analyst Lead

    4 weeks ago

    Toronto, Ontario, Canada Royal Bank of Canada> Full time

    Transformative IT SolutionsGlobal Functions Technology (GFT) is part of Royal Bank of Canada's Technology and Operations division. We collaborate with partners across the company to deliver innovative and transformative IT solutions. Our clients represent various business areas within RBC, and we lead the development of digital tools and platforms to enhance...

  • Senior Software Engineer

    2 months ago

    Toronto, Ontario, Canada Twitch Full time

    About TwitchTwitch is the world's leading live streaming platform, connecting millions of users through gaming, entertainment, music, sports, and more. Our community-driven approach fosters collaboration and innovation, making us a hub for creative and technical talent.About the RoleWe're seeking a seasoned Senior Software Engineer to join our Video Client...

  • Senior Data Transformation Engineer

    3 days ago

    Toronto, Canada Iris Software Inc. Full time

    We are seeking a Senior Data Transformation Engineer to join our team at Iris Software Inc. in Toronto, ON. As a Cloud Database Technical Lead, you will be responsible for designing and implementing data transformation platforms using cloud databases.This is a long-term contract opportunity with a competitive estimated salary of $150,000 - $180,000 per...

  • Software Development Engineer II

    1 month ago

    Old Toronto, Canada Amazon Full time

    Software Development Engineer II - Advertising, Amazon, Amazon Marketing StreamAmazon Advertising operates at the intersection of eCommerce and advertising, offering a rich array of digital display advertising solutions with the goal of helping our customers find and discover anything they want to buy. We help advertisers reach Amazon customers on...

  • Senior Data Engineer for Databricks Pipeline Expertise

    4 days ago

    Toronto, Ontario, Canada Fluent, LLC Full time

    Job Description:A Senior Data Engineer opportunity has arisen at Fluent, LLC, a high-flying performance marketing company. As part of our team, you will play a crucial role in building data products to power our business lines using your expertise in Databricks pipeline development.The successful candidate will be responsible for developing, deploying, and...

  • Senior Backend Engineer

    3 months ago

    Toronto, Ontario, Ontario, Canada Tiny Mile Full time

    Tiny MileOur contribution to society includes reducing congestion, and pollution, providing zero-emissions deliveries, increasing the quality of life for residents, empowering seniors and disabled people, and enabling affordable delivery for local businesses.TeamOur Platform team is at the forefront of engineering time-sensitive, distributed systems and...

  • Product Development Lead

    3 weeks ago

    Toronto, Ontario, Canada Consortia Full time

    Consortia seeks a seasoned Technical Product Manager to spearhead the roadmap and implementation of our cutting-edge video streaming platform. This highly-specialized role requires close collaboration with the engineering team to drive product innovation.Main Responsibilities:Lead the development of a world-class video streaming platform, prioritizing...

  • Senior Software Engineer

    5 months ago

    Toronto, Canada Twitch Full time

    About Us Twitch is the world’s biggest live streaming service, with global communities built around gaming, entertainment, music, sports, cooking, and more. It is where thousands of communities come together for whatever, every day. We’re about community, inside and out. You’ll find coworkers who are eager to team up, collaborate, and smash...

  • Senior Data Engineer, Technical Architect

    3 weeks ago

    Toronto, Ontario, Canada theScore Full time

    About theScoretheScore is a leading sports media company that delivers real-time sports news, scores, and statistics to millions of users worldwide. We are seeking an experienced Senior Data Engineer, Technical Architect to join our team.Job SummaryWe offer a competitive salary of $150,000 - $200,000 per year, depending on experience.Job DescriptionAs a key...