Data Engineer

While technology is the heart of our business, a global and diverse culture is the heart of our success. We love our people and we take pride in catering them to a culture built on transparency, diversity, integrity, learning and growth.

If working in an environment that encourages you to innovate and excel, not just in professional but personal life, interests you- you would enjoy your career with Quantiphi

About Quantiphi:

Quantiphi is an award-winning Applied AI and Big Data software and services company, driven by a deep desire to solve transformational problems at the heart of businesses. Our signature approach combines groundbreaking machine-learning research with disciplined cloud and data-engineering practices to create breakthrough impact at unprecedented speed. 

Quantiphi has seen 2.5x growth YoY since its inception in 2013, we don't just innovate - we lead. 

Headquartered in Boston, with 4,000+ professionals across the globe. Quantiphi leverages Applied AI technologies across multiple a. Industry Verticals (Telco, BFSI, HCLS etc.) and is an established Elite/Premier Partner of NVIDIA, Google Cloud, AWS, Snowflake, and others. 

We've been recognized with:

• 17x Google Cloud Partner of the Year awards in the last 8 years.

• 3x AWS AI/ML award wins.

• 3x NVIDIA Partner of the Year titles.

• 2x Snowflake Partner of the Year awards.

• We have also garnered top analyst recognitions from Gartner, ISG, and Everest Group.

• We have been certified as a Great Place to Work for the third year in a row- 2021, 2022, 2023.

Be part of a trailblazing team that's shaping the future of AI, ML, and cloud innovation. 

Your next big opportunity starts here

For more details, visit: Website or LinkedIn Page.

Role:  Data Engineer

Experience Level: 10+ years experience

Work Location: Canada (Remote)

Role Overview:

We are seeking an accomplished Data Engineer to drive best-in-class data engineering practices by designing, building, and operating production-grade batch and real-time streaming pipelines at scale. This is a hands-on technical leadership role where you will elevate engineering excellence across teams, mentor engineers, and deliver business-critical data solutions in complex, evolving environments.

You will play a key role in enhancing and modernizing existing data platforms, advancing event-driven and cloud-native architectures, and ensuring data reliability, quality, and observability across the ecosystem—while navigating ambiguity and driving outcomes.

Key Responsibilities:

• Lead the design, development, and optimization of highly scalable, low-latency streaming and batch data pipelines.

• Engineer real-time data solutions using technologies such as Apache Kafka, Apache Flink, and Spark Streaming.

• Collaborate closely with product, analytics, AI/ML, and platform teams to ensure data is treated as a first-class, strategic asset.

• Drive platform modernization initiatives, including the adoption of event-driven architectures, cloud-native services, and streaming-first design patterns.

• Establish and enforce best practices for data governance, security, performance tuning, and operational reliability across batch and streaming workloads.

• Embed data quality by design through:

• Schema contracts and backward-compatible schema evolution

• Automated transformation testing and data assertions

• Freshness, completeness, and accuracy checks across pipelines prior to production deployment

• Implement end-to-end observability for data pipelines by:

• Defining and instrumenting metrics, logs, and distributed traces

• Establishing SLAs/SLOs for latency, throughput, and availability

• Enabling proactive alerting, dashboards, and rapid incident response

• Act as a technical mentor and role model by conducting design reviews, code reviews, and fostering a culture of continuous improvement and engineering excellence.

Basic Qualifications:

• 10+ years of professional experience in software or data engineering, with 4+ years focused on streaming and real-time data systems

• Demonstrated success driving technical direction and mentoring engineers while remaining a hands-on contributor

• Deep expertise in streaming technologies such as Apache Kafka, Flink, and Spark Streaming

• Strong foundation in event-driven architectures, distributed systems, and resilient low-latency pipelines

• Hands-on experience with cloud platforms (AWS, Azure, or GCP) and containerized deployments for data workloads

• Proven experience implementing data quality frameworks and CI/CD integrations, including schema management and automated testing (e.g., dbt, Great Expectations)

• Operational excellence in observability, including metrics, logging, tracing, dashboards, and alerting for data pipelines

• Solid understanding of data governance, performance optimization, and scalability across batch and streaming environments

• Experience with Lakehouse architectures and platforms, including Databricks, Azure ADLS Gen2, and Apache Hudi

Other Qualifications (OQs):

• Strong collaboration and communication skills with the ability to influence stakeholders and evangelize modern data practices

• Analytical, structured problem-solving mindset with a bias for action

• Ability to learn quickly and adapt to new tools, technologies, and evolving architectures

• Self-starter who thrives in ambiguous environments and collaborates effectively across teams

• Excellent organizational and critical-thinking skills

• Comfortable leveraging AI-assisted development tools to improve productivity and engineering outcomes

What's in it for YOU at Quantiphi:

• Make an impact at one of the world's fastest-growing AI-first digital engineering companies.

• Upskill and discover your potential as you solve complex challenges in cutting-edge areas of technology alongside passionate, talented colleagues.

• Work where innovation happens - work with disruptive innovators in a research-focused organization with 60+ patents filed across various disciplines.

• Stay ahead of the curve—immerse yourself in breakthrough AI, ML, data, and cloud technologies and gain exposure working with Fortune 500 companies.

If you like wild growth and working with happy, enthusiastic over-achievers, you'll enjoy your career with us