Data Pipeline Specialist Job Opening
7 days ago
We are looking for a highly skilled Azure Databricks Engineer to join our team.
About the JobThe ideal candidate will have experience in designing, implementing and optimizing large-scale data pipelines, ensuring scalability, reliability, and performance.
Key Responsibilities:
- Design and implement scalable ETL/ELT pipelines using Databricks.
- Leverage PySpark/Spark and SQL to transform and process large datasets.
- Integrate data from multiple sources including Azure Blob Storage, ADLS and other relational/non-relational systems.
Required Skills:
- Strong expertise in Databricks (Delta Lake, Unity Catalog, Lakehouse Architecture, Table Triggers, Delta Live Pipelines, Databricks Runtime etc.)
- Proficiency in Azure Cloud Services.
- Solid understanding of Spark and PySpark for big data processing.
-
Data Pipeline Engineer
2 days ago
Mississauga, Ontario, Canada Open Systems Technologies Full timeWe are seeking a highly skilled Big Data Developer for a contract role at Open Systems Technologies. As a key member of our team, you will be responsible for designing and developing scalable data pipelines using Java Spark.This exciting opportunity involves working on large-scale financial data processing and analysis, ensuring efficient data storage and...
-
Mississauga, Ontario, Canada Open Systems Technologies Full timeJob OverviewOpen Systems Technologies is seeking a highly skilled Java Spark Developer to join our team. As a key member of our data engineering group, you will be responsible for designing and developing scalable data pipelines using Java Spark.In this role, you will work closely with our risk management team to develop and optimize data pipelines for risk...
-
Spark Developer
1 week ago
Mississauga, Ontario, Canada Open Systems Technologies Full timeWe are Open Systems Technologies, a leading technology firm, and we are looking for a skilled Java Spark Developer to join our team.This is a 3-day hybrid role where you will be working on developing and optimizing data pipelines for risk calculations, trade analytics, and regulatory reporting. As a Java Spark Developer, you will design and implement...
-
Enterprise Data Architecture Specialist
7 days ago
Mississauga, Ontario, Canada Bombardier Transportation GmbH Full timeJob DescriptionWe're seeking a skilled Data Engineer / Data Specialist to lead our enterprise data platform (DWH, Data Lake). The ideal candidate will create and maintain optimal/reliable data pipeline architecture to meet business needs.The successful candidate will have experience coaching/leading a small team (technical leadership) and knowledge of Agile...
-
Senior Data Professional Wanted
2 hours ago
Mississauga, Ontario, Canada Data Engineer Jobs Full timeJob DescriptionWe are seeking a highly motivated and detail-oriented Senior Data Engineer who will be responsible for SAP Data Engineering with SAP Datasphere or similar technologies maintaining/developing the platform and processes in an ambitious team.The ideal candidate will design and implement data ingestion strategies using SLT SAP to stream data...
-
Azure Databricks Data Pipeline Expert
4 days ago
Mississauga, Ontario, Canada Synechron Full timeSynechron's progressive technologies and optimization strategies span end-to-end Artificial Intelligence, Consulting, Digital, Cloud & DevOps, Data, and Software Engineering.We develop innovative solutions for modernization, including AI and Blockchain, Data Science models, Digital Underwriting, mobile-first applications, and more.We are seeking a highly...
-
Senior Data Technology Specialist
2 days ago
Mississauga, Ontario, Canada Pharma Medica Research Inc. Full timeInnovative and forward-thinking organization Pharma Medica Research Inc. seeks a skilled Senior Data Engineer & AI Specialist to develop and maintain complex data solutions on Azure.The ideal candidate will have expertise in designing and implementing ETL/ELT pipelines, optimizing data ingestion, transformation, and orchestration workflows, and ensuring data...
-
Senior Data Integration Specialist
3 days ago
Mississauga, Ontario, Canada Texada Software Full timeAbout the Job:We are seeking an experienced Senior Data Integration Specialist to join our team in Greater Toronto Area, ON. As a Sr. Data Integration Specialist, you will play a critical role in designing, developing, and maintaining robust data integration pipelines between our systems and external vendors.Key Responsibilities:Designing and implementing...
-
Big Data Processing Specialist
5 days ago
Mississauga, Ontario, Canada Dexian Full timeJob DescriptionDexian is a dynamic organization that connects talent, technology, and organizations. We are currently seeking a Big Data Processing Specialist to join our team.Key Responsibilities:Develop and optimize Java Spark-based data pipelines for large-scale financial data processing and analytics.Design and implement distributed computing solutions...
-
Data Transformation Specialist
2 days ago
Mississauga, Ontario, Canada COMPASS GROUP CANADA Full timeAs a Data Transformation Specialist at COMPASS GROUP CANADA, you will be responsible for developing and maintaining our data transformation layer to ensure accurate and reliable data.The ideal candidate will have experience with dbt, SQL, and Python, as well as strong problem-solving and analytical skills.We are committed to hiring the best talent for this...
-
Senior Azure Data Pipeline Developer
2 days ago
Mississauga, Ontario, Canada Synechron Full timeAt Synechron, we are passionate about driving innovation and growth through digital transformation. Our global consulting firm combines creativity with cutting-edge technology to deliver industry-leading digital solutions that cater to the evolving needs of financial services and technology firms.We are seeking an experienced Azure Data Engineer to join our...
-
Global Data Governance Specialist
3 days ago
Mississauga, Ontario, Canada Citigroup Inc. Full timeWe are looking for a highly skilled Global Data Governance Specialist to join our team at Citigroup Inc. In this critical role, you will be responsible for developing and enforcing global data quality frameworks to ensure the accuracy, consistency, and reliability of data across our organization.About the Role:Collaborate with trading desks, quants, risk,...
-
Senior Python Developer
7 days ago
Mississauga, Ontario, Canada Synechron Full timeThe Role\As a Lead Python Data Engineer at Synechron, you will lead the design and development of data pipelines for ingestion, transformation, and loading of data from various sources (databases, APIs, streaming platforms) into our data warehouse/lake.\You will write optimized and maintainable SQL queries and leverage SQLAlchemy for efficient database...
-
High-Performance Data Specialist
4 days ago
Mississauga, Ontario, Canada Tata Consultancy Services Full timeAbout the PositionThis High-Performance Data Specialist position is an exciting opportunity to work with a leading organization in the IT industry. As a High-Performance Data Specialist, you will be responsible for designing and developing high-quality data transformation applications using Apache Spark framework.Your key responsibilities will...
-
Java Spark Technology Specialist
7 days ago
Mississauga, Ontario, Canada Open Systems Technologies Full timeOpen Systems Technologies seeks a seasoned Java Spark Technology Specialist to join our team. As a key member of our technology team, you will leverage your expertise in big data processing, Core Java and Apache Spark to deliver innovative solutions for our clients in the financial services sector.The ideal candidate will have a strong background in...
-
Engineering Data Quality Manager
1 day ago
Mississauga, Ontario, Canada KUBRA Data Transfer Ltd Full timeAbout the Role:We are seeking a highly skilled Data Quality Engineer to join our team. As a key member of our Engineering department, you will work closely with cross-functional teams to ensure our products meet high levels of product data quality and accuracy. Your focus will be on testing and enhancing data capabilities across various products, using...
-
Java Spark Specialist for Market Analytics
8 hours ago
Mississauga, Ontario, Canada Open Systems Technologies Full timeOpen Systems Technologies is seeking a talented Java Spark Specialist to join our team.In this role, you will be responsible for developing and optimizing Java Spark-based data pipelines for processing and analyzing large-scale financial data.The ideal candidate will have strong proficiency in Python and Java Spark with knowledge of core Spark concepts...
-
Distributed Computing Specialist
5 days ago
Mississauga, Ontario, Canada Open Systems Technologies Full timeJob Overview:We are seeking a talented Distributed Computing Specialist to join our team at Open Systems Technologies. In this role, you will be responsible for designing and implementing distributed computing solutions for risk modeling, pricing, and regulatory compliance.Key Responsibilities:- Develop and optimize scalable Java Spark-based data pipelines...
-
Data Engineering Specialist
4 days ago
Mississauga, Ontario, Canada COMPASS GROUP CANADA Full timeAbout Compass Group CanadaWe are a global foodservice and support services company that's the 6th largest employer in the world, with 625,000 employees. Our team is part of a larger organization that operates in schools, colleges, hospitals, office buildings, senior living communities, tourist attractions, sports venues, remote camps and military...
-
Big Data Engineer
4 days ago
Mississauga, Ontario, Canada Open Systems Technologies Full timeJob Description:We are seeking a highly skilled Java Spark Developer to join our team at Open Systems Technologies. As a key member of our engineering team, you will be responsible for developing and optimizing data pipelines for risk calculations, trade analytics, and regulatory reporting.Key Responsibilities:- Develop scalable Java Spark-based data...