Current jobs related to Senior PySpark Developer to support the design, development, and maintenance of modernized data pipelines for a large-scale data modernization initiative - Toronto - S.i. Systèmes
-
Senior PySpark Developer: Scale Data Pipelines
4 weeks ago
Toronto, Montreal, Calgary, Vancouver, Edmonton, Old Toronto, Ottawa, Mississauga, Quebec, Winnipeg, Halifax, Saskatoon, Burnaby, Hamilton, Victoria, Surrey, Halton Hills, London, Regina, Markham, Brampton, Vaughan, Kelowna, Laval, Southwestern Ontario, R, Canada Maplesoft Group Full timeA tech consulting company in Canada is seeking a Senior PySpark Developer to enhance their pharmaceutical data management system. The role involves developing efficient data pipelines and automating testing processes. Candidates should possess extensive experience in PySpark, Python, and SQL, along with strong problem-solving skills. The company values a...
-
Senior PySpark Developer
4 weeks ago
Toronto, Canada Live Assets Full timeIT Jobs in Canada Job Description Live Assets | IT Staffing Solutions is hiring a Senior PySpark Developer for one of its Clients from Healthcare Industry. Key Responsibilities - Understanding systems and business processes related to assigned products. - Working closely with business partners to develop, maintain, and support solutions using Python,...
-
Senior PySpark Developer
4 weeks ago
Toronto, Ottawa, Canada Live Assets Full timeIT Jobs in Canada Job Description Live Assets | IT Staffing Solutions is hiring a Senior PySpark Developer for one of its Clients from Healthcare Industry. Key Responsibilities Understanding systems and business processes related to assigned products.Working closely with business partners to develop, maintain, and support solutions using Python, PySpark, and...
-
Senior PySpark Developer
4 weeks ago
Toronto, Montreal, Calgary, Vancouver, Edmonton, Old Toronto, Ottawa, Mississauga, Quebec, Winnipeg, Halifax, Saskatoon, Burnaby, Hamilton, Victoria, Surrey, Halton Hills, London, Regina, Markham, Brampton, Vaughan, Kelowna, Laval, Southwestern Ontario, R, Canada Maplesoft Group Full timeMaplesoft implements TimeLive for Electronic time tracking.Please view the demo below on how to enter and approve time.Do you want to work in a dynamic environment where your contributions count?At Maplesoft, we value the contributions of all our employees and contractors. We listen and act upon suggestions, advice, and innovative ideas to further our...
-
Full-stack Software Developer Specialist
1 week ago
Toronto, Canada Intact Financial Corporation Full timeAbout the roleWe’re looking for a Full-stack Software Developer Specialist (Python/PySpark) to join our growing team!pyskaWe are seeking an experienced full-stack developer with strong data engineering skills to design and deliver scalable, high-performing applications that handle large datasets and complex data workflows. The ideal candidate is...
-
Sas Modernization Sme
3 days ago
Toronto, Canada Epsilon Solutions Full time**Position**: SAS Modernization SME **Location**: Toronto, Canada - Hybrid(3 Days onsite in a week with extension based on client need) **Job Type**: Long-Term Contract We are seeking highly experienced SAS Conversion SMEs with strong expertise in Python, PySpark, AWS, and modern data platforms to support the migration and transformation of legacy...
-
Azure Data Engineer
13 hours ago
Toronto, Canada Themesoft Inc. Full timeResponsibilities Design, build, and optimize large-scale ETL/ELT pipelines using Databricks and PySpark. Develop and maintain data ingestion frameworks for structured and unstructured datasets in ADLS. Collaborate with data analysts, data scientists, and product teams to understand business requirements and implement scalable data solutions. Implement data...
-
Azure Data Engineer
4 hours ago
Toronto, Canada Themesoft Inc. Full timeResponsibilities Design, build, and optimize large-scale ETL/ELT pipelines using Databricks and PySpark. Develop and maintain data ingestion frameworks for structured and unstructured datasets in ADLS. Collaborate with data analysts, data scientists, and product teams to understand business requirements and implement scalable data solutions. Implement data...
-
Python / PySpark Developer
1 week ago
Toronto, Ontario, Canada LogicsT Technologies Full time $100,000 - $120,000 per yearJob DescriptionPrimary ResponsibilitiesDesign, develop, and maintain high-quality Python and PySpark applications.Build and optimize data pipelines, ETL/ELT workflows, and data integrations.Write clean, maintainable, and efficient code following best practices and architectural patterns.Perform unit testing using tools like Pytest, and ensure code quality...
-
Lead Data Engineer
1 week ago
Toronto, Canada Jobs via Dice Full timeLead Data Engineer Python, PySpark & SQL Location: Canada Job Type: Full time contract We are looking for a strong Lead Data Engineer with deep experience in Python, PySpark, SQL, and AWS to design, develop, and optimize large-scale data pipelines. This role requires strong hands‑on coding skills, the ability to validate and process complex raw data, and...
Senior PySpark Developer to support the design, development, and maintenance of modernized data pipelines for a large-scale data modernization initiative
4 weeks ago
Our valued public sector client is seeking Senior PySpark Developer to support the design, development, and maintenance of modernized data pipelines for a large-scale data modernization initiative Initial 5-month contract (until March 31, 2026) with a strong possibility of extension. Remote work arrangement within Canada, full-time, Monday to Friday. The successful candidates will be responsible for developing, testing, and supporting data ingestion and transformation pipelines using PySpark, Python, and AWS-based technologies, following Agile development practices and CI/CD principles. The developers will work closely with technical and business teams to deliver scalable, high-performance data solutions that support enterprise analytics and reporting. ResponsibilitiesDesign, develop, and maintain large-scale data processing pipelines using PySpark, Spark SQL, and Python.Collaborate with business and technical stakeholders to translate business requirements into technical solutions.Develop modular, reusable, and maintainable code following software development best practices.Implement automated testing frameworks to ensure data quality and reliability.Participate in peer code reviews and apply CI/CD practices using Git-based workflows.Work with Airflow or equivalent orchestration tools for pipeline scheduling and automation.Develop and maintain ETL mappings, documentation, and data flow diagrams.Deploy and monitor data workflows in a cloud-based environment (AWS EMR, Redshift, S3, Lambda).Troubleshoot performance issues and optimize Spark jobs for scalability and efficiency.Ensure compliance with quality assurance and change management procedures. Must-Have5+ years of hands-on programming experience in Python and SQL, writing modular, maintainable code.3+ years of strong experience developing PySpark data pipelines for large-scale data processing.Solid understanding of Spark DataFrames, Spark SQL, and distributed data processing concepts.Practical experience working in AWS Cloud environments (e.g., EMR, Redshift, Lambda).Strong knowledge of MySQL or equivalent relational databases.Proficiency with Git, unit testing, and release automation.Familiarity with Apache Iceberg or similar open table formats.Experience with Airflow or equivalent orchestration frameworks.Excellent problem-solving and troubleshooting skills, with a proactive, collaborative attitude.Strong oral and written communication skills in English. Nice to HaveExperience with AWS Cloud Development Kit (CDK) for Python.Familiarity with serverless architecture (AWS Lambda, event-driven design).Exposure to DevOps automation and continuous integration pipelines.Previous experience working on healthcare or public sector data platforms. Apply