Senior PySpark Developer

3 weeks ago

Toronto, Canada Live Assets Full time

IT Jobs in Canada

Job Description

Live Assets | IT Staffing Solutions is hiring a Senior PySpark Developer for one of its Clients from Healthcare Industry.

Key Responsibilities

- Understanding systems and business processes related to assigned products.
- Working closely with business partners to develop, maintain, and support solutions using Python, PySpark, and related tools.
- Providing support and guidance for writing high-quality, clean, and maintainable code while actively participating in peer code reviews.
- Developing, modifying, and executing automated test plans to improve coverage and reduce manual effort.
- Ensuring proper testing and sign-off procedures in accordance with company’s quality assurance framework.
- Promoting and implementing applications in accordance with departmental change management processes.
- Creating or updating documentation related to product design, ETL mappings, and other technical components as directed by company’s IT team.
- Preparing relevant documentation, reports, and presentations related to assigned projects and activities.

Necessary Skills

- 5+ years of experience in programming in Python & SQL; should be able to write modular, maintainable code.
- Extensive experience developing PySpark data pipelines; expert using Spark DataFrames, Spark SQL, and PySpark for large-scale data processing.
- Proven experience with automated testing and DevOps practices.
- Solid knowledge of MySQL or equivalent relational databases.
- Familiarity with software development tools/practices (Git, unit testing, release automation) and Amazon Redshift.
- Excellent troubleshooting and problem-solving skills; demonstrating initiative and a positive, team-oriented attitude.
- Experience with Apache Iceberg (open table format) and with Airflow or equivalent orchestration tools.
- Experience developing solutions in an AWS Cloud environment.
- Working knowledge of Amazon EMR (Elastic MapReduce), AWS Lambda (serverless) service and AWS Cloud Development Kit (CDK) for Python.
- Strong analytical skills and the ability to translate business requirements into technical solutions.
- Strong oral and written communication skills in English.

About Live Assets | Leaders in IT Excellence | Greater Toronto Area

Live Assets is a premier IT agency dedicated to delivering excellence in tech solutions across various industries.

Our agency is renowned for its expertise in engineering, and we take pride in our track record of delivering outstanding IT projects with precision and innovation.

With a wide spectrum of clients spanning different industries, we cater to both permanent and contract IT opportunities.

Discover more about our agency and stay updated on our latest developments through our social media channels:

LinkedIn – Twitter – Facebook – Youtube – Glassdooor

#J-18808-Ljbffr

  • Senior PySpark Developer

    4 weeks ago

    Toronto, Ottawa, Canada Live Assets Full time

    IT Jobs in Canada Job Description Live Assets | IT Staffing Solutions is hiring a Senior PySpark Developer for one of its Clients from Healthcare Industry. Key Responsibilities Understanding systems and business processes related to assigned products.Working closely with business partners to develop, maintain, and support solutions using Python, PySpark, and...

  • Senior PySpark Developer

    4 weeks ago

    Toronto, Montreal, Calgary, Vancouver, Edmonton, Old Toronto, Ottawa, Mississauga, Quebec, Winnipeg, Halifax, Saskatoon, Burnaby, Hamilton, Victoria, Surrey, Halton Hills, London, Regina, Markham, Brampton, Vaughan, Kelowna, Laval, Southwestern Ontario, R, Canada Maplesoft Group Full time

    Maplesoft implements TimeLive for Electronic time tracking.Please view the demo below on how to enter and approve time.Do you want to work in a dynamic environment where your contributions count?At Maplesoft, we value the contributions of all our employees and contractors. We listen and act upon suggestions, advice, and innovative ideas to further our...

  • Senior PySpark Developer: Scale Data Pipelines

    3 weeks ago

    Toronto, Montreal, Calgary, Vancouver, Edmonton, Old Toronto, Ottawa, Mississauga, Quebec, Winnipeg, Halifax, Saskatoon, Burnaby, Hamilton, Victoria, Surrey, Halton Hills, London, Regina, Markham, Brampton, Vaughan, Kelowna, Laval, Southwestern Ontario, R, Canada Maplesoft Group Full time

    A tech consulting company in Canada is seeking a Senior PySpark Developer to enhance their pharmaceutical data management system. The role involves developing efficient data pipelines and automating testing processes. Candidates should possess extensive experience in PySpark, Python, and SQL, along with strong problem-solving skills. The company values a...

  • Sr. Developer PySpark/Python

    7 days ago

    toronto, Canada IT Connex Full time

    Our client needs a Sr. PySpark Developer to support the design, development, and maintenance of the project’s data platform and pipelines.Responsibilities may include the full range of activities from requirements gathering and feasibility analysis to design, coding, testing, quality assurance, implementation, documentation, and ongoing support.Must...

  • Python / PySpark Developer

    1 week ago

    Toronto, Ontario, Canada LogicsT Technologies Full time $100,000 - $120,000 per year

    Job DescriptionPrimary ResponsibilitiesDesign, develop, and maintain high-quality Python and PySpark applications.Build and optimize data pipelines, ETL/ELT workflows, and data integrations.Write clean, maintainable, and efficient code following best practices and architectural patterns.Perform unit testing using tools like Pytest, and ensure code quality...

  • Senior PySpark Developer to support the design, development, and maintenance of modernized data pipelines for a large-scale data modernization initiative

    4 weeks ago

    Toronto, Canada S.i. Systèmes Full time

    Our valued public sector client is seeking Senior PySpark Developer to support the design, development, and maintenance of modernized data pipelines for a large-scale data modernization initiative! Initial 5-month contract (until March 31, 2026) with a strong possibility of extension. Remote work arrangement within Canada, full-time, Monday to Friday. The...

  • Azure Data Engineer with PySpark and Spark SQL

    3 weeks ago

    Toronto, Canada Saransh Inc Full time

    Overview Role: Azure Data Engineer with PySpark and Spark SQL Location: Toronto / GTA, ON, Canada (Hybrid - 3 days a week onsite) Job Type: Contract Required Responsibilities 8-10 years strong hands-on experience with Azure Data Factory, Azure Databricks and PySpark development. Work on data migration projects. Understand complex data systems by...

  • Azure Data Engineer with PySpark and Spark SQL

    3 weeks ago

    Toronto, Canada Saransh Inc Full time

    Overview Role: Azure Data Engineer with PySpark and Spark SQL Location: Toronto / GTA, ON, Canada (Hybrid - 3 days a week onsite) Job Type: Contract Required Responsibilities 8-10 years strong hands-on experience with Azure Data Factory, Azure Databricks and PySpark development. Work on data migration projects. Understand complex data systems by...

  • Azure Data Engineer with PySpark and Spark SQL

    3 weeks ago

    Toronto, Canada Saransh Inc Full time

    Overview Role: Azure Data Engineer with PySpark and Spark SQL Location: Toronto / GTA, ON, Canada (Hybrid - 3 days a week onsite) Job Type: Contract Required Responsibilities 8-10 years strong hands-on experience with Azure Data Factory, Azure Databricks and PySpark development. Work on data migration projects. Understand complex data systems by...

  • Senior Data Engineer

    1 week ago

    Calgary, Toronto, Montreal, Vancouver, Edmonton, Old Toronto, Ottawa, Mississauga, Quebec, Winnipeg, Halifax, Saskatoon, Burnaby, Hamilton, Surrey, Victoria, London, Halton Hills, Regina, Markham, Brampton, Vaughan, Kelowna, Laval, Southwestern Ontario, R, Canada Lumenalta Full time

    A progressive tech company is seeking a Senior Data Engineer to build scalable data solutions in a remote setting. This role requires 7+ years of experience in data engineering, with strong skills in Python, SQL, and tools like PySpark and Databricks. The company offers flexible hours, health insurance, and professional development opportunities, fostering a...