Senior PySpark Developer

Title

Senior PySpark Developer

Location

Remote

Start Date

Language

English

Salary

Negotiable

Security Clearance

None

Duration

6 Months

Date Posted

Job ID

14013

Recruiter Email

Maplesoft Group is currently seeking a Senior PySpark Developer for our client.

Tasks and Responsibilities include, but are not limited to the following:

Background:

• Our client is developing a modernized pharmaceutical data management system designed to efficiently handle large volumes of data ingestion and transformation. The initiative leverages a modern technology stack, updated standards, and improved processes, all within an Agile Scrum delivery framework.

• We require a Senior PySpark Developers to support the design, development, and maintenance of the project's data platform and pipelines.

Services:

• This Senior Consultant/Developer will work as part of the technical team to develop and maintain information systems. - Responsibilities may include the full range of activities from requirements gathering and feasibility analysis to design, coding, testing, quality assurance, implementation, documentation, and ongoing support.

In summary, the main deliverables include:

• Understanding systems and business processes related to assigned products.
• Working closely with business partners to develop, maintain, and support solutions using Python, PySpark, and related tools.
• Providing support and guidance for writing high-quality, clean, and maintainable code while actively participating in peer code reviews.
• Developing, modifying, and executing automated test plans to improve coverage and reduce manual effort.
• Ensuring proper testing and sign-off procedures in accordance with the client's quality assurance framework
• Promoting and implementing applications in accordance with departmental change management processes.
• Creating or updating documentation related to product design, ETL mappings, and other technical components as directed by the client's IT team.
• Preparing relevant documentation, reports, and presentations related to assigned projects and activities

The successful candidate must have:

• Extensive experience developing PySpark data pipelines.
• Strong expertise in Python and SQL development.
• Proven experience with automated testing and DevOps practices.
• Ability to manage a heavy workload and effectively coordinate and prioritize multiple tasks.
• Strong analytical skills and the ability to translate business requirements into technical solutions.
• Willingness to perform various tasks as required including development, operations, and support.
• Excellent troubleshooting and problem-solving skills; demonstrating initiative and a positive, team-oriented attitude.
• Strong oral and written communication skills in English.

Maplesoft Group prides itself on its distinct corporate culture and recognizes that success is a direct reflection of our most valuable asset - our people. Therefore, attitude and ambition are key personality traits we seek out, along with skill and aptitude, in potential employees.

Maplesoft Group is committed to having a diverse, representative workforce and continuing to build an inclusive environment. We encourage applications from all qualified individuals. Maplesoft Group is an equal opportunity employer committed to diversity and inclusion. We are pleased to consider all qualified applicants irrespective of race, color, religion, sex, sexual orientation, gender identity, national origin, age, disability, protected veterans' status, Aboriginal peoples or any other legally protected factors.

All employment decisions are made based on business needs, job requirements, and individual qualifications.

We are committed to developing inclusive, barrier-free recruitment and selection processes, and a work environment that supports our diverse workforce. Please let us know if you require accommodations at any stage of the recruitment process. We can be reached at Maplesoft Info at

We thank you for your interest in Maplesoft Group and wish to advise you, that only candidates under consideration will be contacted.