Senior Pyspark Developer
4 weeks ago
Our client is seeking a Senior PySpark Developer with strong experience in building and supporting scalable data pipelines using PySpark, Python, and AWS cloud services. This role will involve collaborating closely with business and technical teams to design, develop, test, and support data solutions that align with business needs and established quality frameworks. Key Responsibilities Analyze and understand systems and business processes related to assigned data products. Collaborate with business partners to develop, maintain, and optimize data solutions using Python, PySpark, and related tools. Write clean, high-quality, and maintainable code while participating in peer code reviews. Develop, enhance, and execute automated tests to improve coverage and reduce manual effort. Ensure testing and release activities adhere to the Client’s quality assurance and change management standards. Create, maintain, and update technical documentation including product design and ETL mapping. Prepare project-related reports, documentation, and presentations as needed. Provide operational support, troubleshooting, and enhancements to existing solutions. Must-Have Skills & Experience Extensive experience building scalable PySpark data pipelines. Strong expertise in Python and SQL programming. Hands-on experience with DevOps practices, automated testing, and CI/CD pipelines. Ability to manage multiple priorities in a fast-paced environment. Strong analytical skills with the ability to translate business requirements into technical solutions. Excellent problem-solving skills with a proactive, collaborative approach. Strong communication skills in English (written and verbal). Technical Requirements Advanced Python & SQL skills; ability to write modular and maintainable code. Strong knowledge of MySQL or similar relational database technologies. Expertise with Spark DataFrames, Spark SQL, and PySpark for distributed data processing. Proficiency with Git and development best practices. Experience with Apache Iceberg (open table format). Experience using Airflow or similar orchestration tools. Hands-on experience developing in an AWS environment, including: Amazon Redshift Amazon EMR AWS Lambda AWS Cloud Development Kit (CDK) for Python
-
Senior PySpark Developer
4 weeks ago
, , Canada Maplesoft Group Full timeMaplesoft implements TimeLive for Electronic time tracking. Please view the demo below on how to enter and approve time. Do you want to work in a dynamic environment where your contributions count? At Maplesoft, we value the contributions of all our employees and contractors. We listen and act upon suggestions, advice, and innovative ideas to further our...
-
Senior PySpark Developer: Scale Data Pipelines
4 weeks ago
, , Canada Maplesoft Group Full timeA tech consulting company in Canada is seeking a Senior PySpark Developer to enhance their pharmaceutical data management system. The role involves developing efficient data pipelines and automating testing processes. Candidates should possess extensive experience in PySpark, Python, and SQL, along with strong problem-solving skills. The company values a...
-
Sr. Developer PySpark/Python
4 weeks ago
Canada IT Connex Full timeOur client needs a Sr. PySpark Developer to support the design, development, and maintenance of the project’s data platform and pipelines. Responsibilities may include the full range of activities from requirements gathering and feasibility analysis to design, coding, testing, quality assurance, implementation, documentation, and ongoing support. Must...
-
Sr. Developer PySpark/Python
1 week ago
Canada IT Connex Full timeOur client needs a Sr. PySpark Developer to support the design, development, and maintenance of the project’s data platform and pipelines. Responsibilities may include the full range of activities from requirements gathering and feasibility analysis to design, coding, testing, quality assurance, implementation, documentation, and ongoing support. Must...
-
Sr. Developer PySpark/Python
7 days ago
New Canada IT Connex Full timeOur client needs a Sr. PySpark Developer to support the design, development, and maintenance of the project's data platform and pipelines.Responsibilities may include the full range of activities from requirements gathering and feasibility analysis to design, coding, testing, quality assurance, implementation, documentation, and ongoing support.Must...
-
Sr. Developer PySpark/Python
2 weeks ago
New Canada, NS IT Connex Full timeOur client needs a Sr. PySpark Developer to support the design, development, and maintenance of the project's data platform and pipelines. Responsibilities may include the full range of activities from requirements gathering and feasibility analysis to design, coding, testing, quality assurance, implementation, documentation, and ongoing support. Must Have:...
-
Senior PySpark Engineer
3 weeks ago
, , Canada Maplesoft Group, an SEB Company Full timeA leading technology services provider is seeking a Senior PySpark Developer to support the design and maintenance of a pharmaceutical data management system. The ideal candidate will have strong expertise in Python and SQL, experience with automated testing, and a proven track record in DevOps practices. This contract position offers opportunities for...
-
Entry Level
4 weeks ago
Canada Maplesoft Group, an SEB Company Full timeMaplesoft Group is currently seeking a Senior PySpark Developer for our client. Our client is developing a modernized pharmaceutical data management system designed to efficiently handle large volumes of data ingestion and transformation. The initiative leverages a modern technology stack, updated standards, and improved processes, all within an Agile...
-
Entry Level
4 weeks ago
Canada Maplesoft Group, an SEB Company Full timeMaplesoft Group is currently seeking a Senior PySpark Developer for our client. Our client is developing a modernized pharmaceutical data management system designed to efficiently handle large volumes of data ingestion and transformation. The initiative leverages a modern technology stack, updated standards, and improved processes, all within an Agile...
-
Entry Level
4 weeks ago
Canada Maplesoft Group, an SEB Company Full timeMaplesoft Group is currently seeking a Senior PySpark Developer for our client. Our client is developing a modernized pharmaceutical data management system designed to efficiently handle large volumes of data ingestion and transformation. The initiative leverages a modern technology stack, updated standards, and improved processes, all within an Agile...
