Senior PySpark Developer
3 weeks ago
IT Jobs in Canada Job Description Live Assets | IT Staffing Solutions is hiring a Senior PySpark Developer for one of its Clients from Healthcare Industry. Key Responsibilities Understanding systems and business processes related to assigned products. Working closely with business partners to develop, maintain, and support solutions using Python, PySpark, and related tools. Providing support and guidance for writing high-quality, clean, and maintainable code while actively participating in peer code reviews. Developing, modifying, and executing automated test plans to improve coverage and reduce manual effort. Ensuring proper testing and sign-off procedures in accordance with company’s quality assurance framework. Promoting and implementing applications in accordance with departmental change management processes. Creating or updating documentation related to product design, ETL mappings, and other technical components as directed by company’s IT team. Preparing relevant documentation, reports, and presentations related to assigned projects and activities. Necessary Skills 5+ years of experience in programming in Python & SQL; should be able to write modular, maintainable code. Extensive experience developing PySpark data pipelines; expert using Spark DataFrames, Spark SQL, and PySpark for large-scale data processing. Proven experience with automated testing and DevOps practices. Solid knowledge of MySQL or equivalent relational databases. Familiarity with software development tools/practices (Git, unit testing, release automation) and Amazon Redshift. Excellent troubleshooting and problem-solving skills; demonstrating initiative and a positive, team-oriented attitude. Experience with Apache Iceberg (open table format) and with Airflow or equivalent orchestration tools. Experience developing solutions in an AWS Cloud environment. Working knowledge of Amazon EMR (Elastic MapReduce), AWS Lambda (serverless) service and AWS Cloud Development Kit (CDK) for Python. Strong analytical skills and the ability to translate business requirements into technical solutions. Strong oral and written communication skills in English. About Live Assets | Leaders in IT Excellence | Greater Toronto Area Live Assets is a premier IT agency dedicated to delivering excellence in tech solutions across various industries. Our agency is renowned for its expertise in engineering, and we take pride in our track record of delivering outstanding IT projects with precision and innovation. With a wide spectrum of clients spanning different industries, we cater to both permanent and contract IT opportunities. Discover more about our agency and stay updated on our latest developments through our social media channels: LinkedIn – Twitter – Facebook – Youtube – Glassdooor #J-18808-Ljbffr
-
Senior PySpark Developer
4 weeks ago
Toronto, Ottawa, Canada Live Assets Full timeIT Jobs in Canada Job Description Live Assets | IT Staffing Solutions is hiring a Senior PySpark Developer for one of its Clients from Healthcare Industry. Key Responsibilities Understanding systems and business processes related to assigned products.Working closely with business partners to develop, maintain, and support solutions using Python, PySpark, and...
-
Senior PySpark Developer
4 weeks ago
Toronto, Montreal, Calgary, Vancouver, Edmonton, Old Toronto, Ottawa, Mississauga, Quebec, Winnipeg, Halifax, Saskatoon, Burnaby, Hamilton, Victoria, Surrey, Halton Hills, London, Regina, Markham, Brampton, Vaughan, Kelowna, Laval, Southwestern Ontario, R, Canada Maplesoft Group Full timeMaplesoft implements TimeLive for Electronic time tracking.Please view the demo below on how to enter and approve time.Do you want to work in a dynamic environment where your contributions count?At Maplesoft, we value the contributions of all our employees and contractors. We listen and act upon suggestions, advice, and innovative ideas to further our...
-
Senior PySpark Developer: Scale Data Pipelines
3 weeks ago
Toronto, Montreal, Calgary, Vancouver, Edmonton, Old Toronto, Ottawa, Mississauga, Quebec, Winnipeg, Halifax, Saskatoon, Burnaby, Hamilton, Victoria, Surrey, Halton Hills, London, Regina, Markham, Brampton, Vaughan, Kelowna, Laval, Southwestern Ontario, R, Canada Maplesoft Group Full timeA tech consulting company in Canada is seeking a Senior PySpark Developer to enhance their pharmaceutical data management system. The role involves developing efficient data pipelines and automating testing processes. Candidates should possess extensive experience in PySpark, Python, and SQL, along with strong problem-solving skills. The company values a...
-
Ottawa, Canada Live Assets Full timeA premier IT agency is seeking a Senior PySpark Developer in Ottawa to support solutions in the Healthcare sector. The ideal candidate will have over 5 years of experience with Python and PySpark, capable of developing data pipelines and contributing to automated testing. Strong analytical skills and a positive attitude are essential. This position offers an...
-
Ottawa, Canada Live Assets Full timeA premier IT agency is seeking a Senior PySpark Developer in Ottawa to support solutions in the Healthcare sector. The ideal candidate will have over 5 years of experience with Python and PySpark, capable of developing data pipelines and contributing to automated testing. Strong analytical skills and a positive attitude are essential. This position offers an...
-
Hybrid Data Engineer
4 weeks ago
Ottawa, Canada Maplesoft Group Full timeMaplesoft implements TimeLive for Electronic time tracking. Please view the demo below on how to enter and approve time. Do you want to work in a dynamic environment where your contributions count? At Maplesoft, we value the contributions of all our employees and contractors. We listen and act upon suggestions, advice, and innovative ideas to further our...
-
Hybrid Data Engineer
3 weeks ago
Ottawa, Canada Maplesoft Group Full timeMaplesoft implements TimeLive for Electronic time tracking. Please view the demo below on how to enter and approve time. Do you want to work in a dynamic environment where your contributions count? At Maplesoft, we value the contributions of all our employees and contractors. We listen and act upon suggestions, advice, and innovative ideas to further our...
-
Hybrid Data Engineer
3 weeks ago
Ottawa, Canada Maplesoft Group Full timeMaplesoft implements TimeLive for Electronic time tracking. Please view the demo below on how to enter and approve time. Do you want to work in a dynamic environment where your contributions count? At Maplesoft, we value the contributions of all our employees and contractors. We listen and act upon suggestions, advice, and innovative ideas to further our...
-
Hybrid Data Engineer
3 weeks ago
Ottawa, Canada Maplesoft Group Full timeMaplesoft implements TimeLive for Electronic time tracking. Please view the demo below on how to enter and approve time. Do you want to work in a dynamic environment where your contributions count? At Maplesoft, we value the contributions of all our employees and contractors. We listen and act upon suggestions, advice, and innovative ideas to further our...
-
Ottawa, Canada Live Assets Full timeA premier IT agency is seeking a Senior PySpark Developer in Ottawa to support solutions in the Healthcare sector. The ideal candidate will have over 5 years of experience with Python and PySpark, capable of developing data pipelines and contributing to automated testing. Strong analytical skills and a positive attitude are essential. This position offers an...
