Python/PySpark Developer

6 days ago

Mississauga, Canada Compunnel, Inc. Full time

We are seeking an experienced Python/PySpark Developer to design, develop, and optimize data-driven applications and solutions.

The ideal candidate will have strong expertise in Python, PySpark, and Databricks, along with experience in Azure DevOps and enterprise data integration.

This role requires a deep understanding of algorithms, data structures, and best practices for building scalable and efficient systems.

Key Responsibilities

- Develop and maintain applications using Python and PySpark.
- Implement ETL/ELT processes and integrate data pipelines.
- Utilize Databricks for data processing and analytics.
- Perform code testing and analysis using tools such as Pytest and Pylint.
- Collaborate with cross-functional teams to design and deliver high-quality solutions.
- Apply architectural design patterns and best practices throughout the SDLC.
- Consume APIs (REST and others) for data integration.
- Work in an Agile development environment and participate in sprint planning and reviews.
- Use version control, ticketing systems, and CI/CD workflows for efficient development.

Required Qualifications

- Overall 10+ years of software development experience.
- Minimum 6 years of hands-on Python development experience.
- Strong experience with PySpark and Databricks.
- Proficiency in Azure DevOps and CI/CD practices.
- Experience with Python testing and code analysis tools (Pytest, Pylint).
- At least 4 years of full-time development experience using Python.
- At least 4 years working with T-SQL, XML, and enterprise schedulers.
- Solid understanding of algorithms, data structures, and architectural design patterns.
- Extensive experience in software development and SDLC.
- Familiarity with frameworks such as Django, Flask, Pyramid, or Tornado.
- Integration experience (ETL, ELT) with Python; SSIS knowledge is a plus.
- Strong analytical mindset and ability to create high-level product specifications and design documents.
- Proven collaboration and influencing skills.

Preferred Qualifications

- Experience with API management and advanced data integration techniques.
- Familiarity with cloud platforms and distributed systems.
- Exposure to Agile methodologies and tools like Jira.

#J-18808-Ljbffr

  • Python/PySpark Developer

    3 weeks ago

    Mississauga, Canada Compunnel, Inc. Full time

    We are seeking an experienced Python/PySpark Developer to design, develop, and optimize data-driven applications and solutions. The ideal candidate will have strong expertise in Python, PySpark, and Databricks, along with experience in Azure DevOps and enterprise data integration. This role requires a deep understanding of algorithms, data structures, and...

  • Python/PySpark Developer

    2 weeks ago

    Mississauga, Canada Compunnel Full time

    Job SummaryWe are seeking an experienced Python/PySpark Developer to design, develop, and optimize data-driven applications and solutions. The ideal candidate will have strong expertise in Python, PySpark, and Databricks, along with experience in Azure DevOps and enterprise data integration. This role requires a deep understanding of algorithms, data...

  • Python/PySpark Developer

    1 week ago

    Mississauga, Canada Compunnel, Inc. Full time

    We are seeking an experienced Python/PySpark Developer to design, develop, and optimize data-driven applications and solutions.The ideal candidate will have strong expertise in Python, PySpark, and Databricks, along with experience in Azure DevOps and enterprise data integration.This role requires a deep understanding of algorithms, data structures, and best...

  • Data Engineer Python/PySpark/OpenShift

    1 week ago

    Mississauga, Canada Compunnel, Inc. Full time

    The Data Engineer will design, develop, and maintain scalable data pipelines and workflows using Python, PySpark, and cloud technologies. This role involves managing data storage solutions, orchestrating ETL processes, and deploying containerized applications to support enterprise data initiatives. Key Responsibilities Develop, construct, test, and maintain...

  • Data Engineer Python/PySpark/OpenShift

    1 week ago

    Mississauga, Canada Compunnel, Inc. Full time

    The Data Engineer will design, develop, and maintain scalable data pipelines and workflows using Python, PySpark, and cloud technologies. This role involves managing data storage solutions, orchestrating ETL processes, and deploying containerized applications to support enterprise data initiatives. Key Responsibilities - Develop, construct, test, and...

  • Senior Python PySpark Data Engineer – Databricks

    3 weeks ago

    Mississauga, Canada Compunnel, Inc. Full time

    A tech solutions company is looking for an experienced Python/PySpark Developer to design and optimize data-driven applications. This role involves developing applications, utilizing Databricks, and integrating data pipelines. The ideal candidate will possess strong skills in Python, PySpark, and Azure DevOps, with over 10 years of software development...

  • Senior Python PySpark Data Engineer – Databricks

    1 week ago

    Mississauga, Canada Compunnel, Inc. Full time

    A tech solutions company is looking for an experienced Python/PySpark Developer to design and optimize data-driven applications. This role involves developing applications, utilizing Databricks, and integrating data pipelines. The ideal candidate will possess strong skills in Python, PySpark, and Azure DevOps, with over 10 years of software development...

  • Senior Python PySpark Data Engineer – Databricks

    1 week ago

    Mississauga, Canada Compunnel, Inc. Full time

    A tech solutions company is looking for an experienced Python/PySpark Developer to design and optimize data-driven applications. This role involves developing applications, utilizing Databricks, and integrating data pipelines. The ideal candidate will possess strong skills in Python, PySpark, and Azure DevOps, with over 10 years of software development...

  • Databricks Data Engineer

    9 hours ago

    Mississauga, Canada Astra North Infoteck Inc. Full time

    Job DescriptionEssential Skills:·         Databricks·         Python·         PySpark·         CI/CD Job Description:·         3-5 years experience with data management, best practices and software development·         Experience in Data Warehousing, data integration and data cleansing·        ...

  • Data Engineer – Python/PySpark/OpenShift

    1 week ago

    Mississauga, Canada Compunnel Inc. Full time

    Base pay range CA$60.00/hr - CA$75.00/hr Matching Top Tech Talent with the Right Roles | Driving Successful Tech Placements We are seeking an experienced Data Engineer to design, develop, and maintain scalable data solutions. The ideal candidate will have a strong background in Python, PySpark, SQL, Snowflake, Data Factory, Data Lakes, and OpenShift, with a...