Big Data Etl

3 days ago

Toronto, Canada virtusa Full time

**Job Title**: Big Data ETL + Python/PySpark Tester

**Location**: Toronto, ON, Canada
**Industry**: Big Data, Cloud Computing, ETL Testing

**Required Skills and Qualifications**:

- **9+ years** experience in Software Development Life Cycle (SDLC) and Software Testing Life Cycle (STLC).
- Strong knowledge of **Big Data** technologies like Hadoop/Cloudera.
- Proficient in **Python** programming language with **7+ years** experience.
- **ETL Testing** experience with **PySpark** and **Linux** systems.
- Proficient in testing API services using **Postman** and **Rest Assured** (7+ years).
- Familiarity with **Cloud Technologies** like **AWS** or **Azure**, and experience with **Hadoop commands**.
- Experience with **Test Management** tools like **qTest**.
- Solid understanding of **Continuous Testing** and version control with **GitHub**.
- Hands-on experience in **UI Automation** using tools like **Selenium**, **PyTest**, **Playwright**, and **Cypress** (3+ years).
- Knowledge of **BDD frameworks** such as **Cucumber** or **Behave** (2+ years).
- Familiarity with **Performance Testing** tools such as **JMeter** (4+ years).
- Ability to work in an agile environment and collaborate with cross-functional teams.

**Responsibilities**:

- Execute data testing tasks for the conversion of Big Data systems (Hadoop/Cloudera) to Python/PySpark-based solutions.
- Validate data transformations, ETL processes, and integration workflows.
- Work closely with development teams to ensure proper data handling, transformations, and migration to cloud environments.
- Perform end-to-end testing, including unit, functional, integration, and performance testing.
- Leverage cloud technologies (AWS/Azure) to execute and monitor data tests.
- Utilize automation tools like Jenkins for continuous testing and GitHub for version control.
- Perform API testing (REST) using tools like Postman and Rest Assured.
- Develop and maintain test scripts using Python and PySpark.
- Utilize UI Automation tools like Selenium, PyTest, and Playwright for testing front-end components.
- Use performance testing tools (JMeter) to ensure systems can handle high volumes of data.
- Actively contribute to test management processes using tools like qTest.

**Good to Have**:

- Experience with **Databricks**, **Salesforce** (SF), and other cloud-based platforms.
- Knowledge of **Jenkins** for Continuous Integration/Continuous Deployment (CI/CD).

Pay: $50.00-$60.00 per hour

Expected hours: 40 per week

Schedule:

- 8 hour shift

**Experience**:

- Python: 7 years (required)
- Pyspark: 7 years (required)
- Big data: 7 years (required)
- ETL: 7 years (required)

  • Qe - Mainframe / Etl / Big Data

    2 weeks ago

    Toronto, Canada Q1 Technologies Full time

    **Role: Quality Engineer** **Job Location: Toronto, ON** **Duration: Fulltime** **Job Description -** QE - Mainframe Testing (JCL, Cobol, Batch Testing) QE - Python, SQL **QE - ETL Testing, SQL, Python, Unix** QE - Big Data, Spark, Scala **Salary**: $58,179.06-$117,633.34 per year Schedule: - 8 hour shift Ability to commute/relocate: - Toronto,...

  • Big Data Developer

    2 days ago

    Toronto, Canada Insight Global Full time

    The Big Data Engineer is responsible for architecting, developing, and maintaining enterprise‑scale data platforms that support analytics, operational reporting, and machine learning initiatives. This role requires deep technical expertise in distributed systems, cloud platforms, and data modeling, combined with strong communication and leadership...

  • Big Data Developer

    2 days ago

    Toronto, Canada Insight Global Full time

    The Big Data Engineer is responsible for architecting, developing, and maintaining enterprise‑scale data platforms that support analytics, operational reporting, and machine learning initiatives. This role requires deep technical expertise in distributed systems, cloud platforms, and data modeling, combined with strong communication and leadership...

  • ETL & SQL Data Migration Specialist

    3 weeks ago

    Toronto, Canada FNZ (UK) Ltd Full time

    A global financial services provider in Toronto is seeking a Migration Analyst Developer to design and implement complex data mapping solutions. The role involves working with big data, developing ETL processes, and collaborating with clients to ensure successful migrations. Ideal candidates will have strong SQL Server experience, proficiency in ETL tools,...

  • Etl Tester with Data Quality

    3 days ago

    Toronto, Canada Rivago Infotech Pvt Full time

    **Job Overview** **Responsibilities** Design and execute test plans, scenarios, scripts, or procedures to ensure data integrity and consistency. Use SQL and other tools to perform data validation and testing. Collaborate with the development team to identify and fix data-related issues. Document and communicate test results, and track defects and...

  • ETL Developer

    3 weeks ago

    Toronto, Canada Compunnel, Inc. Full time

    We are seeking a skilled ETL Developer to support our data integration and transformation initiatives. The ideal candidate will have hands-on experience in ETL/ELT development, data warehousing, and working with various data formats and platforms. This role involves working closely with cross-functional teams to ensure efficient data flow and integrity...

  • Data Engineer

    2 weeks ago

    Toronto, Canada Scotiabank Full time

    A leading Canadian bank is seeking a Data Engineer in Toronto to contribute to their data integration solutions. The role requires extensive experience in software development and a deep understanding of Big Data technologies. Candidates should have strong skills in Agile development, data management, and analytics, coupled with hands-on experience with...

  • Data Engineer

    4 days ago

    Toronto, Canada Scotiabank Full time

    A leading Canadian bank is seeking a Data Engineer in Toronto to contribute to their data integration solutions. The role requires extensive experience in software development and a deep understanding of Big Data technologies. Candidates should have strong skills in Agile development, data management, and analytics, coupled with hands-on experience with...

  • Hiring for Etl Tester!!

    3 days ago

    Toronto, Canada Kumaran Systems Pvt Ltd Full time

    QA ETL TESTER, with our Banking Client in Toronto, Contract 6 months with possible extension. - 5 + years of work experience, ETL Tester/Automation. - Good understanding of SDLC & STLC, Agile (Scrum) models. - Strong experience in PL/SQL and UNIX shell scripting to perform ETL data warehousing testing. - DATABASES: Oracle and Big Data ( Hadoop, Netezza) -...

  • Hiring for a Full-time Position at Kumaran Systems for a Etl Testing

    2 days ago

    Toronto, Canada Kumaran Systems Pvt Ltd Full time

    **Hiring for a Full-Time Position at Kumaran Systems for a ETL Testing** - 5 + years of work experience, ETL Tester/Automation. - Good understanding of SDLC & STLC, Agile (Scrum) models. - Strong experience in PL/SQL and UNIX shell scripting to perform ETL data warehousing testing. - DATABASES: Oracle and Big Data ( Hadoop, Netezza) - Test tools: Toad,...