AWS Glue ETL Tester with Data Validation Expertise

2 weeks ago

Calgary, Alberta, Canada S I Systems Full time
Expert ETL Tester with AWS Glue and S3 Experience

S I Systems is seeking an experienced ETL Tester with a strong background in AWS Glue and S3 to support the validation of data accuracy, quality, and performance.

This role requires a high level of expertise in ETL testing, with a focus on ensuring data quality and integrity.

Must Haves:

  • 5+ years experience as a QA specifically with ETL testing.
  • Experience with AWS Glue, AWS S3, AWS Athena, AWS Lambda, and AWS DataSync.
  • Experience working with AWS Aurora (PostgreSQL), DynamoDB, and MS SQL Server.
  • Experience with test automation tools and frameworks.

Nice to Haves:

  • Experience with other AWS services such as AWS Redshift and RDS.
  • Familiarity with Big Data technologies (e.g., Hadoop, Spark).
  • AWS Certification related to data analytics or data engineering.

Responsibilities:

  • Lead the design, development, and implementation of ETL test strategies and plans.
  • Validate data extraction, transformation, and loading processes to ensure data quality and integrity.
  • Conduct detailed testing of data pipelines utilizing AWS Glue, ensuring transformations are correctly applied.
  • Verify data storage and retrieval from AWS S3, ensuring data consistency and accessibility.
  • Utilize AWS Athena to query and validate data stored in S3, applying SQL knowledge to perform complex queries.
  • Leverage AWS Lambda for serverless functions within the testing strategy.
  • Use AWS DataSync for data transfer operations and ensure data is accurately synchronized across environments.
  • Validate the performance and accuracy of databases such as AWS Aurora (PostgreSQL), DynamoDB, and MS SQL Server.
  • Create and maintain detailed documentation of test plans, test cases, and test results.
  • Automate testing processes where possible to streamline validation efforts.
  • Continuously monitor ETL processes post-deployment to identify and address any issues.
  • Collaborate with cross-functional teams to understand requirements and deliver high-quality test results.
  • Mentor and guide junior QA engineers and testers within the team.

  • Intermediate ETL Tester with AWS Glue and S3 Experience

    2 weeks ago

    Calgary, Alberta, Canada S.i. Systèmes Full time

    Job DescriptionOur client is seeking an experienced ETL Tester with a strong background in AWS Glue and S3 to support the validation of data accuracy, quality, and performance.This role requires the ability to work onsite 5 days a week, with core business hours of 8-5 and free onsite parking.Must-Haves:5+ years of experience as a QA specifically with ETL...

  • Data Engineer II

    6 days ago

    Calgary, Alberta, Canada Bazaarvoice Full time

    About the Role:We are seeking a highly skilled Data Engineer II to join our team at Bazaarvoice. As a key member of our data engineering platform, you will be responsible for designing, developing, and maintaining our data pipelines and workflows.Key Responsibilities:Design and implement data pipelines and workflows to support business needsCollaborate with...

  • Software Engineer II

    3 weeks ago

    Calgary, Alberta, Canada Bazaarvoice Full time

    About the Role:We are seeking a highly skilled Software Engineer II to join our team at Bazaarvoice. As a key member of our data engineering platform, you will play a critical role in launching new data pipelines and improving current data workflows and toolsets.Key Responsibilities:Design and develop data ingestion processes powered by machine learning...

  • Software Engineer II

    3 weeks ago

    Calgary, Alberta, Canada Bazaarvoice Full time

    About the Role:We are seeking a highly skilled Software Engineer II to join our team at Bazaarvoice. As a key member of our data engineering platform, you will play a critical role in launching new data pipelines and improving current data workflows and toolsets.Key Responsibilities:Design and develop data ingestion processes powered by machine learning...

  • Data Analyst

    3 weeks ago

    Calgary, Alberta, Canada Data Privacy Full time

    Data Analyst Role at PBSPBS Systems, a leading business platform vendor in North America, specializes in dealership management solutions. With over 30 years of experience, PBS manages diverse aspects of automotive dealerships, including sales, service, inventory, and accounting.The Data Analyst role at PBS involves providing expertise to clients and ensuring...

  • Data Analyst

    3 weeks ago

    Calgary, Alberta, Canada Data Privacy Full time

    Data Analyst Role at PBSPBS Systems, a leading business platform vendor in North America, specializes in dealership management solutions. With over 30 years of experience, PBS manages diverse aspects of automotive dealerships, including sales, service, inventory, and accounting.The Data Analyst role at PBS involves providing expertise to clients and ensuring...

  • Data Analyst

    3 weeks ago

    Calgary, Alberta, Canada Data Privacy Full time

    Data Analyst Role at PBSPBS Systems, a leading business platform vendor in North America, specializes in dealership management solutions. With over 30 years of experience, PBS manages diverse aspects of automotive dealerships, including sales, service, inventory, and accounting.The Data Analyst role at PBS involves providing expertise to clients and ensuring...

  • Data Analyst

    4 weeks ago

    Calgary, Alberta, Canada Data Privacy Full time

    Data Analyst Role at PBSPBS Systems, a leading business platform vendor in North America, specializes in dealership management solutions. With over 30 years of experience, PBS manages diverse aspects of automotive dealerships, including sales, service, inventory, and accounting.The Data Analyst role at PBS involves providing expertise to clients and ensuring...

  • Senior Data Engineer

    2 months ago

    Calgary, Alberta, Canada Data Engineer Jobs Full time

    About the RoleWe are seeking a highly skilled Senior Data Engineer to join our team at Data Engineer Jobs. As a Senior Data Engineer, you will be responsible for designing, developing, and maintaining scalable data pipelines and architectures within the Snowflake Data Cloud.Key ResponsibilitiesDesign and implement complex data pipelines and ETL processes...

  • Senior Data Engineer

    2 months ago

    Calgary, Alberta, Canada Data Engineer Jobs Full time

    About the RoleWe are seeking a highly skilled Senior Data Engineer to join our team at Data Engineer Jobs. As a Senior Data Engineer, you will be responsible for designing, developing, and maintaining scalable data pipelines and architectures within the Snowflake Data Cloud.Key ResponsibilitiesDesign and implement complex data pipelines and ETL processes...

  • Data Analyst

    1 month ago

    Calgary, Alberta, Canada Data Privacy Full time

    PBS Systems, a leading business platform vendor in North America, specializes in dealership management solutions. With over 30 years of experience, PBS manages diverse aspects of automotive dealerships, including sales, service, inventory, and accounting. The Data Analyst role at PBS involves providing expertise to clients and ensuring data integrity.Key...

  • Data Analyst

    1 month ago

    Calgary, Alberta, Canada Data Privacy Full time

    PBS Systems, a leading business platform vendor in North America, specializes in dealership management solutions. With over 30 years of experience, PBS manages diverse aspects of automotive dealerships, including sales, service, inventory, and accounting. The Data Analyst role at PBS involves providing expertise to clients and ensuring data integrity.Key...

  • Senior Data Engineer

    1 month ago

    Calgary, Alberta, Canada Data Engineer Jobs Full time

    About the RoleWe are seeking a highly skilled Data Engineer to join our team at EY. As a Data Engineer, you will play a critical role in designing, developing, and maintaining scalable data pipelines and architectures within the Snowflake Data Cloud.Key ResponsibilitiesDesign and implement complex data pipelines and ETL processes within Snowflake's cloud...

  • Senior Data Engineer

    1 month ago

    Calgary, Alberta, Canada Data Engineer Jobs Full time

    Job Title: Senior Data EngineerAt EY, we're seeking a highly skilled Senior Data Engineer to join our team. As a Senior Data Engineer, you will be responsible for designing, developing, and maintaining scalable data pipelines and architectures within the Snowflake Data Cloud.Key Responsibilities:Design and implement complex data pipelines and ETL processes...

  • Senior Data Engineer

    1 month ago

    Calgary, Alberta, Canada Data Engineer Jobs Full time

    About the RoleWe are seeking a highly skilled Data Engineer to join our team at EY. As a Data Engineer, you will play a critical role in designing, developing, and maintaining scalable data pipelines and architectures within the Snowflake Data Cloud.Key ResponsibilitiesDesign and implement complex data pipelines and ETL processes within Snowflake's cloud...

  • Senior Data Engineer

    1 month ago

    Calgary, Alberta, Canada Data Engineer Jobs Full time

    Job Title: Senior Data EngineerAt EY, we're seeking a highly skilled Senior Data Engineer to join our team. As a Senior Data Engineer, you will be responsible for designing, developing, and maintaining scalable data pipelines and architectures within the Snowflake Data Cloud.Key Responsibilities:Design and implement complex data pipelines and ETL processes...

  • Senior Data Engineer

    1 month ago

    Calgary, Alberta, Canada Data Engineer Jobs Full time

    About the RoleWe are seeking a highly skilled Snowflake Data Engineer to join our team at EY. As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining scalable data pipelines and architectures within the Snowflake Data Cloud.Key ResponsibilitiesDesign and implement complex data pipelines and ETL...

  • Senior Data Engineer

    1 month ago

    Calgary, Alberta, Canada Data Engineer Jobs Full time

    About the RoleWe are seeking a highly skilled Data Engineer to join our team at EY. As a Data Engineer, you will play a critical role in designing, developing, and maintaining scalable data pipelines and architectures within the Snowflake Data Cloud.Key ResponsibilitiesDesign and implement complex data pipelines and ETL processes within Snowflake's cloud...

  • Senior Data Engineer

    1 month ago

    Calgary, Alberta, Canada Data Engineer Jobs Full time

    About the RoleWe are seeking a highly skilled Snowflake Data Engineer to join our team at EY. As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining scalable data pipelines and architectures within the Snowflake Data Cloud.Key ResponsibilitiesDesign and implement complex data pipelines and ETL...

  • Senior Data Engineer

    1 month ago

    Calgary, Alberta, Canada Data Engineer Jobs Full time

    About the RoleWe are seeking a highly skilled Data Engineer to join our team at EY. As a Data Engineer, you will play a critical role in designing, developing, and maintaining scalable data pipelines and architectures within the Snowflake Data Cloud.Key ResponsibilitiesDesign and implement complex data pipelines and ETL processes within Snowflake's cloud...