Intermediate ETL Tester with AWS Glue, S3 and Athena experience to support the validation of data ac

1 week ago


Calgary, Canada S.i. Systems Full time

Our client is looking for an Intermediate ETL Tester with AWS Glue, S3 and Athena experience to support the validation of data accuracy, quality, and performance.

This role requires you to be onsite 5 days/week, working core business hours of 8-5 with free onsite parking

Must Haves:
5+ years experience as a QA specifically with ETL testing.
Experience with AWS Glue , AWS S3 , AWS Athena , AWS Lambda , and AWS DataSync
Experience working with AWS Aurora (PostgreSQL), DynamoDB , and MS SQL Server
Experience with test automation tools and frameworks.

Nice to Haves:
Experience with other AWS services such as AWS Redshift and RDS
Familiarity with Big Data technologies (e.g., Hadoop, Spark)
AWS Certification related to data analytics or data engineering

Responsibilities:
Lead the design, development, and implementation of ETL test strategies and plans.
Validate data extraction, transformation, and loading processes to ensure data quality and integrity.
Conduct detailed testing of data pipelines utilizing AWS Glue, ensuring transformations are correctly applied.
Verify data storage and retrieval from AWS S3, ensuring data consistency and accessibility.
Utilize AWS Athena to query and validate data stored in S3, applying SQL knowledge to perform complex queries.
Leverage AWS Lambda for serverless functions within the testing strategy.
Use AWS DataSync for data transfer operations and ensure data is accurately synchronized across environments.
Validate the performance and accuracy of databases such as AWS Aurora (PostgreSQL), DynamoDB, and MS SQL Server.
Create and maintain detailed documentation of test plans, test cases, and test results.
Automate testing processes where possible to streamline validation efforts.
Continuously monitor ETL processes post-deployment to identify and address any issues.
Collaborate with cross-functional teams to understand requirements and deliver high-quality test results.
Mentor and guide junior QA engineers and testers within the team.

Apply



  • Calgary, Canada S.i. Systems Full time

    Our client is looking for anIntermediate ETL Tester with AWS Glue, S3 and Athena experience to support the validation of data accuracy, quality, and performance.This role requires you to be onsite 5 days/week, working core business hours of 8-5 with free onsite parkingMust Haves: 5+ years experience as aQAspecifically withETLtesting. Experience withAWS Glue...


  • Calgary, Alberta, Calgary region, Canada KTek Resourcing Full time

    Title : ETL Tester(AWS Glue)Location : Calgary, ABMode : ContractJD : Required Qualifications:• 5+ years of experience in ETL development and data engineering.• Strong experience with AWS Glue, Lambda, DataSync, S3, Aurora (PostgreSQL), DynamoDB, and MS SQL Server.• Proficiency in SQL and data modeling techniques.• Experience with Python or other...

  • ETL Developer

    1 week ago


    Calgary, Alberta, Calgary region, Canada KTek Resourcing Full time

    Required Skills, Experience and Qualifications :Key Responsibilities :• Design, develop, and maintain ETL processes to support data extraction, transformation, and loading between source and target data stores.• Optimize and automate data pipelines to ensure high performance and reliability.• Develop data workflows and pipelines using AWS Glue for data...

  • Data Engineer

    2 days ago


    Calgary, Canada KTek Resourcing Full time

    Required Skills, Experience and Qualifications:Must Have Skills:• Experience in Developing big data solutions using S3 and Redshift / Snowflake• Experience in data migration and processing using AWS services like Glue, DataBricks, Lambda Function , Glue, Spectrum etc related to Data services• Hand on Experience in Glue and Spark for any kind of ETL or...


  • Calgary, Alberta, Canada KTek Resourcing Full time

    About KTek ResourcingWe are a leading resourcing company providing top talent to organizations across various industries.Job SummaryThis is an exciting opportunity for a highly skilled Senior Big Data Solutions Developer to join our team in KTek Resourcing. The ideal candidate will have extensive experience in developing big data solutions using S3 and...

  • Data Engineer

    3 days ago


    Calgary, Canada KTek Resourcing Full time

    Required Skills, Experience and Qualifications:Must Have Skills:• Experience in Developing big data solutions using S3 and Redshift / Snowflake• Experience in data migration and processing using AWS services like Glue, DataBricks, Lambda Function , Glue, Spectrum etc related to Data services• Hand on Experience in Glue and Spark for any kind of ETL or...

  • Data Engineer

    3 days ago


    Calgary, Canada KTek Resourcing Full time

    Required Skills, Experience and Qualifications: Must Have Skills: • Experience in Developing big data solutions using S3 and Redshift / Snowflake • Experience in data migration and processing using AWS services like Glue, DataBricks, Lambda Function , Glue, Spectrum etc related to Data services • Hand on Experience in Glue and Spark for any kind of ETL...

  • Data Engineer

    3 days ago


    Calgary, Canada KTek Resourcing Full time

    Required Skills, Experience and Qualifications:Must Have Skills:• Experience in Developing big data solutions using S3 and Redshift / Snowflake• Experience in data migration and processing using AWS services like Glue, DataBricks, Lambda Function , Glue, Spectrum etc related to Data services• Hand on Experience in Glue and Spark for any kind of ETL or...

  • Data Engineer

    1 day ago


    Calgary, AB, Canada KTek Resourcing Full time

    Required Skills, Experience and Qualifications: Must Have Skills: - Experience in Developing big data solutions using S3 and Redshift / Snowflake - Experience in data migration and processing using AWS services like Glue, DataBricks, Lambda Function, Glue, Spectrum etc related to Data services - Hand on Experience in Glue and Spark for any kind of ETL or...

  • Data Engineer

    3 days ago


    Calgary, Alberta, Calgary region, Canada KTek Resourcing Full time

    Required Skills, Experience and Qualifications:Must Have Skills:• Experience in Developing big data solutions using S3 and Redshift / Snowflake• Experience in data migration and processing using AWS services like Glue, DataBricks, Lambda Function , Glue, Spectrum etc related to Data services• Hand on Experience in Glue and Spark for any kind of ETL or...

  • Senior Data Architect

    23 hours ago


    Calgary, Alberta, Canada KTek Resourcing Full time

    About the RoleWe are seeking a highly skilled Data Systems Engineer to join our team at KTek Resourcing.Job DescriptionThis is an exciting opportunity for someone who wants to work with cutting-edge technologies and make a significant impact on our data infrastructure.ResponsibilitiesDeveloping Big Data SolutionsDesign, implement, and maintain large-scale...


  • Calgary, Alberta, Canada The University of Calgary Full time

    About the Opportunity: We are seeking a skilled Junior Data Engineer to join our team at the University of Calgary. As a key member of the Libin Precision Medicine Initiative (LPMI) team, you will play a vital role in supporting the development and implementation of innovative cardiac data management pipelines.Job Summary: The successful candidate will...

  • Project Systems

    4 weeks ago


    Calgary, Canada TC Energy Full time

    Determined. Imaginative. Curious. If these are some of the ways you describe yourself — we want to learn more about you! At TC Energy, we are Energy Problem Solvers — passionate about transitioning North America to cleaner energy while meeting the energy demands of today and tomorrow. If that sounds like a challenge you want to help tackle, we want you...

  • Data Engineer II Lead

    3 weeks ago


    Calgary, Alberta, Canada Bazaarvoice Full time

    About This Role:As a seasoned Data Engineer II Lead at Bazaarvoice, you will play a pivotal part in shaping our data engineering platform. Your primary responsibility will be to design and implement innovative data pipelines that drive business growth and improve current workflows.Your Impact:Create cutting-edge data solutions to support the launch of new...

  • AWS SRE Engineer

    6 days ago


    Calgary, Canada ZayZoon Full time

    p>WHO WE AREOur goal is to save ten-million hard-working employees ten-billion dollars. We are a values driven, well-funded, and fast-growing Financial Technology and HR company. span>We’ve created a financial empowerment platform that helps small but mighty HR teams make a big impact on employee financial wellness. ZayZoon is quickly becoming the employee...

  • SAP Project Systems

    1 week ago


    Calgary, Canada TC Energie Full time

    Determined. Imaginative. Curious. If these are some of the ways you describe yourself — we want to learn more about you! At TC Energy, we are Energy Problem Solvers — passionate about transitioning North America to cleaner energy while meeting the energy demands of today and tomorrow. If that sounds like a challenge you want to help tackle, we want you...


  • Calgary, Alberta, Canada Bazaarvoice Full time

    Job OverviewWe are seeking a highly skilled Data Engineer II to join our team at Bazaarvoice. The successful candidate will be responsible for working on our data engineering platform to launch new data pipelines and improve current workflows.About YouTo be considered for this role, you should have a Bachelor's degree in Computer Science or a related field,...

  • Senior Data Engineer

    3 weeks ago


    Calgary, Alberta, Canada Artech LLC Full time

    Job Title:Sr. Data Engineer - Cloud ArchitectAbout the Role:We are seeking a highly skilled Senior Data Engineer to join our team at Artech LLC. This role will be responsible for designing and implementing scalable ingestion frameworks, leveraging 6+ years of data engineering experience.Key Responsibilities:Design and implement scalable ingestion frameworks...

  • Software Engineer

    4 weeks ago


    Calgary, Alberta, Canada Trafigura Group Full time

    Job DescriptionTrafigura Group is seeking a skilled Software Engineer to work directly with traders and research analysts in our trading teams. This is an exciting opportunity to work in a fast-paced commercial setting, playing a vital role in a real-time, data and software-driven trading environment.As a member of the global data science and engineering...


  • Calgary, Alberta, Canada Artech LLC Full time

    Job OverviewWe are seeking a highly skilled IT professional to fill a Software Engineering role as an Application Developer with Artech LLC. This 6-month contract opportunity is fully remote and based in Calgary, Alberta.About the JobThis exciting project involves designing and implementing scalable data ingestion frameworks using AWS services such as...