AWS Data Engineer

1 week ago

Toronto, Canada Astra North Infoteck Inc. Full time

Job DescriptionJob Location• TorontoRequired skills• Digital : Snowflake• Microsoft SQL Server 2019• Cognos Data Integration• Digital : CUE - UI / Interaction DesignExperience range• 6 to 8 yearsJob description• Design and implement Redshift data models (starsnowflake) optimized for analytics, reporting, and high concurrency workloads.• Develop and tune SQL (CTASINSERT, window functions, distribution sort keys) to deliver performant queries at scale.• Build ELTETL pipelines into Redshift using AWS Glue, Lambda, and S3 orchestrate jobs, handle schema evolution, and ensure data quality.• Optimize query performance and workload management (WLMAuto WLM, concurrency scaling, result caching) to meet stringent UX and SLA needs.• Implement secure data access controls (IAM, Redshift RBAC, schema object permissions, column row level security) aligned with audit requirements.• Enable audit friendly logging and observability (Redshift audit logs, STLSVL system tables, CloudWatch metrics alarms) for compliance and troubleshooting.• Manage data ingestion patterns (COPYUNLOAD, Spectrum External tables) across S3 and federated sources ensure efficient file formats partitioning.• Collaborate with application API teams to define data contracts and serve performant query endpoints for Nodebased APIs and UI integrations.• Implement serverless patterns that interface with Redshift (Lambda functions, event-driven loads, S3 triggers) for scalable data services.• Drive CICD automation for Redshift objects (schemas, views, stored procedures, Spectrum definitions) and pipeline code enforce testing gates.• Monitor and remediate performance issues (vacuumsort maintenance, analyze statistics, slot utilization) across UIAPI data paths.• Ensure data reliability via validation, reconciliation checks, and rollback strategies for batch and streaming loads.• Maintain cost efficiency (compression encodings, distribution strategy, concurrency scaling controls) while safeguarding performance.• Partner with data engineering product teams to prioritize backlog, refine requirements, and deliver high quality data features.• Document standards and best practices (naming, versioning, deployment playbooks) and mentor peers on Redshift and AWS data services.RequirementsExperience (Years): 8-10

  • AWS Data Engineer

    2 weeks ago

    Toronto, Ontario, Canada XChange Software Inc Full time

    Role:AWSDataEngineerLocation: Toronto, ON (Onsite)Full-timeJob Description:10+ years of experiencePrimary Skills AWS Data Engineer - AWS Glue, Amazon Redshift, S3 ETL Process , SQL, DatabricksExamining the business needs to determine the testing technique by automation testing.Maintenance of present regression suites and test scripts is an important...

  • AWS Data Engineering

    3 weeks ago

    Toronto, Canada Compunnel, Inc. Full time

    We are seeking a skilled AWS Data Engineer with expertise in building scalable data pipelines and cloud-native platforms. The ideal candidate will have hands-on experience with AWS services such as Redshift, Glue, RDS, Lambda, and Airflow, and will be responsible for designing, implementing, and maintaining robust data engineering workflows that support...

  • AWS Data Engineering

    3 weeks ago

    Toronto, Canada Compunnel, Inc. Full time

    We are seeking a skilled AWS Data Engineer with expertise in building scalable data pipelines and cloud-native platforms. The ideal candidate will have hands-on experience with AWS services such as Redshift, Glue, RDS, Lambda, and Airflow, and will be responsible for designing, implementing, and maintaining robust data engineering workflows that support...

  • AWS Data Engineering

    2 weeks ago

    Toronto, Canada Compunnel, Inc. Full time

    We are seeking a skilled AWS Data Engineer with expertise in building scalable data pipelines and cloud-native platforms. The ideal candidate will have hands-on experience with AWS services such as Redshift, Glue, RDS, Lambda, and Airflow, and will be responsible for designing, implementing, and maintaining robust data engineering workflows that support...

  • AWS Data Engineer

    5 hours ago

    Toronto, Ontario, Canada Quantum World Technologies Inc. Full time

    Role : AWS Data EngineerLocation: Toronto, ONType : ContractMust HaveAWS Glue, Amazon Redshift, S3, ETL Process , SQL, DatabricksJob DescriptionPrimary Skills• Examining the business needs to determine the testing technique by automation testing.• Maintenance of present regression suites and test scripts is an important responsibility of the tester.•...

  • AWS Data Engineers

    3 weeks ago

    Toronto, Canada Virtusa Full time

    Overall 10+ years of Experience. Migrating SSIS packages to AWS Glue would focus on a data engineer or architect with experience in ETL processes and cloud computing. The role would involve automating the migration of SSIS packages to AWS Glue using tools like AWS Schema Conversion Tool (AWS SCT) and potentially developing custom connectors. Responsibilities...

  • AWS Data Engineers

    3 weeks ago

    Toronto, Canada Virtusa Full time

    Overall 10+ years of Experience. Migrating SSIS packages to AWS Glue would focus on a data engineer or architect with experience in ETL processes and cloud computing. The role would involve automating the migration of SSIS packages to AWS Glue using tools like AWS Schema Conversion Tool (AWS SCT) and potentially developing custom connectors. Responsibilities...

  • AWS Data Engineers

    3 weeks ago

    Toronto, Canada Virtusa Full time

    Job Title P1-C2-TSTS Responsibilities Migrating SSIS packages to AWS Glue would focus on a data engineer or architect with experience in ETL processes and cloud computing. The role would involve automating the migration of SSIS packages to AWS Glue using tools like AWS Schema Conversion Tool (AWS SCT) and potentially developing custom connectors. Create,...

  • AWS Data Engineers

    3 weeks ago

    Toronto, Canada Virtusa Full time

    Job Title P1-C2-TSTS Responsibilities Migrating SSIS packages to AWS Glue would focus on a data engineer or architect with experience in ETL processes and cloud computing. The role would involve automating the migration of SSIS packages to AWS Glue using tools like AWS Schema Conversion Tool (AWS SCT) and potentially developing custom connectors. Create,...

  • AWS Data Engineers

    1 week ago

    Toronto, Ontario, Canada Virtusa Full time

    Overall 10+ years of Experience.Migrating SSIS packages to AWS Glue would focus on a data engineer or architect with experience in ETL processes and cloud computing. The role would involve automating the migration of SSIS packages to AWS Glue using tools like AWS Schema Conversion Tool (AWS SCT) and potentially developing custom connectors.Create, build, and...