AWS Data Engineering
2 weeks ago
We are seeking a skilled AWS Data Engineer with expertise in building scalable data pipelines and cloud-native platforms. The ideal candidate will have hands-on experience with AWS services such as Redshift, Glue, RDS, Lambda, and Airflow, and will be responsible for designing, implementing, and maintaining robust data engineering workflows that support analytics, reporting, and machine learning initiatives. Key Responsibilities Design and implement scalable ETL/ELT pipelines using AWS Glue, Lambda, Step Functions, and related services. Integrate structured and unstructured data from diverse sources into data lakes and warehouses (e.g., S3, Redshift, RDS, Athena). Build and maintain cloud infrastructure for data analytics platforms using Terraform, CloudFormation, or similar IaC tools. Develop reusable frameworks and automation scripts to streamline data operations. Data Analytics Enablement Collaborate with data engineers, data scientists, and analysts to deliver high-quality platforms for data loading, reporting, and machine learning. Optimize data models and queries for performance and scalability. Monitoring and Maintenance Monitor data pipelines and troubleshoot issues to ensure reliability and data integrity. Implement CI/CD pipelines for data engineering workflows using GitLab, Bitbucket, Jenkins, or GitHub Actions. Security and Governance Ensure compliance with data governance and security best practices. Implement access controls and encryption for sensitive data. Required Qualifications Proficiency in Python, SQL, and PySpark. Hands-on experience with AWS services: S3, Glue, Lambda, Redshift, RDS, Athena, Step Functions. Experience with orchestration tools like Apache Airflow or MWAA. Familiarity with DevOps tools and practices (CDK, CI/CD, Git, Terraform). Strong understanding of data modeling, warehousing, and ETL processes. Preferred Qualifications Experience with big data tools (Spark, Hive, Kafka, Python, TypeScript). Knowledge of containerization (Docker, Kubernetes). Familiarity with data visualization tools (e.g., Power BI). AWS certifications (e.g., AWS Certified Data Analytics – Specialty). #J-18808-Ljbffr
-
AWS Data Engineer
1 week ago
Toronto, Ontario, Canada XChange Software Inc Full timeRole:AWSDataEngineerLocation: Toronto, ON (Onsite)Full-timeJob Description:10+ years of experiencePrimary Skills AWS Data Engineer - AWS Glue, Amazon Redshift, S3 ETL Process , SQL, DatabricksExamining the business needs to determine the testing technique by automation testing.Maintenance of present regression suites and test scripts is an important...
-
AWS Data Engineering
2 weeks ago
Toronto, Canada Compunnel, Inc. Full timeWe are seeking a skilled AWS Data Engineer with expertise in building scalable data pipelines and cloud-native platforms. The ideal candidate will have hands-on experience with AWS services such as Redshift, Glue, RDS, Lambda, and Airflow, and will be responsible for designing, implementing, and maintaining robust data engineering workflows that support...
-
AWS Data Engineering
2 weeks ago
Toronto, Canada Compunnel, Inc. Full timeWe are seeking a skilled AWS Data Engineer with expertise in building scalable data pipelines and cloud-native platforms. The ideal candidate will have hands-on experience with AWS services such as Redshift, Glue, RDS, Lambda, and Airflow, and will be responsible for designing, implementing, and maintaining robust data engineering workflows that support...
-
AWS Data Engineers
2 weeks ago
Toronto, Canada Virtusa Full timeOverall 10+ years of Experience. Migrating SSIS packages to AWS Glue would focus on a data engineer or architect with experience in ETL processes and cloud computing. The role would involve automating the migration of SSIS packages to AWS Glue using tools like AWS Schema Conversion Tool (AWS SCT) and potentially developing custom connectors. Responsibilities...
-
AWS Data Engineers
2 weeks ago
Toronto, Canada Virtusa Full timeOverall 10+ years of Experience. Migrating SSIS packages to AWS Glue would focus on a data engineer or architect with experience in ETL processes and cloud computing. The role would involve automating the migration of SSIS packages to AWS Glue using tools like AWS Schema Conversion Tool (AWS SCT) and potentially developing custom connectors. Responsibilities...
-
AWS Data Engineers
4 weeks ago
Toronto, Canada Virtusa Full timeJob Title P1-C2-TSTS Responsibilities Migrating SSIS packages to AWS Glue would focus on a data engineer or architect with experience in ETL processes and cloud computing. The role would involve automating the migration of SSIS packages to AWS Glue using tools like AWS Schema Conversion Tool (AWS SCT) and potentially developing custom connectors. Create,...
-
AWS Data Engineers
4 days ago
Toronto, Ontario, Canada Virtusa Full timeOverall 10+ years of Experience.Migrating SSIS packages to AWS Glue would focus on a data engineer or architect with experience in ETL processes and cloud computing. The role would involve automating the migration of SSIS packages to AWS Glue using tools like AWS Schema Conversion Tool (AWS SCT) and potentially developing custom connectors.Create, build, and...
-
AWS Data Engineers
2 weeks ago
Toronto, Canada Virtusa Full timeJob Title P1-C2-TSTS Responsibilities Migrating SSIS packages to AWS Glue would focus on a data engineer or architect with experience in ETL processes and cloud computing. The role would involve automating the migration of SSIS packages to AWS Glue using tools like AWS Schema Conversion Tool (AWS SCT) and potentially developing custom connectors. Create,...
-
AWS Data Engineers
2 weeks ago
Toronto, Canada Virtusa Full timeJob Title P1-C2-TSTS Responsibilities Migrating SSIS packages to AWS Glue would focus on a data engineer or architect with experience in ETL processes and cloud computing. The role would involve automating the migration of SSIS packages to AWS Glue using tools like AWS Schema Conversion Tool (AWS SCT) and potentially developing custom connectors. Create,...
-
AWS Data Engineer
1 week ago
Toronto, Canada Virtusa Full timeWe are seeking a highly skilled and experienced Data Engineer with 9 years of experience to design, develop, and maintain scalable data pipelines and infrastructure on AWS. The ideal candidate will have strong expertise in AWS Glue, Redshift, Athena, and related AWS services. The role demands end-to-end ownership of data workflows, performance optimization,...