Data Engineer
2 days ago
Winnipeg MB, Winnipeg Census Division, MB; Manitoba, Canada
Acestack
Full-time
Free with email or Google
Save this job and keep your search organized
Create a free account to save jobs, create alerts and return to this listing from your dashboard.
Free with email or Google
By continuing, you agree to our Terms & Privacy Policy.
Job Title:
Data EngineerJob Type:
Full TimeLocation:
Toronto, ON (Onsite)
Job Description
We are seeking an experienced Data Engineer with strong data warehouse expertise and extensive experience in the banking and financial services domain. The ideal candidate will have 12+ years of experience in data engineering and hands-on expertise designing and developing scalable data pipelines, data lakes, and data warehouses on AWS.
Key Responsibilities
Design, develop, and maintain scalable data pipelines and workflows on AWS Build and manage data lakes and data warehouses using Amazon S3 and Redshift Develop ETL/ELT processes using AWS Glue, Lambda, Spark, and related technologies Implement Kafka message processing, batch data ingestion, and business-layer data processing Optimize data ingestion, transformation, and loading processes Ensure data quality, governance, security, performance, and scalability Monitor and troubleshoot data pipelines and workflows using AWS services Automate deployments through CI/CD pipelines Collaborate with clients, data users, and stakeholders to understand requirements Develop reusable data engineering frameworks and design patterns Perform data onboarding using established frameworks Analyze existing IBM Netezza code and design migration solutions for AWS Data Lake Develop unit tests and support QA, SIT, and performance testingRequired Skills & Experience 12+ years of experience in data engineering/data warehousing Strong experience in the banking and financial services domain Hands-on expertise with Amazon S3, AWS Glue, AWS Lambda, Amazon Redshift Experience with AWS Step Functions, IAM, and CloudWatch Strong ETL/ELT and data pipeline development experience Experience with IBM Netezza and migration to AWS environments Knowledge of Kafka, Spark, and batch data processing Strong understanding of data warehouse architecture and data lake solutions Good to Have AWS Solutions Architect or Data Analytics certification Experience with Airflow or Amazon MWAA Exposure to Snowflake, Databricks, or Delta Lake Experience with CI/CD and cloud deployment practices #J-18808-Ljbffr
Job Description
We are seeking an experienced Data Engineer with strong data warehouse expertise and extensive experience in the banking and financial services domain. The ideal candidate will have 12+ years of experience in data engineering and hands-on expertise designing and developing scalable data pipelines, data lakes, and data warehouses on AWS.
Key Responsibilities
Design, develop, and maintain scalable data pipelines and workflows on AWS Build and manage data lakes and data warehouses using Amazon S3 and Redshift Develop ETL/ELT processes using AWS Glue, Lambda, Spark, and related technologies Implement Kafka message processing, batch data ingestion, and business-layer data processing Optimize data ingestion, transformation, and loading processes Ensure data quality, governance, security, performance, and scalability Monitor and troubleshoot data pipelines and workflows using AWS services Automate deployments through CI/CD pipelines Collaborate with clients, data users, and stakeholders to understand requirements Develop reusable data engineering frameworks and design patterns Perform data onboarding using established frameworks Analyze existing IBM Netezza code and design migration solutions for AWS Data Lake Develop unit tests and support QA, SIT, and performance testingRequired Skills & Experience 12+ years of experience in data engineering/data warehousing Strong experience in the banking and financial services domain Hands-on expertise with Amazon S3, AWS Glue, AWS Lambda, Amazon Redshift Experience with AWS Step Functions, IAM, and CloudWatch Strong ETL/ELT and data pipeline development experience Experience with IBM Netezza and migration to AWS environments Knowledge of Kafka, Spark, and batch data processing Strong understanding of data warehouse architecture and data lake solutions Good to Have AWS Solutions Architect or Data Analytics certification Experience with Airflow or Amazon MWAA Exposure to Snowflake, Databricks, or Delta Lake Experience with CI/CD and cloud deployment practices #J-18808-Ljbffr