Current jobs related to AWS Data Engineer - Toronto, Ontario - AstraNorth
-
AWS Data Engineer
3 days ago
Toronto, Ontario, Canada Quantum World Technologies Inc. Full time $80,000 - $120,000 per yearRole : AWS Data EngineerLocation: Toronto, ONType : ContractMust HaveAWS Glue, Amazon Redshift, S3, ETL Process , SQL, DatabricksJob DescriptionPrimary Skills• Examining the business needs to determine the testing technique by automation testing.• Maintenance of present regression suites and test scripts is an important responsibility of the tester.•...
-
AWS Data Engineers
2 weeks ago
Toronto, Ontario, Canada Virtusa Full time $120,000 - $180,000 per yearOverall 10+ years of Experience.Migrating SSIS packages to AWS Glue would focus on a data engineer or architect with experience in ETL processes and cloud computing. The role would involve automating the migration of SSIS packages to AWS Glue using tools like AWS Schema Conversion Tool (AWS SCT) and potentially developing custom connectors. Create, build,...
-
AWS Data Engineers
1 week ago
Toronto, Ontario, Canada Virtusa Full time $120,000 - $180,000 per yearOverall 10+ years of Experience.Migrating SSIS packages to AWS Glue would focus on a data engineer or architect with experience in ETL processes and cloud computing. The role would involve automating the migration of SSIS packages to AWS Glue using tools like AWS Schema Conversion Tool (AWS SCT) and potentially developing custom connectors.Create, build, and...
-
AWS Data Engineer
2 weeks ago
Toronto, Ontario, Canada Virtusa Full time $120,000 - $180,000 per yearWe are seeking a highly skilled and experienced Data Engineer with 9 years of experience to design, develop, and maintain scalable data pipelines and infrastructure on AWS. The ideal candidate will have strong expertise in AWS Glue, Redshift, Athena, and related AWS services. The role demands end-to-end ownership of data workflows, performance optimization,...
-
AWS Data Engineer with SQL
16 hours ago
Toronto, Ontario, Canada Atlantis IT Group Full time $120,000 - $180,000 per yearRole : AWS Data Engineer with SQLLocation : Toronto, ON(Hybrid)Contract PositionJob Summary We are seeking a highly skilled Data Engineer with deep expertise in SQL (including stored procedures) and AWS-based data engineering solutions. You will be responsible for designing, building, and optimizing scalable data pipelines and systems that enable analytics,...
-
AWS Data Engineer
2 weeks ago
Toronto, Ontario, Canada Virtusa Full time $125,000 - $175,000 per yearWe are seeking a highly skilled and experienced Data Engineer with 9 years of experience to design, develop, and maintain scalable data pipelines and infrastructure on AWS. The ideal candidate will have strong expertise in AWS Glue, Redshift, Athena, and related AWS services. The role demands end-to-end ownership of data workflows, performance optimization,...
-
Senior AWS Data Engineer
3 days ago
Toronto, Ontario, Canada Kaizen Technologies Full time US$80,000 - US$180,000 per yearRole: Sr. AWS Data EngineerLocation: Toronto, ON - Day 1 OnsiteSkills: AWS, Glue, SQL, Redshift, LambdaJob Description:8+ years of experience in Data Engineer with AWS, Glue, Lambda, SQL, Python, Redshift.Must have working knowledge in designing and implementing data pipelines on any of the cloud providers (AWS is preferred).Must be able to work with large...
-
Senior AWS Data Engineer
1 week ago
Toronto, Ontario, Canada Cloudious LLC Full time $120,000 - $180,000 per yearPosition Details:Title:Senior AWS Data EngineerLocation:Toronto, ON - Hybrid Role (3 days to office a week)Type:ContractDuration:12+ months contract with possible extensionStart Date:ASAPPrimary Skills: Redshift/glue/Rds/Airflow/Lambda setupKey Responsibilities:Data Pipeline Development:Design and implement scalable ETL/ELT pipelines using AWS Glue, Lambda,...
-
AWS Data Engineer-- DWIDC5535373
3 days ago
Toronto, Ontario, Canada Compunnel Inc. Full time US$80,000 - US$1,600,000 per year8+ years of experience in Data Engineer with AWS, Glue, Lambda, SQL, Python, Redshift.Must have working knowledge in designing and implementing data pipelines on any of the cloud providers (AWS is preferred). Must be able to work with large volumes of data coming from various sources. Perform data cleansing, data validation etcHands on ETL developer who is...
-
AWS Data Engineer(10+Years)
12 hours ago
Toronto, Ontario, Canada Quantum World Technologies Inc. Full time US$100,000 - US$200,000 per yearPrimary Skills AWS Data Engineer - AWS Glue, Amazon Redshift, S3 ETL Process , SQl, DatabricksExamining the business needs to determine the testing technique by automation testing.Maintenance of present regression suites and test scripts is an important responsibility of the tester.The testers must attend agile meetings for backlog refinement, sprint...
AWS Data Engineer
2 weeks ago
Skills Required: Digital: Amazon Web Service (AWS) Cloud Computing Netezza SQL Server 2012 In-tegration Services (SSIS)
Job Description: Role and Responsibilities Understand requirement from product owners and translate into requirement and scope documents Decide on the best fitment of technologies ser-vices that are available in scope Create Solution for data ingestion and data transformation using Hadoop services like Spark, Spark streaming, Hive, etc.
Create technical design documents to com-municate solutions to the team and mentor the team to develop the solution Build the solution with Hadoop Services as per design specifications Assist team teams to build test cases and sup-port with testing the solution Coordinate with Upstream, Downstream and other supporting teams for production implementation Provide post-production support for Solutions implemented De-velop data engineering frameworks in Spark on AWS Data Lake platform Coordinate with clients, data users and key stakeholders to understand feature requirements needed merge them to cre-ate reusable design patterns Data onboarding using the developed frameworks Understand and make sense of available code in Netezza and Hadoop to design a best way to implement its current features in AWS Data Lake Unit test code and aid with QASITP erf testing Migration to production environment Please list 5 mandatory MUST HAVE skills and experience for this requirement.
Please include skills related to technical as well as domain and non-technical skills and experience as ap-plicable to the position. Candidate should have strong working experience with Hadoop platform. Strong hands-on experience on Hive, Spark with Scala. In-depth knowledge and extensive experi-ence in building batch workloads on Hadoop. Adept in analysing and refining requirements, con-sumption query patterns and choosing the right technology fit like RDBMS, data lake and data warehouse. Should have knowledge of analytical data modelling on any of the RDBMS platform Hive Should have working experience in Pentaho Proven practical experience in migrating RDBMS based data to Hadoop on-prem 7 plus years of data experience in Data warehouse and Data Lake platforms At least 2 years of implementation experience in AWS Data Lake, S3, EMR Glue, Python, AWS RDS, Amazon Redshift, Amazon Lake Formation, Airflow, Data Models, etc.
MUST have very strong knowledge of Pyspark Must understand data Encryption techniques and be able to imple-ment them. Must have experience in working with Bitbucket, Artifactory, AWS Code Pipeline Please list 5 NICE TO HAVE but not mandatory skills and experience for this requirement Hands-on expe-rience working with Terra bytes peat bytes scale data and millions of transactions per day. Skills to develop ETL pipeline using Airflow Knowledge of Spark streaming or any other streaming jobs Abil-ity to deploy code using AWS Code Pipeline and Bit bucket is an added plus Expert in any of the following programming language Scala, Java and comfortable with working on Linux platform. Knowledge of Pythonic pipeline design AWS Cloud Infrastructure for services like S3, Glue, Secrets manager, KMS, Lambda, etc
etc
Exp Required: 6
Job Types: Full-time, Fixed term contract
Work Location: Hybrid remote in Toronto, ON
