Senior Cloud Data Engineer
2 weeks ago
Job Description:
This position requires a skilled Cloud Data Engineer to design, develop, and deploy large-scale data pipelines and data warehouses using technologies such as Snowflake, Databricks, and Pyspark. The ideal candidate will have a strong background in Python, SQL, and data warehousing for enterprise-level systems.
Responsibilities:
- Build and optimize data pipelines for efficient data ingestion, transformation, and loading from various sources.
- Design, develop, and deploy Spark programs in the Databricks environment to process and analyze large volumes of data.
- Experience with Delta Lake, DWH, Data Integration, Cloud, Design, and Data Modeling.
- Proficient in developing programs in Python and SQL.
- Experience with Data Warehouse Dimensional data modeling.
- Working with event-based/streaming technologies to ingest and process data.
- Working with structured, semi-structured, and unstructured data.
- Optimize Databricks jobs for performance and scalability to handle big data workloads.
- Monitor and troubleshoot Databricks jobs, identify and resolve issues or bottlenecks.
- Implement best practices for data management, security, and governance within the Databricks environment.
- Proficient in writing SQL queries and programming including stored procedures and reverse engineering existing processes.
- Perform code reviews to ensure fit to requirements, optimal execution patterns, and adherence to established standards.
Requirements:
- 5+ years Python coding experience.
- 5+ years SQL Server based development of large datasets.
- 5+ years experience with developing and deploying ETL pipelines using Databricks Pyspark.
- Experience in any cloud data warehouse like Synapse, Big Query, Redshift, Snowflake.
- Experience in Data warehousing - OLTP, OLAP, Dimensions, Facts, and Data modeling.
- Previous experience leading an enterprise-wide Cloud Data Platform migration with strong architectural and design skills.
- Experience with Cloud-based data architectures, messaging, and analytics.
- Cloud certification(s).
- Any experience with Airflow is a plus.
Job Type: Fixed term contract
Contract length: 24 months
Pay: $50.00-$70.00 per hour
Expected hours: 40 per week
Work Location: In person
-
Data Engineer
4 weeks ago
Montreal, Quebec, Canada Data Engineer Jobs Full timeMake Your Mark as a Data EngineerAre you a data enthusiast looking for a challenging role in a multinational Fortune 500 company? We have an exciting opportunity for a Data Engineer to join our team in Canada.Key Responsibilities:Design and create foundational campaign tables in Hive and Snowflake using SQL, Python, and PySpark.Collect new data points from...
-
Senior Data Engineer
9 hours ago
Montreal, Quebec, Canada Data Engineer Jobs Full timeAt NearSource Technologies, we are seeking a highly skilled Data Engineer to join our dynamic team in Montreal, Canada.We offer a competitive salary range of $120,000 - $180,000 per year, depending on experience.The ideal candidate will have a strong background in data analysis and engineering, with expertise in Python, SQL, and visualization tools like...
-
Data Engineer
4 weeks ago
Montreal, Quebec, Canada Data Engineer Jobs Full timeAs a Data Engineer on a multinational Fortune 500 project in Canada, you will shape innovative solutions and drive technological excellence. Your responsibilities will include providing guidance on optimizing the Genuine Optimized Campaign process, designing and creating foundational campaign tables in Hive and Snowflake using SQL, Python, and PySpark, and...
-
Senior Data Engineer
1 month ago
Montreal, Quebec, Canada The Globe and Mail Full timeAbout The Globe and MailThe Globe and Mail is a leading Canadian media company that delivers essential content to Canadians. We are committed to fostering diversity and inclusivity, and we strive to reflect the diversity of Canada in our stories and workforce.Job OverviewWe are seeking a Senior Data Engineer to join our team. As a Senior Data Engineer, you...
-
Senior Data Engineer
1 month ago
Montreal, Quebec, Canada The Globe and Mail Full timeAbout The Globe and MailThe Globe and Mail is a leading Canadian media company that delivers essential content to Canadians. We are committed to fostering diversity and inclusivity, and we strive to reflect the diversity of Canada in our stories and workforce.Job OverviewWe are seeking a Senior Data Engineer to join our team. As a Senior Data Engineer, you...
-
Azure Cloud Data Engineer
4 weeks ago
Montreal, Quebec, Canada https:www.energyjobline.comsitemap Full timeJob Summary:We are seeking a highly skilled Cloud Data Architect to join our team. The ideal candidate will have extensive experience in designing and implementing cloud-based data engineering solutions using Azure technologies.Key Responsibilities:Design and implement cloud-based data engineering solutions using Azure Data Factory, Synapse, and...
-
Cloud Data Architect
4 days ago
Montreal, Quebec, Canada Two95 International Inc. Full timeAbout Two95 International Inc.We are a global organization with a passion for innovation and excellence. Our team is dedicated to delivering cutting-edge solutions that transform businesses.Job Title: Cloud Data ArchitectLocation: RemoteEstimated Salary: $100,000 - $120,000 per annumThis is a contract position.About the Role:We are seeking an experienced...
-
Senior Data Engineer
2 months ago
Montreal, Quebec, Canada The Globe and Mail Full timeAbout The Globe and MailThe Globe and Mail is a leading Canadian media company that delivers essential content to Canadians. Our mission is to provide high-quality journalism, analysis, and insights that inform and engage our audience.Job OverviewWe are seeking a highly skilled Senior Data Engineer to join our team. As a Senior Data Engineer, you will play a...
-
Senior Data Engineer
2 months ago
Montreal, Quebec, Canada The Globe and Mail Full timeAbout The Globe and MailThe Globe and Mail is a leading Canadian media company that delivers essential content to Canadians. Our mission is to provide high-quality journalism, analysis, and insights that inform and engage our audience.Job OverviewWe are seeking a highly skilled Senior Data Engineer to join our team. As a Senior Data Engineer, you will play a...
-
AWS Cloud Engineer
4 weeks ago
Montreal, Quebec, Canada Groupe SII Full timeSenior Python Software Engineer - AWS Cloud ExpertWe are seeking an experienced Senior Python Software Engineer with a strong background in AWS cloud solutions to join our SUNRISE team. As a key member of our engineering team, you will be responsible for designing, developing, and deploying scalable and secure cloud-based systems using AWS services.Key...
-
Senior Cloud Data Platform Specialist
4 days ago
Montreal, Quebec, Canada Tiger Analytics Full timeJob OverviewTiger Analytics is a pioneering advanced analytics consulting firm, renowned for delivering cutting-edge data science solutions to Fortune 100 companies. As a trusted partner, we empower businesses to unlock value from their data, earning recognition from top market research firms like Forrester and Gartner.We are seeking an experienced Senior...
-
Senior Data Engineer
4 weeks ago
Montreal, Quebec, Canada Recrute Action Full timeJob Title: Senior Data EngineerWe are seeking a highly skilled Senior Data Engineer to join our team at Recruit Action. As a Senior Data Engineer, you will be responsible for designing, building, and integrating data from various resources to manage large datasets for data scientists.In this role, you will have the opportunity to work on cutting-edge...
-
Senior Data Engineer
4 weeks ago
Montreal, Quebec, Canada Recrute Action Full timeJob Title: Senior Data EngineerWe are seeking a highly skilled Senior Data Engineer to join our team at Recruit Action. As a Senior Data Engineer, you will be responsible for designing, building, and integrating data from various resources to manage large datasets for data scientists.In this role, you will have the opportunity to work on cutting-edge...
-
AWS Cloud Engineer
2 months ago
Montreal, Quebec, Canada Groupe SII Full timeSenior Python Cloud EngineerWe are seeking an experienced Senior Python Cloud Engineer to join our SUNRISE team, specializing in Data Engineering and Bioinformatics systems development. The ideal candidate will have hands-on experience with AWS, leveraging tools like AWS DataZone, AWS Bedrock, and others.Key ResponsibilitiesCollaborate with local and...
-
AWS Cloud Engineer
2 months ago
Montreal, Quebec, Canada Groupe SII Full timeSenior Python Cloud EngineerWe are seeking an experienced Senior Python Cloud Engineer to join our SUNRISE team, specializing in Data Engineering and Bioinformatics systems development. The ideal candidate will have hands-on experience with AWS, leveraging tools like AWS DataZone, AWS Bedrock, and others.Key ResponsibilitiesCollaborate with local and...
-
Senior Cloud Software Engineer
3 months ago
Montreal, Quebec, Canada Toparo Full timeOverview: One of our esteemed clients, Toparo, is on the lookout for a Senior Cloud Software Engineer dedicated to revolutionizing the logistics sector. This opportunity is more than just a role; it embodies a commitment to innovation and excellence. The dynamic nature of this position ensures that every day presents new challenges and rewards.Role Summary:...
-
Senior Cloud Software Engineer
1 month ago
Montreal, Quebec, Canada Toparo Full timeOverview: One of our esteemed clients, Toparo, is on the lookout for a Senior Cloud Software Engineer dedicated to revolutionizing the logistics sector. This opportunity is more than just a role; it embodies a commitment to innovation and excellence. The dynamic nature of this position ensures that every day presents new challenges and rewards.Role Summary:...
-
AWS Cloud Engineer
4 weeks ago
Montreal, Quebec, Canada Groupe SII Full timeSenior Python Software Engineer - AWS Cloud ExpertWe are seeking an experienced Senior Python Software Engineer with a strong background in AWS cloud services to join our team at Groupe SII. As a key member of our SUNRISE team, you will be responsible for designing, developing, and deploying cloud-based solutions using Python and AWS technologies.Key...
-
Senior Data Engineer
4 weeks ago
Montreal, Quebec, Canada https:www.energyjobline.comsitemap Full timeTransformative Data Engineer RoleThe Globe and Mail is seeking a highly skilled Senior Data Engineer to drive the transformation and optimization of our data ecosystem. As a key player in architecting scalable and efficient data pipelines, you will integrate advanced analytics and machine learning models into our infrastructure, unlocking actionable insights...
-
Senior Data Engineer
4 weeks ago
Montreal, Quebec, Canada Tiger Analytics Full timeTiger Analytics is a leading advanced analytics consulting firm, renowned for its expertise in Data Science, Machine Learning, and AI. As a trusted partner for Fortune 100 companies, we empower businesses to unlock value from data. Our leadership and business value have been recognized by market research firms, including Forrester and Gartner.We are seeking...