Data Engineering Lead and Data Engineers
4 days ago
Must Have:
- Snowflake
- Databricks
- SQL
- Python
- ADF
- PySpark
- Data Warehouse Concepts
Job Description:
This position is for a Cloud Data Engineer with a background in Python, PySpark, SQL, and data warehousing for enterprise-level systems. The position calls for someone who is comfortable working with business users along with business analyst expertise in understanding Banking and Capital Markets; especially in investment banking would be a big plus. Strong Database fundamentals are a must along with PySpark coding expertise.
Major Responsibilities:
- Build and optimize data pipelines for efficient data ingestion, transformation, and loading from various sources while ensuring data quality and integrity.
- Design, develop, and deploy Spark programs in the Databricks environment to process and analyze large volumes of data.
- Experience with Delta Lake, DWH, Data Integration, Cloud, Design, and Data Modeling.
- Proficient in developing programs in Python and SQL.
- Experience with Data Warehouse dimensional data modeling.
- Work with event-based/streaming technologies to ingest and process data.
- Work with structured, semi-structured, and unstructured data.
- Optimize Databricks jobs for performance and scalability to handle big data workloads.
- Monitor and troubleshoot Databricks jobs, identify and resolve issues or bottlenecks.
- Implement best practices for data management, security, and governance within the Databricks environment. Experience designing and developing Enterprise Data Warehouse solutions.
- Proficient in writing SQL queries and programming including stored procedures and reverse engineering existing processes.
- Perform code reviews to ensure fit to requirements, optimal execution patterns, and adherence to established standards.
Skills:
- 5+ years of Python coding experience.
- 5+ years of SQL Server-based development of large datasets.
- 5+ years of experience with developing and deploying ETL pipelines using Databricks PySpark.
- Experience in any cloud data warehouse like Synapse, BigQuery, Redshift, Snowflake.
- Experience in Data Warehousing – OLTP, OLAP, Dimensions, Facts, and Data Modeling.
- Previous experience leading an enterprise-wide Cloud Data Platform migration with strong architectural and design skills.
- Experience with cloud-based data architectures, messaging, and analytics.
- Cloud certification(s).
- Strong experience in code optimizations and performance tuning.
-
Senior Data Engineer
3 days ago
Ottawa, Ontario, Canada Data Engineer Jobs Full timeJob Description:At Quantexa, we're innovating the data analytics market in ways no one else can. Our technology started out in FinTech, helping tackle serious criminal activity. Now, its potential is virtually limitless. We're a real team, collaborating and constantly engineering better solutions. As a senior data engineer, you'll bring it all together,...
-
Data Engineering Specialist
3 days ago
Ottawa, Ontario, Canada Data Engineer Jobs Full timeAbout Us:We're a collection of bright, passionate minds harnessing complexities and helping our clients and their communities. One culture, made of many. Heading in one direction - the future. At Quantexa, we have one mission: to help businesses grow, make data easier, and make the world a better place.About the Role:We're seeking a highly skilled senior...
-
Data Engineering Lead
6 days ago
Ottawa, Ontario, Canada BlackBerry Inc. Full timeAt BlackBerry Inc., we are seeking a highly skilled Data Engineering Lead to join our Cloud Services team. In this role, you will design and develop high-performance data pipelines to seamlessly transport data between systems.The successful candidate will have experience with data engineering, cloud services, and big data technologies such as Apache Spark...
-
Data Engineering Lead
3 days ago
Ottawa, Ontario, Canada Canopy Growth Full timeAbout UsAt Canopy Growth, we're dedicated to improving lives and transforming the cannabis industry. We believe in a future where cannabis is accessible, safe, and respected. As a leading cannabis company, we're committed to innovation, collaboration, and excellence.We're seeking a highly skilled Senior Data Engineer to join our IT team. In this role, you'll...
-
Lead Data Processing Systems Developer
3 days ago
Ottawa, Ontario, Canada Data Engineer Jobs Full timeYour Career Journey:You'll be working in a dynamic and collaborative environment, where you'll have the opportunity to develop your skills and advance your career. As a senior data engineer, you'll be responsible for implementing our innovative technology for various domains, including banking, insurance, government, and healthcare. You'll work closely with...
-
Data Engineer
5 days ago
Ottawa, Ontario, Canada Pinterest Full timeAbout Pinterest: Our mission is to help people find their inspiration and create a life they love. As a full stack data engineer, you'll play a crucial role in upholding this mission by developing better data platforms to empower our business teams.As a key member of our engineering team, you will work closely with business and product leads, analysts, and...
-
Data Engineer Lead
4 days ago
Ottawa, Ontario, Canada Tree Trust Full timeAbout the Team: Our data team is passionate about building innovative data solutions to drive business insights. As a Data Engineer, you'll be part of a collaborative team that values knowledge sharing, mentorship, and continuous learning.Responsibilities: You'll be responsible for designing and implementing data engineering solutions, working closely with...
-
Data Engineering Lead
3 days ago
Ottawa, Ontario, Canada Quantexa Full timeAbout QuantexaWe are a pioneering technology company that has been innovating the data analytics market since 2016. Our mission is to help businesses grow and make data easier to understand, while making the world a better place. We're not just a start-up, but we've managed to maintain a culture of passion, creativity, and collaboration.Job DescriptionAs a...
-
Quantexa Senior Data Engineer
4 days ago
Ottawa, Ontario, Canada Data Engineer Jobs Full timeJob Description: What we're all about. It isn't often you get to be part of a tech company that, since 2016, has been innovating the data analytics market in ways no one else can. Our technology started out in FinTech, helping tackle serious criminal activity. Now, its potential is virtually limitless. Working at Quantexa isn't just intellectually...
-
Cloud Data Engineering Lead
3 days ago
Ottawa, Ontario, Canada ALLTECH CONSULTING SVC INC Full timeCompany OverviewAbout ALLTECH CONSULTING SVC INC:We are a leading consulting firm specializing in data engineering solutions. Our team of experts provides cutting-edge services to help businesses optimize their data management and analysis capabilities.Job DescriptionWe are seeking a highly skilled Cloud Data Engineer to join our team. As a Cloud Data...
-
Data Engineer
5 days ago
Ottawa, Ontario, Canada Ampcus Incorporated Full timeBravens Inc., a wholly owned subsidiary of Ampcus Inc., is an information technology consulting and services company. Bravens is a leader in providing tailored staffing solutions across both IT and non-IT industries. We are in search of a highly motivated candidate to join our talented team and contribute to our ongoing success.Job Title: Data...
-
Senior Data Engineer
4 days ago
Ottawa, Ontario, Canada Canopy Growth Full timeThe CompanyAt Canopy Growth, our mission is clear: improve lives, end cannabis prohibition, and strengthen communities. We believe that cannabis can be a force for good. We're building a consumer-centric organization that is focused on sharing the transformational potential of cannabis with the world. We will achieve this through an innovative and disruptive...
-
Data Engineering Expert
7 days ago
Ottawa, Ontario, Canada Assent Full timeAssent is a leading solution for supply chain sustainability, tailored for top-tier manufacturers. Our mission is to help manufacturers navigate hidden risks in their supply chains and ensure comprehensive sustainability.We are proud to announce that we have crossed the US$100M ARR milestone, granting us Centaur Status. This achievement makes us the first...
-
Data Engineer III
4 weeks ago
Ottawa, Ontario, Canada Tbwa ChiatDay Inc Full timeSurveyMonkey is the world's most popular platform for surveys and forms, built for business—loved by users. We combine powerful capabilities with intuitive design, effectively serving every use case, from customer experience to employee engagement, market research to payment and registration forms. With built-in research expertise and AI-powered...
-
Data Engineer III
1 week ago
Ottawa, Ontario, Canada Tree Trust Full timeSurveyMonkey is the world's most popular platform for surveys and forms, built for business—loved by users. We combine powerful capabilities with intuitive design, effectively serving every use case, from customer experience to employee engagement, market research to payment and registration forms. With built-in research expertise and AI-powered...
-
Data Engineer III
7 days ago
Ottawa, Ontario, Canada Tree Trust Full timeSurveyMonkey is the world's most popular platform for surveys and forms, built for business—loved by users. We combine powerful capabilities with intuitive design, effectively serving every use case, from customer experience to employee engagement, market research to payment and registration forms. With built-in research expertise and AI-powered...
-
Electrical Engineering Team Lead
6 days ago
Ottawa, Ontario, Canada MacLean Engineering Full timeAt MacLean Engineering, we're a team of innovators who are passionate about pushing the boundaries of engineering excellence. We're looking for an experienced Electrical Engineering Team Lead to join our Human Machine Interface (HMI) team in Querétaro, Mexico or Collingwood, Ontario.The successful candidate will be responsible for leading a team of...
-
Data Engineer
5 days ago
Ottawa, Ontario, Canada Lumenalta Full timeJoin to apply for the Data Engineer - Databricks - Tech Lead role at Lumenalta.Experience Remote done Right. With over 20 years of remote experience, all 500+ staff are 100% remote, and we still grow vibrant relationships and provide exceptional opportunities for career growth while working with stellar clients on ambitious projects.What we're working...
-
Senior Data Engineer
7 days ago
Ottawa, Ontario, Canada Assent Inc. Full timeAssent is the leading solution for supply chain sustainability tailored for the world's top-tier, sustainability-driven manufacturers. Hidden risks riddle supply chains, many of which weren't built with sustainability in mind. That's where we step in. With insights from experts, Assent is the tool manufacturers trust for comprehensive sustainability.We are...
-
Senior Data Engineer
6 hours ago
Ottawa, Ontario, Canada Assent Compliance Full timeCompany DescriptionAssent is the leading solution for supply chain sustainability tailored for the world's top-tier, sustainability-driven manufacturers. Hidden risks riddle supply chains, many of which weren't built with sustainability in mind. That's where we step in. With insights from experts, Assent is the tool manufacturers trust for comprehensive...