Current jobs related to Sr. Data Engineer to designed and developed data pipelines for data ingestion using Spark and c[...] - Old Toronto - S I Systems
-
Data Engineer Data Analytics
2 weeks ago
Toronto, ON, Canada Pacific Data Integrators Full timeThe Data Engineer will support the client's OCM Self-serve platform. They will be a part of a team with Tech Lead, Business Analyst and a Data Engineer. Technical Operationalizing and maintaining data pipelines deployed to the Client's investment entities and cultivate a business relationship that assists in meeting business demands Deploying ETL/ELT...
-
Data Engineer
1 week ago
Toronto, ON, Canada Pacific Data Integrators Full timeThe Data Engineer will support the client's OCM Self-serve platform. They will be a part of a team with Tech Lead, Business Analyst and a Data Engineer.Role and Responsibilities:Technical Operationalizing and maintaining data pipelines deployed to the Client's investment entities and cultivate a business relationship that assists in meeting business...
-
Data Engineer
2 weeks ago
Toronto, Canada Pacific Data Integrators Full timeThe Data Engineer will support the client's OCM Self-serve platform. They will be a part of a team with Tech Lead, Business Analyst and a Data Engineer.Role and Responsibilities:Technical Operationalizing and maintaining data pipelines deployed to the Client's investment entities and cultivate a business relationship that assists in meeting business...
-
Data Engineer
2 weeks ago
Toronto, Canada Pacific Data Integrators Full timeThe Data Engineer will support the client's OCM Self-serve platform. They will be a part of a team with Tech Lead, Business Analyst and a Data Engineer.Role and Responsibilities:Technical Operationalizing and maintaining data pipelines deployed to the Client's investment entities and cultivate a business relationship that assists in meeting business...
-
Data Engineer
1 week ago
Toronto, Canada Pacific Data Integrators Full timeThe Data Engineer will support the client's OCM Self-serve platform. They will be a part of a team with Tech Lead, Business Analyst and a Data Engineer.Role and Responsibilities:Technical Operationalizing and maintaining data pipelines deployed to the Client's investment entities and cultivate a business relationship that assists in meeting business...
-
Data Engineer
2 weeks ago
Toronto, Canada Pacific Data Integrators Full timeThe Data Engineer will support the client's OCM Self-serve platform. They will be a part of a team with Tech Lead, Business Analyst and a Data Engineer. Role and Responsibilities: Technical Operationalizing and maintaining data pipelines deployed to the Client's investment entities and cultivate a business relationship that assists in meeting business...
-
Data Engineer
2 weeks ago
Toronto, ON, Canada Pacific Data Integrators Full timeThe Data Engineer will support the client's OCM Self-serve platform. They will be a part of a team with Tech Lead, Business Analyst and a Data Engineer. Role and Responsibilities: Technical Operationalizing and maintaining data pipelines deployed to the Client's investment entities and cultivate a business relationship that assists in meeting...
-
Data Engineer
2 weeks ago
Toronto, ON, Canada Pacific Data Integrators Full timeThe Data Engineer will support the client's OCM Self-serve platform. They will be a part of a team with Tech Lead, Business Analyst and a Data Engineer. Role and Responsibilities: Technical Operationalizing and maintaining data pipelines deployed to the Client's investment entities and cultivate a business relationship that assists in meeting business...
-
Data Architect Data Analytics
2 weeks ago
Toronto, ON, Canada Pacific Data Integrators Full timeThe Data Engineer will support the client's OCM Self-serve platform. They will be a part of a team with Tech Lead, Business Analyst and a Data Engineer. Technical Operationalizing and maintaining data pipelines deployed to the Client's investment entities and cultivate a business relationship that assists in meeting business demands Deploying ETL/ELT...
-
Sr. Data Engineer
1 month ago
Old Toronto, Canada Paytm Full timeAbout Paytm Labs:At Paytm Labs, we’re on a mission to provide useful technological solutions that enrich and empower millions of people in their daily lives. We apply big data, artificial intelligence, and machine learning to bring the next generation of financial products and services to global markets.We recently soft-launched Pi, our full end-to-end...
-
Sr. Data Engineer
2 months ago
Old Toronto, Canada Paytm Full timeAbout Paytm Labs:At Paytm Labs, we’re on a mission to provide useful technological solutions that enrich and empower millions of people in their daily lives. We apply big data, artificial intelligence, and machine learning to bring the next generation of financial products and services to global markets.We recently soft-launched Pi, our full end-to-end...
-
Sr. Data Engineer
4 weeks ago
Old Toronto, Canada Paytm Full timeAbout Paytm Labs:At Paytm Labs, we’re on a mission to provide useful technological solutions that enrich and empower millions of people in their daily lives. We apply big data, artificial intelligence, and machine learning to bring the next generation of financial products and services to global markets.We recently soft-launched Pi, our full end-to-end...
-
Sr. Data Engineer
4 weeks ago
Old Toronto, Canada Paytm Full timeAbout Paytm Labs:At Paytm Labs, we’re on a mission to provide useful technological solutions that enrich and empower millions of people in their daily lives. We apply big data, artificial intelligence, and machine learning to bring the next generation of financial products and services to global markets.We recently soft-launched Pi, our full end-to-end...
-
Data Engineer
1 week ago
Toronto, Ontario, Canada Pacific Data Integrators Full timeAbout the RolePacific Data Integrators is seeking a highly skilled Data Engineer to join our team. As a Data Engineer, you will play a critical role in supporting our client's OCM Self-serve platform.Key ResponsibilitiesDesign and implement data pipelines deployed to our client's investment entities, ensuring high reliability, scalability, and...
-
Data Architect
2 weeks ago
Toronto, Ontario, Canada Pacific Data Integrators Full timeAbout the RolePacific Data Integrators is seeking a highly skilled Data Engineer to join our team. As a Data Engineer, you will play a critical role in supporting our client's OCM Self-serve platform.Key ResponsibilitiesTechnical Operationalization: Design, implement, and maintain data pipelines deployed to our client's investment entities, ensuring high...
-
Data Architect
2 weeks ago
Toronto, Ontario, Canada Pacific Data Integrators Full timeAbout the RolePacific Data Integrators is seeking a highly skilled Data Engineer to join our team. As a Data Engineer, you will play a critical role in supporting our client's OCM Self-serve platform.Key ResponsibilitiesTechnical Operationalization: Design, implement, and maintain data pipelines deployed to our client's investment entities, ensuring high...
-
Azure Data Engineer
3 days ago
Toronto, Ontario, Canada Tata Consultancy Services Full timeAbout the RoleTata Consultancy Services is seeking a skilled Azure Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing and implementing data ingestion pipelines from multiple sources using Azure Databricks.Key ResponsibilitiesDesign and implement scalable and reusable frameworks for ingesting...
-
Azure Data Engineer
3 days ago
Toronto, Ontario, Canada Tata Consultancy Services Full timeAbout the RoleTata Consultancy Services is seeking a skilled Azure Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing and implementing data ingestion pipelines from multiple sources using Azure Databricks.Key ResponsibilitiesDesign and implement scalable and reusable frameworks for ingesting...
-
Cloud Data Engineer, Data Pipeline
2 weeks ago
Toronto, Ontario, Canada MUFG Investor Services Full timeAbout MUFG Investor ServicesWe are a leading provider of administration, asset services, banking, and fund financing solutions to over 480 global investment firms. Our team is passionate about delivering exceptional results and creating a Brilliantly Different experience for our clients.Job SummaryWe are seeking a highly skilled Data Engineer to join our...
-
Cloud Data Engineer, Data Pipeline
2 weeks ago
Toronto, Ontario, Canada MUFG Investor Services Full timeAbout MUFG Investor ServicesWe are a leading provider of administration, asset services, banking, and fund financing solutions to over 480 global investment firms. Our team is passionate about delivering exceptional results and creating a Brilliantly Different experience for our clients.Job SummaryWe are seeking a highly skilled Data Engineer to join our...
Sr. Data Engineer to designed and developed data pipelines for data ingestion using Spark and c[...]
4 months ago
Sr. Data Engineer to designed and developed data pipelines for data ingestion using Spark and create workflows using Airflow for our large banking client - 34083
Location Address: Hybrid - Downtown Toronto – 1-2 days / week (Wednesdays and Thursdays) – need candidates in GTA
Contract Duration: ASAP to Oct 31, 2024 – approx. 4 months
Possibility of extension
Schedule Hours: 9am-5pm Monday-Friday; standard 37.5 hrs/week
Story Behind the Need
Business group: Enterprise Platform Architecture & Enablement – building data pipelines from end to end
Project: Initiative working with an external vendor (fraud and know your customer technology) – ensuring data is properly ingested, structured; work in coordinating with fraud, digital teams and business partners to ensure data is effectively shaped – stage: through proof of concept, current coordination with vendor partners and ensuring their technologies align to ours, early stages and ramping up
Typical Day in Role:
Collaborate with business lines and other stakeholders and identify opportunities to drive business value by leveraging data engineer.
Efficiently handle large volumes of structured and unstructured data through ingestion, modeling, transformation, and storage across diverse data stores. Leverage distributed computing tools (e.g., Spark, Cloud) for analysis, data mining, and modeling
Collaborate with operation, and other analytics teams to deploy models and automate pipelines / workflows in production across different channels and platforms
Work with the team to design the project architecture and road map.
Create and apply model and algorithm testing strategies to measure the effectiveness of models and make ongoing changes.
Prepare detailed documentation to outline data sources, models, and algorithms used and developed.
Present results to business line stakeholders and help implement real world data-driven changes.
Candidate Requirements/Must Have Skills:
- 10+ years of progressive experience as Data Engineer.
- 5+ years’ experience with SQL/NOSQL and relational databases technologies/concepts for both querying/manipulating datasets and managing /controlling databases.
- 3+ years’ experience with Google Cloud Platform about Data Ingesting and on-prem to cloud environment data replication.
- 5+ years’ combined experience programming in Python or equivalent languages (Scala, Java), and tools such as Spark, Airflow (please list which)
Nice-To-Have Skills:
- Experience with DBT (Data Building Tool)
- Experience in creating Docker images
- Experience / knowledge of MongoDB
- Experience from banking / financial services
Education:
Bachelor’s Degree or equivalent in in Computer Science, Engineering, or relevant field.
Best VS. Average Candidate:
GCP, Python and Spark experience best for programming
MS Teams Video Interviews
1st - HM interview round – 45 minutes max
2nd - Panel technical round - 45 minutes max – potential exercise / caste study component
#J-18808-Ljbffr