Lead Data Engineering Analyst

2 weeks ago

Toronto, Ontario, Canada CB Canada Full time

Design and develop state-of-the-art data analytics solutions for business problems

  1. Architect Big Data analytics frameworks and solutions to solve data driven business problems. Evaluate Tiger's existing data and analytics platforms and develop core product strategy by customizing and standardizing tools and components.
  2. Study the existing data architecture for client's big data platforms to see if the data retrieval latency and velocity is acceptable. Monitor, collect, and review business requirements, and related technology solutions. Use this information to suggest design of new big data frameworks and Data Lake solutions. Establish platform governance via data-flow-diagrams, and system reviews for all new initiatives and existing programs.
  3. Solve problems of large dimensionality (terabytes of data storage) in a computationally efficient and statistically effective manner -- use codes and modules that reduce the time to read the data and also allow machine learning algorithm to run in real time. Collect the requirement on the acceptable latency and test against that.
  4. Work on advancing emerging platform features for artificial intelligence, machine learning, advance analytics, cloud data warehousing, and metadata management by working closely with business, technical and data science teams to gather, analyze and understand business requirements, translate activities and objectives into analytical models and algorithms for application in production scale environment.
  5. Design the data pipelines so data can be used for Data Science, Machine Learning, Artificial Intelligence, Operational Research techniques. Drive personalization, real-time decision-making, causal inference and predictive analytics capabilities through the application of Machine Learning, Deep Learning, simulation and AI processes in an agile development framework.
  6. Research the academic and industrial best practices in the Big Data Analytics field to understand the trends in increasing data volume (size of data), data velocity (speed of data access), data variety (types of data available to businesses). Advise clients on the latest tools and technologies in this space


Build quantitative programs using latest analytics tools

  1. Analyze sample data sets given by the client to understand the size and type of data (structured or unstructured, text, image, video). Then provide options on the suitable big data frameworks and databases to use.
  2. Survey business users and IT teams to identify, analyze, collect, transform, and document data sets that can be used to drive business insights. Extract, transform and organize the data into datasets using tools like SQL
  3. Test solution algorithms on real-time data processing systems and benchmark performance using R, Python, etc.
  4. Validate the results of the model by developing testing framework using Hadoop, Python, etc.
  5. Build large scale fault tolerant enterprise applications using Hadoop and Big Data open source solutions such as: MR, Hive, Pig, HBase, Spark
  6. Define the data architecture and work on end to end holistic data solutions that include OLTP data stores (SQL data stores and others) , NoSQL data stores (Cassandra and others ), messaging and data movement products (such as Kafka, ActiveMQ, and others), search engine products (such as Elastic Search, and others), as well as OLAP data stores (such as Hadoop, HBase, Teradata, and others).
  7. Develop new data sources by analyzing similar use cases from the Tiger's case studies and accelerator poos. Simulate market scenarios using Python or other programming tools to create and evaluate new additions to enhance data assets.
  8. Work with multi-functional teams to access data elements, understand the data being analyzed, and identify improvement opportunities for data ingestion process.
  9. Develop repeatable testing strategies for measuring results produced by analytics models.
  10. Operationalizing an enterprise data governance strategy. Aligning policies and processes to support data strategy, data quality, regulations, and latency.

Supervise teams of Data Analysts and Data Engineers

  1. Understand the business context and suggest analytical solutions using Big data architectures based on industry knowledge
  2. Identify the parts of a data driven business problem that require Big Data solutions. Develop flow charts and solution diagrams proposal. Then discuss the proposal with client's cross-functional teams to divide project goals into specific tasks involving business analysis, data analysis and data engineering;
  3. Work with client's IT stakeholders to deploy the developed solution and make sure it can be implemented in production by the client engineering team
  4. Lead all data collection, validation, and analysis activities including risk, spend, commodity and supplier information.
  5. Deliver datasets with the appropriate characteristics for the desired usage patterns and use cases.
  6. Benchmark the developed solution for data consistency, data latency, data quality and deploy them into production.


Job Requirements:

Education Qualification: Bachelor's Degree


*Salaries may increase annually based on performance. Additional bonuses may be issued at the company's discretion and comparative market trends. If issued, the bonus may be in the form of Cash or ESOPS. COLA may be added as well at the company's discretion.

  • Lead Data Analyst

    2 weeks ago

    Toronto, Ontario, Canada Clarivate Full time

    The Lead Data Analyst, Real-World Data provides high quality, on-time input to client projects in the life sciences field. They are comfortable working with data and business processes to enable business opportunities and enhance the member and customer experience. Responsible for quality and service to the client and ensuring clients obtains maximum value...

  • Lead Data Analyst

    2 weeks ago

    Toronto, Ontario, Canada Scotiabank Full time

    Team Global Engineering and Operations Functions do you provide development and support services to Global Risk Management (GRM) in delivering regulatory and non regulatory solutions utilizing both agile and waterfall approaches. This position is related to the IFRS9 application which is used to calculate the Expected Credit Losses (ECL) Role ...

  • Data Engineer

    2 weeks ago

    Toronto, Ontario, Canada NTT DATA Services Full time

    Req ID: NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer (Snowflake/Python) - Remote Canada Position Day to Day / Job Responsibilities: As a Snowflake/Python...

  • Lead Data Engineer

    2 weeks ago

    Toronto, Ontario, Canada BMO Full time

    Job Description Application Deadline: 06/18/2024 Address: 100 King Street West Job Family Group: Data Analytics & Reporting A team lead role with deep knowledge of current data technology and data engineering practices. This role will lead a team of data engineers to build and automate databases for asset management data, including investment, market,...

  • Lead Data Engineer

    2 weeks ago

    Old Toronto, Ontario, Canada BMO Full time

    Job DescriptionApplication Deadline: 06/18/2024Address: 100 King Street WestJob Family Group: Data Analytics & ReportingA team lead role with deep knowledge of current data technology and data engineering practices. This role will lead a team of data engineers to build and automate databases for asset management data, including investment, market, and sales...

  • Data Engineer

    2 weeks ago

    Toronto, Ontario, Canada NTT DATA Services Full time

    Req ID: NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Engineer to join our team in Toronto, Ontario (CA-ON), Canada (CA).Data Engineer Responsibilities-Create and...

  • Data Transformation Lead Engineer

    2 weeks ago

    Toronto, Ontario, Canada Sunwing Vacations Group Full time

    Sunwing Vacations Group is home to North America's largest vacation brands, comprised of the leading Canadian leisure tour operators Sunwing Vacations and WestJet Vacations, along with the growing United States based tour operator Vacation Express, together with the Group's own travel retail businesses SellOffVacations.Under Sunwing Vacations , we are...

  • Senior Data Engineer

    2 weeks ago

    Toronto, Ontario, Canada NTT DATA Full time

    Job Description Req ID: NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Senior Data Engineer to join our hybrid team.Data Engineer Responsibilities- (Informatica, Snowflake,...

  • Business Analyst

    2 weeks ago

    Toronto, Ontario, Canada NTT DATA Full time

    Req ID:235679We are currently seeking a Business Analyst (Team Lead) to join our team in Toronto, Ontario (CA-ON), Canada (CA).We are seeking a Senior Business Analyst to join our team. As the Senior Business Analyst, for a small team, you will assist in the coordination, distribution and oversight of the work within the BA portfolio. Additionally you will...

  • Lead Data Engineer

    4 weeks ago

    Toronto, Ontario, Canada S&P Global Full time

    About the Role:Grade Level (for internal use):11About the Role:The Team:The S&P Global Advanced Analytics & Automation: Data Engineering team combines automation, machine learning, and data engineering to improve the delivery of Ratings data & content to our analysts and customers. The team sits within the organizations Ratings Technology and works in close...

  • Lead Data Engineer

    1 month ago

    Toronto, Ontario, Canada S&P Global Full time

    About the Role:Grade Level (for internal use):11About the Role:The Team:The S&P Global Advanced Analytics & Automation: Data Engineering team combines automation, machine learning, and data engineering to improve the delivery of Ratings data & content to our analysts and customers. The team sits within the organizations Ratings Technology and works in close...

  • Lead Data Analyst, SAS

    2 weeks ago

    Old Toronto, Ontario, Canada Scotiabank Full time

    Press Tab to Move to Skip to Content Link Select how often (in days) to receive an alert: Requisition ID: 199512Join a purpose driven winning team, committed to results, in an inclusive and high-performing culture. Team Global Engineering and Operations Functions do you provide development and support services to Global Risk Management (GRM) in...

  • Lead Data Quality Analyst

    1 month ago

    Toronto, Ontario, Canada Equifax, Inc. Full time

    Lead Data Quality Analyst - Consumer The Chief Data Office is a fast growing team critical to the Bureau's objectives of transforming into a Data and Analytics organization. It plays a critical function in building and supporting best-in-class data assets. Data is our second most important asset after our people. As such, Data Quality is a key component...

  • Lead Data Quality Analyst

    4 weeks ago

    Toronto, Ontario, Canada Equifax, Inc. Full time

    Lead Data Quality Analyst - Consumer The Chief Data Office is a fast growing team critical to the Bureau's objectives of transforming into a Data and Analytics organization. It plays a critical function in building and supporting best-in-class data assets. Data is our second most important asset after our people. As such, Data Quality is a key component...

  • Data Engineer

    2 weeks ago

    Toronto, Ontario, Canada ISG Search Inc Full time

    Senior Data Analyst Contract GTA We are looking for a data engineering with a strength in Data Warehouse, SQL, Python, and Azure cloud tools.Requirements:Understanding of SQL and data warehousing ETL processes, Python/Spark Azure Data Factory (ADF) Qualifications Expert with Data Warehouse and building ETL Extensive experience working with SQL and Python...

  • Lead Data Engineer

    2 weeks ago

    Old Toronto, Ontario, Canada Sunwing Vacations Group Full time

    April 22, 2024 About Us: Sunwing Vacations Group is home to North America's largest vacation brands, comprised of the leading Canadian leisure tour operators Sunwing Vacations and WestJet Vacations, along with the growing United States based tour operator Vacation Express, together with the Group's own travel retail businesses and Luxe Destination...

  • Data Analyst

    2 weeks ago

    Toronto, Ontario, Canada Modis Full time

    We are looking for a data analyst to join our Data Platform Team. You will be responsible for data analysis, data mapping, data modeling, governance and testing of various data sources and platforms. You will also collaborate with other data analysts, engineers, and business stakeholders to create derived consumable data products. This role includes thorough...

  • Lead Data Engineer

    2 weeks ago

    Toronto, Ontario, Canada Bank of Montreal Full time

    Lead Data Engineer (Global Asset Management) page is loaded Lead Data Engineer (Global Asset Management)Apply locations Toronto, ON, CAN time type Full time posted on Posted 6 Days Ago job requisition id R Application Deadline: 06/18/2024 Address: 10

  • Data Engineer

    2 weeks ago

    Old Toronto, Ontario, Canada The Home Depot Full time

    Data Engineer Job At The Home Depot in Toronto, ONM3C 3N6The Home Depot Canada is a unique opportunity for you to become part of a transformative team as we continue on our mission to provide the best interconnected shopping experience to our customers. As part of the Analytics team, you will be tasked with absorbing billions of rows of data from dozens of...

  • Sr Data Engineer

    4 weeks ago

    Toronto, Ontario, Canada NTT DATA Services Full time

    Req ID: NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Sr Data Engineer to join our team in Toronto, Ontario (CA-ON), Canada (CA).Data Engineer Responsibilities-Create and...