Data Engineer

4 weeks ago


Canada Morningstar Credit Ratings, LLC Full time

The Role:
In this role, you will take responsibility for developing automated data processing, maintaining, testing, and optimizing data pipelines that enable the end-to-end data flow of Morningstar Data Dictionary through our data platform. You are also responsible for ensuring quality of data processing that includes data security, fault tolerance, performance, scale and event based operational engineering processes. The ideal candidate will have a passion for data, metadata driven solution design and secured data processing technology, operating in Public Cloud platform. Also, candidate should demonstrate excellent problem solving, communication and a good understanding of financial investment data. Understanding data lineage management using metadata is a plus. Your track record for establishing best engineering practices, applying innovation and data pipeline management to make solid design decisions sets you apart from your peers.

 

Job responsibilities:

• Hands-on data cleaning, wrangling and preparation for Morningstar Data Dictionary content release.
• Maintain and optimize data pipelines for Morningstar Data Dictionary product through our data platform.
• Automate data workflows such as data ingestion, aggregation, and ETL processing.
• Contribute to dataset physical schema enhancements with attribute management using metadata requirements to support various use cases (for example taxonomy, data lineage, etc.)
• Partner with architect, quality assurance (QA), and business analyst (BA) to identify opportunities to improve current Morningstar Data Dictionary release process, as well as to deliver other projects according to requirements, in collaboration with program and product management, technology leadership and development teams

 

Qualifications:

• Advanced SQL skills and experience with various relational database management systems (e.g. MySQL, PostgreSQL, MS SQL, etc.)
• Experience in test driven development (TDD) practice
• Experience in container (e.g., Docker) based solution development
• Experience in applying and implementing authorization and encryption in data processing and storage level as part ETL
• Experience in physical database schema design
• 3+ years of experience with Python
• Hands-on experience with ETL tools, along with configuration driven data transformation development
• Experience with public cloud infrastructure, primarily Amazon Web Services (AWS)
• Self-motivated, excellent work ethic, strong interpersonal and communication skills
• Ability to work independently and in a team environment
• Ability to communicate complex ideas, problems and solutions in ways that are consumable by different audiences in both written and spoken manner
• Excellent problem-solving skills

 

Nice to have:

• Possess Bachelor's degree in Computer Science, Information Systems, Engineering or related field of study
• Good understanding of NoSQL databases (e.g. MongoDB, etc)
• Experience in Java programming language and framework
• Experience with working on large datasets

Morningstar is an equal opportunity employer.

100_MstarResCanad Morningstar Research, Inc. (Canada) Legal Entity

The Role:
In this role, you will take responsibility for developing automated data processing, maintaining, testing, and optimizing data pipelines that enable the end-to-end data flow of Morningstar Data Dictionary through our data platform. You are also responsible for ensuring quality of data processing that includes data security, fault tolerance, performance, scale and event based operational engineering processes. The ideal candidate will have a passion for data, metadata driven solution design and secured data processing technology, operating in Public Cloud platform. Also, candidate should demonstrate excellent problem solving, communication and a good understanding of financial investment data. Understanding data lineage management using metadata is a plus. Your track record for establishing best engineering practices, applying innovation and data pipeline management to make solid design decisions sets you apart from your peers.

 

Job responsibilities:

• Hands-on data cleaning, wrangling and preparation for Morningstar Data Dictionary content release.
• Maintain and optimize data pipelines for Morningstar Data Dictionary product through our data platform.
• Automate data workflows such as data ingestion, aggregation, and ETL processing.
• Contribute to dataset physical schema enhancements with attribute management using metadata requirements to support various use cases (for example taxonomy, data lineage, etc.)
• Partner with architect, quality assurance (QA), and business analyst (BA) to identify opportunities to improve current Morningstar Data Dictionary release process, as well as to deliver other projects according to requirements, in collaboration with program and product management, technology leadership and development teams

 

Qualifications:

• Advanced SQL skills and experience with various relational database management systems (e.g. MySQL, PostgreSQL, MS SQL, etc.)
• Experience in test driven development (TDD) practice
• Experience in container (e.g., Docker) based solution development
• Experience in applying and implementing authorization and encryption in data processing and storage level as part ETL
• Experience in physical database schema design
• 3+ years of experience with Python
• Hands-on experience with ETL tools, along with configuration driven data transformation development
• Experience with public cloud infrastructure, primarily Amazon Web Services (AWS)
• Self-motivated, excellent work ethic, strong interpersonal and communication skills
• Ability to work independently and in a team environment
• Ability to communicate complex ideas, problems and solutions in ways that are consumable by different audiences in both written and spoken manner
• Excellent problem-solving skills

 

Nice to have:

• Possess Bachelor's degree in Computer Science, Information Systems, Engineering or related field of study
• Good understanding of NoSQL databases (e.g. MongoDB, etc)
• Experience in Java programming language and framework
• Experience with working on large datasets

Morningstar is an equal opportunity employer.

100_MstarResCanad Morningstar Research, Inc. (Canada) Legal Entity

Morningstar’s hybrid work environment gives you the opportunity to work remotely and collaborate in-person each week. We’ve found that we’re at our best when we’re purposely together on a regular basis, at least three days each week. A range of other benefits are also available to enhance flexibility as needs change. No matter where you are, you’ll have tools and resources to engage meaningfully with your global colleagues.

#J-18808-Ljbffr
  • Sr Data Engineer

    1 week ago


    Canada NTT Data Vertex Software Inc. Full time

    Apply for Sr Data Engineer, Career Progress Consultants in Canada for Year of Experience on

  • Sr Data Engineer

    1 week ago


    Canada NTT Data Vertex Software Inc. Full time

    Apply for Sr Data Engineer, Career Progress Consultants in Canada for 8 - 11 Year of Experience on TimesJobs.com.

  • Lead Engineer

    4 weeks ago


    Canada Scribble Data Full time

    About Scribble Data Scribble Data is a generative AI (GenAI), machine learning (ML), and advanced analytics data products platform company. It focuses on the Annuities and Pension Risk Transfer (PRT) segments of the Insurance industry in the US, Canada, and UK. Hasper - Scribble Data's flagship product, is designed to implement and transform...

  • Data Engineering

    3 weeks ago


    Canada Shopify Full time

    About the roleData is a crucial part of Shopify's mission to make commerce better for everyone. We organize and interpret petabytes of data to provide solutions for our merchants and stakeholders across the organization. As a Data Engineer at Shopify, your primary responsibility will be to contribute to Shopify's Data Warehouse, while unlocking powerful...

  • Data Engineering

    7 days ago


    Canada Shopify Full time

    About the roleData is a crucial part of Shopify's mission to make commerce better for everyone. We organize and interpret petabytes of data to provide solutions for our merchants and stakeholders across the organization. As a Data Engineer at Shopify, your primary responsibility will be to contribute to Shopify's Data Warehouse, while unlocking powerful...

  • Data Engineer

    1 week ago


    Canada Epsilon Solutions Ltd. Full time

    Join to apply for the Data Engineer role at Epsilon Solutions Ltd. Join to apply for the Data Engineer role at Epsilon Solutions Ltd. Save this job with your existing LinkedIn profile, or create a new one. Save this job with your existing LinkedIn profile, or create a new one. Your job seeking activity is only visible to you. Email Welcome back ...

  • Data Engineer

    3 days ago


    Canada CGS (Computer Generated Solutions) Full time

    Data Engineer– Full time – Permanent PositionComputer Generated Solutions – Saint John, NBOpen for Remote workCorporate Profile:We provide custom learning solutions, channel partner enablement services and applications development. Since 1984, CGS has been delivering expert, cross-industry solutions across multiple platforms. To learn more about us,...

  • Data Engineer

    2 days ago


    Canada CGS (Computer Generated Solutions) Full time

    Data Engineer– Full time – Permanent PositionComputer Generated Solutions – Saint John, NBOpen for Remote workCorporate Profile:We provide custom learning solutions, channel partner enablement services and applications development. Since 1984, CGS has been delivering expert, cross-industry solutions across multiple platforms. To learn more about us,...

  • Data Engineer

    2 days ago


    Canada CGS (Computer Generated Solutions) Full time

    Data Engineer– Full time – Permanent Position Computer Generated Solutions – Saint John, NB Open for Remote work Corporate Profile: We provide custom learning solutions, channel partner enablement services and applications development. Since 1984, CGS has been delivering expert, cross-industry solutions across multiple platforms. To learn more about...

  • Data Engineer

    2 weeks ago


    Canada Orion eSolutions Full time

    As a Data Engineer at Orion, you will be responsible for designing, developing, and maintaining data pipelines, as well as analyzing and interpreting data to extract actionable insights. This role requires technical expertise in data engineering to support the decision-making processes across the organization. Experience: 3-7 years Job location: Remote ...

  • Data Engineer

    4 weeks ago


    Canada Wysdom Full time

    They say you only get one chance to make a great first impression. At Wysdom we’re here to change that. We exist to help our clients make a great first impression with their customers – over and over again! Conversation is the new user interface (UI). It will power everything from self-driving cars to gadgets around your home. For a conversational UI to...


  • Canada Quantum Technology Recruiting Inc. Full time

    Save this job with your existing LinkedIn profile, or create a new one. Save this job with your existing LinkedIn profile, or create a new one. Your job seeking activity is only visible to you. Email Welcome back Sign in to save Senior Data Engineer at Quantum Technology Recruiting Inc. (QTR) . Our client, a leading American delivery company based...

  • Data Engineer

    4 weeks ago


    Canada Intelliswift Software Full time

    Job Title: Data Engineer Location: Anywhere in Canada (100% remote) Duration: 12+ months Position Overview: We are seeking a highly skilled and motivated Data Engineer to join our team. The ideal candidate will have a strong background in data engineering, with expertise in DataBricks and Data Lake technologies. This role will involve designing, building,...


  • Canada The Kynetec Group Full time

    Responsibilities: - Provide leadership, support and mentorship to a small team, ensuring their professional and technical growth. - Collaborate effectively with leadership at all levels and contribute towards Data Engineering strategy and direction. - Design and develop new techniques and data pipelines to enable various insights for internal and external...

  • Senior Data Engineer

    4 weeks ago


    Canada Collage HR Full time

    Product & Technology Full Time Montreal, QC Our platform is designed to capture the real-world performance of go-to-market teams, offering a clear picture of their success and challenges. That's why we're seeking an exceptional Senior Data Engineer to join our team and contribute to this vital mission. *** Welcome to Vasco, a science-driven revenue...

  • Senior Data Engineer

    2 weeks ago


    Canada Techedinlabs Full time

    We have an opportunity for a "Senior Data Engineer" role based in Canada. Kindly review the job description provided below. This position offers full-time engagement with the flexibility of remote work, although candidates must reside within Canadian territory. Minimum Qualifications Bachelor’s degree in computer science, Engineering or related field,...

  • Lead Data Engineer

    1 week ago


    Canada Kynetec Full time

    At Kynetec, we're proud to be at the forefront of the intersection between agriculture, sustainability, and animal health. We’re redefining our industry with unparalleled insights and leading technology, whilst on an ambitious growth plan to supersede our influence from the food on our plates, to the health of our livestock and the care of our beloved pets...

  • Lead Data Engineer

    2 weeks ago


    Canada Kynetec Full time

    At Kynetec, we're proud to be at the forefront of the intersection between agriculture, sustainability, and animal health. We’re redefining our industry with unparalleled insights and leading technology, whilst on an ambitious growth plan to supersede our influence from the food on our plates, to the health of our livestock and the care of our beloved pets...

  • Lead Data Engineer

    1 week ago


    Canada Kynetec Full time

    At Kynetec, we're proud to be at the forefront of the intersection between agriculture, sustainability, and animal health. We’re redefining our industry with unparalleled insights and leading technology, whilst on an ambitious growth plan to supersede our influence from the food on our plates, to the health of our livestock and the care of our beloved pets...

  • Data Engineer/MLOps

    6 days ago


    Canada COGNITO INC Full time

    Data Engineer Location: Toronto, ON Job Description: Mandate Skills: ML OPS, Azure Data bricks, Visualization Experience, SQL, Python Job Description: Minimum 5 years of experience in Data Engineering role that involves Analyzing, organizing raw data, and building data systems & pipelines in Cloud Platform [Azure] Experienced in migrating data from...