Data Engineer

Found in: Appcast CA C2 Glassdoor - 1 week ago

Markham, Canada Workday Full time

Individually we are people, but together we are Aviva. Individually these are just words, but together they are our Values – Care, Commitment, Community, and Confidence.

We are looking for a collaborative and resourceful Data Engineer/ETL Developer. You are dedicated, naturally inquisitive and are comfortable in a fast-paced environment.

This role will be part of and a member of our Data Delivery Group, you will be responsible for analysis, design and implementation in high-performing, experienced team. You'll be required to apply your depth of knowledge and expertise to all many areas including requirements, infrastructure, and solutioning. Aviva has embarked on an exciting journey to modernize, craft and build a next generation of data platform to support the growing data needs for data engineering, analytics and Data Science.

We embrace a culture challenging the status quo and constantly look to efficiently simplify processes, technology, and workflow.

This position reports to the AVP – Data Delivery.

What you’ll do

  • Design and Develop ETL Pipeline to ingest data into Hadoop from different data sources (Files, Mainframe, Relational Sources, NoSQL Etc.) using Informatica BDM
  • Parse unstructured data, semi structured data such as JSON, XML etc. using Informatica Data Processor.
  • Analyze the Informatica PowerCenter Jobs and redesign and develop them in BDM.
  • Design and develop efficient Mapping and workflows to load data to Data Marts.
  • Perform the GAP analysis between various legacy applications to migrate them to newer platforms/data marts.
  • Write efficient queries in Hive or Impala and PostgreSQL to extract data on Adhoc basis to do the data analysis.
  • Identify the performance bottlenecks in ETL Jobs and tune their performance by enhancing or redesigning them.  
  • Work with Hadoop administrators, Postgres DBAs to partition the hive tables, refresh metadata and various other activities, to enhance the performance of data loading and extraction.
  • Performance tuning of ETL mappings and queries.
  • Write simple or medium complex shell scripts to preprocess the files, schedule ETL jobs etc.
  • Identify various manual processes, queries etc. in the Data and BI areas, design and develop ETL Jobs to automate them.
  • Participate in daily scrums; work with vendor partners, QA team and business users in various stages of development cycle.
  • Advocate importance of data catalogs, data governance and data quality practices.
  • Outstanding problem solving skills
  • Work in an Agile delivery framework to evolve data models and solution designs to deliver value incrementally.
  • You are a self-starter with experience working in a fast-paced agile development environment.

What you’ll bring

  • University degree in Computer Engineering or Computer Science
  • 3+ years of experience working on Informatica BDM platform.
  • Experience on various execution modes in BDM such Blaze, Spark, Hive, Native.
  • 3+ years of experience working on Hadoop Platform, writing hive or impala queries.
  • 5+ years of experience working on relational databases (Oracle, Teradata, PostgreSQL etc.) and writing SQL queries.
  • Should have deep knowledge on performance tuning of ETL Jobs, Hadoop Jobs, SQL’s, Partitioning, Indexing and various other techniques.
  • Experience in writing Shell scripts.
  • Experience in Spark Jobs (Python or Scala) is an asset.
  • Knowledge/experience in Cloud Data Lake Design – pref AWS technologies like S3, EMR, Redshift, Snowflake, could data catalog etc.,
  • Understanding of reporting/analytics tools (QlikSense, SAP Business Objects, SAS, DataIku, etc.,)
  • Familiar with the Agile software development
  • Excellent verbal and written communication skills
  • Insurance knowledge an asset-Ability to foundationally understand complex business process driving technical systems.

What you’ll get

  • Competitive rewards package including base compensation, eligibility for annual bonus, retirement savings, share plan, health benefits, personal wellness, and volunteer opportunities.
  • Exceptional Career Development opportunities.
  • We’ll support your professional development education.

Additional Information: Aviva Canada has an accommodation process in place to provide accommodations for employees with disabilities. If upon commencement of employment you require a specific accommodation because of a disability, please contact your Talent Acquisition Partner so that an appropriate accommodation can be arranged. This process applies throughout your career with Aviva Canada.

  • AVP - Data Engineering

    Found in: Appcast CA C2 Glassdoor - 1 week ago

    Markham, Canada Workday Full time

    Individually we are people, but together we are Aviva. Individually these are just words, but together they are our Values – Care, Commitment, Community, and Confidence.We are looking for a forward-thinking AVP - Data Engineering to join and be part of our growing multidisciplinary team. This position will be reporting to the VP – Software Engineering...

  • AVP - Data Engineering

    Found in: Appcast CA A2 P - 7 days ago

    Markham, Canada Workday Full time

    Individually we are people, but together we are Aviva. Individually these are just words, but together they are our Values – Care, Commitment, Community, and Confidence.We are looking for a forward-thinking AVP - Data Engineering to join and be part of our growing multidisciplinary team. This position will be reporting to the VP – Software Engineering...

  • Senior Data Engineer

    Found in: Appcast CA C2 Glassdoor - 1 week ago

    Markham, Canada Workday Full time

    Individually we are people, but together we are Aviva. Individually these are just words, but together they are our Values – Care, Commitment, Community, and Confidence.We are looking for a collaborative and resourceful Senior Data Engineer. You are dedicated, naturally inquisitive and are comfortable in a fast-paced environment.This role will be part of...

  • Senior Data Engineer

    Found in: Appcast CA A2 P - 7 days ago

    Markham, Canada Workday Full time

    Individually we are people, but together we are Aviva. Individually these are just words, but together they are our Values – Care, Commitment, Community, and Confidence.We are looking for a collaborative and resourceful Senior Data Engineer. You are dedicated, naturally inquisitive and are comfortable in a fast-paced environment.This role will be part of...

  • Clinical Data Architect

    Found in: Talent CA C2 - 7 days ago

    Markham, Canada Astellas Pharma Inc. Full time

    Job Description Astellas Canada – Clinical Data Architect & EngineerAt Astellas, we strive to become a cutting-edge, value-driven life science innovator. This means working at the forefront of healthcare change to turn innovative science into VALUE for patients. What sets us apart is our focus on patients, our pioneering innovation, our collaborative...

  • Clinical Data Architect

    Found in: Talent CA C2 - 7 days ago

    Markham, Canada Astellas Full time

    Astellas Canada – Clinical Data Architect & Engineer At Astellas, we strive to become a cutting-edge, value-driven life science innovator. This means working at the forefront of healthcare change to turn innovative science into VALUE for patients.  What sets us apart is our focus on patients, our pioneering innovation, our collaborative culture, and the...

  • Software Engineer

    6 days ago

    Markham, Canada Huawei Technologies Canada Co., Ltd. Full time

    Our team has an immediate 12-month contract opening for a Software Engineer. Responsibilities: Work with a team of architects and engineers to design and develop framework/engine for the next-generation serverless data analytics and cloud.Deeply analyze and optimize software system performance.Learn and adopt new technologies (parallel, distributed systems,...

  • Software Engineer

    2 weeks ago

    Markham, Canada Huawei Technologies Canada Co., Ltd. Full time

    Our team has an immediate 12-month contract opening for a Software Engineer. Responsibilities: Work with a team of architects and engineers to design and develop framework/engine for the next-generation serverless data analytics and cloud.Deeply analyze and optimize software system performance.Learn and adopt new technologies (parallel, distributed systems,...

  • Software Engineer

    7 days ago

    Markham, Canada Huawei Technologies Canada Co., Ltd. Full time

    Our team has an immediate 12-month contract opening for a Software Engineer. Responsibilities: Work with a team of architects and engineers to design and develop framework/engine for the next-generation serverless data analytics and cloud.Deeply analyze and optimize software system performance.Learn and adopt new technologies (parallel, distributed systems,...

  • Senior Engineer

    6 days ago

    Markham, Canada Huawei Technologies Canada Co., Ltd. Full time

    Our team has an immediate permanentopening for aSenior Engineer. Responsibilities: Design, develop, and implement new features and architecture design of the integration of big data and AI projectsAnalyze the software requirements and software elements for system designParticipate in different open source and standard meetings to present solutionsUnderstand...

  • Senior Engineer – FPGA Acceleration for Big Data Analytics

    6 days ago

    Markham, Canada Huawei Full time

    Our team has an immediate permanentopening for a Senior Engineer. Responsibilities: Design, develop, and implement new features and architecture designof new computing infrastructure and ASIC chips for data intensive applicationCreate and develop innovative new features for accelerating the data analyticUnderstand business and technical needs and work...

  • Senior Engineer – FPGA Acceleration for Big Data Analytics

    2 weeks ago

    Markham, Canada Huawei Full time

    Our team has an immediate permanentopening for a Senior Engineer. Responsibilities: Design, develop, and implement new features and architecture designof new computing infrastructure and ASIC chips for data intensive applicationCreate and develop innovative new features for accelerating the data analyticUnderstand business and technical needs and work...

  • Senior Engineer – FPGA Acceleration for Big Data Analytics

    7 days ago

    Markham, Canada Huawei Full time

    Our team has an immediate permanentopening for a Senior Engineer. Responsibilities: Design, develop, and implement new features and architecture designof new computing infrastructure and ASIC chips for data intensive applicationCreate and develop innovative new features for accelerating the data analyticUnderstand business and technical needs and work...

  • Software Engineer

    Found in: Jooble CA O C2 - 1 week ago

    Markham, ON, Canada Huawei Technologies Canada Co., Ltd. Full time

    Our team has an immediate 12-month contract opening for a Software Engineer. Responsibilities: Work with a team of architects and engineers to design and develop framework/engine for the next-generation serverless data analytics and cloud. Deeply analyze and optimize software system performance. Learn and adopt new technologies (parallel, distributed...

  • Data Analyst

    1 day ago

    Markham, Canada Colas Full time

    **Subsidiary**:Miller Paving Limited Location: Markham, ON **What Does a Data Analyst Do?**: The Business Intelligence Analyst would work closely with operations and our IT team to enable senior managers to understand and present information on various tools including Power BI to enable better business decisions. **As a Data Analyst, You Will**: -...

  • Senior Engineer

    Found in: Jooble CA O C2 - 1 week ago

    Markham, ON, Canada Huawei Technologies Canada Co., Ltd. Full time

    Our team has an immediate permanentopening for a Senior Engineer. Responsibilities : Design, develop, and implement new features and architecture design of the integration of big data and AI projects Analyze the software requirements and software elements for system design Participate in different open source and standard meetings to present solutions...

  • Senior Data Analyst

    Found in: Talent CA C2 - 7 days ago

    Markham, Canada Aviva Full time

    Individually we are people, but together we are Aviva. Individually these are just words, but together they are our Values – Care, Commitment, Community, and Confidence.  We are seeking a collaborative and resourceful Senior Data Systems Analyst for our fast-paced Technology Delivery Data function at Aviva Canada. You will be part of the data systems...

  • Senior Engineer

    Found in: Jooble CA O C2 - 1 week ago

    Markham, ON, Canada Huawei Full time

    Our team has an immediate permanentopening for a Senior Engineer . Responsibilities : Design, develop, and implement new features and architecture designof new computing infrastructure and ASIC chips for data intensive application Create and develop innovative new features for accelerating the data analytic Understand business and technical needs and...

  • Data Centre Co-oplt

    1 day ago

    Markham, Canada Advanced Micro Devices, Inc Full time

    Overview: **WHAT YOU DO AT AMD CHANGES EVERYTHING** We care deeply about transforming lives with AMD technology to enrich our industry, our communities, and the world. Our mission is to build great products that accelerate next-generation computing experiences - the building blocks for the data center, artificial intelligence, PCs, gaming and embedded....

  • Technical VP

    Found in: Talent CA C2 - 7 days ago

    Markham, Canada Huawei Technologies Canada Co., Ltd. Full time

    Our team has an immediate permanent opening for a Technical VP.Responsibilities:Take the lead in driving technical innovation across the entire big data stack. Spearhead the development of forward-thinking solutions and contribute to the evolution of cutting-edge technologies. Specifically, oversee the design and innovation of Hardware-Software co-design...