ETL Developer

Found in: beBee jobs CA - 1 week ago

Toronto, Ontario, Canada GTT, LLC Full time

ETL Developer

Job Responsibilities

The ETL Developer will design, develop, and implement the ingestion framework from Oracle data source to Azure Data Lake - initial load and incremental ETL. Tools used are:
Azure Data Factory (good knowledge required) to maintain the pipeline from Oracle to Azure Data Lake
Azure Databricks/PySpark (good Python/PySpark knowledge required) to build transformations of raw data into curated zones in the data lake
Azure Databricks/PySpark/SQL (good SQL knowledge required) to develop and/or troubleshoot transformations of curated data into datamart model
Review the requirements, database tables, and database relationships - Identify gaps and inefficiencies in the current production reporting environment and provide recommendations to address them in the new platform.
The ETL Developer will design ingestion framework and CDC - tools used are Oracle Golden Gate and Azure Data Factory
Prepare design artifacts
Work with an IT partner on the configuration of Golden Gate - responsible for providing direction and "how to ".
Maintain a dynamic pipeline for ETL ingestion to add new tables and data elements
Data design - physical model mapping from data source to reporting destination.
Understand the requirements. Recommend changes to the physical model to support ETL design.
Reverse engineer and document existing SQL logic to improve design effort
Assist with data modeling and updates of source-to-target mapping documentation
Develop scripts for the physical model, and update database and/or data lake structure.
Access Oracle DB, SQL Server, and Azure environments, using SSIS, SQLDeveloper, Azure Data Studio, Azure Data Factory, Databricks, and other tools to develop solutions.
Proactively communicate with business and IT experts on any changes required to conceptual, logical and physical models, and communicate and review timelines, dependencies, and risks.
Development of ETL strategy and solution for different sets of data modules
Understand the Tables and Relationships in the data model.
Create low-level design documents and test cases for ETL development.
Create the workflows and pipeline design
Development and testing of data pipelines with Incremental and Full Load.
Develop high-quality ETL mappings/scripts/notebooks
Develop and maintain pipeline from Oracle data source to Azure Data Lake and Databricks Sql Warehouse
Develop ETL to update datamarts built-in Databricks Sql Warehouse
Perform unit testing
Ensure performance monitoring and improvement
Performance review, data consistency checks
Troubleshoot performance issues, ETL issues, and log activity for each pipeline and transformation.
Review and optimize overall ETL performance.
End-to-end integrated testing for Full Load and Incremental Load
Plan for Go Live, Production Deployment.
Create production deployment steps.
Configure parameters, scripts for go live. Test and review the instructions.
Create release documents and help build and deploy code across servers.
Go Live Support and Review after Go Live.
Review existing ETL processes, and tools and provide recommendations on improving performance and reducing ETL timelines.
Review infrastructure and remediate issues for overall process improvement
Knowledge Transfer to Ministry staff, development of documentation on the work completed.
Document work and share the ETL end-to-end design, troubleshooting steps, configuration, and script review.
Transfer documents, scripts, and review of documents to Ministry.

Experience:
Experience of 7+ years of working with SQL Server, T-SQL, Oracle, PL/SQL development or similar relational databases (must-have)
Experience of 2+ years of working with Azure Data Factory, Databricks, and Python development (must-have)
Experience building data ingestion and change data capture using Oracle Golden Gate (nice-to-have)
Experience working with building databases, data warehouses, and dimensional data marts and working with delta and full loads (must-have)
Experience in Data modeling, and tools - e.g. SAP Power Designer, Visio, or similar (must-have)
Experience with dimensional modeling. Experience in designing data warehouse solutions using slowly changing dimensions (must-have)
Experience working with SQL Server SSIS or other ETL tools, solid knowledge, and experience with SQL scripting (must-have)
Experience developing in an Agile environment
Understanding data warehouse architecture with a delta lake and dimensional model (must-have)
Ability to analyze, design, develop, test, and document ETL pipelines from detailed and high-level specifications, and assist in troubleshooting.
Ability to utilize SQL to perform DDL tasks and complex queries
Good knowledge of database performance optimization techniques
Ability to assist in the requirements analysis and subsequent developments
Ability to conduct unit testing and assist in test preparations to ensure data integrity
Work closely with Designers, Business Analysts, and other Developers
Liaise with Project Managers, Quality Assurance Analysts, and Business Intelligence Consultants
Design and implement technical enhancements of the Data Warehouse as required.

Must-Have:

7+ years using ETL tools such as Microsoft SSIS, stored procedures, T-SQL
2+ Azure Data Lake and Databricks, and building Azure Data Factory and Azure Databricks pipelines
2+ years of Python and PySpark

Skills:

Oracle Golden Gate
SQL Server
Oracle
Ability to present technical requirements to the business

Assets:

Knowledge and experience in building data ingestion, history, and change data capture using Oracle Golden Gate is an asset.

Evaluation Criteria:

Design Documentation and Analysis Skills

Demonstrated experience in creating both Functional Design Documents (FDD) & Detailed Design Documents (DDD).
Experience in Fit-Gap analysis, system use case reviews, requirements reviews, coding exercises and reviews.
Experience in the development and maintaining a plan to address contract deliverables, through the identification of significant milestones and expected results with weekly status reporting.
Work with the Client & Developer(s) assigned to refine/confirm Business Requirements
Participate in defect fixing, testing support and development activities for ETL and reporting
Analyze and document solution complexity and interdependencies by function including providing support for data validation.

Development, Database, and ETL experience

Demonstrated experience in database and ETL development (7+ years)
Experience in developing in an agile Azure DevOps environment
Experience in application mapping to populate data warehouse and dimensional data mart schemas
Demonstrated experience in Extract, Transform & Load software development (7+ years)
Experience in providing ongoing support on Azure pipeline/configuration and SqlServer SSIS development
Experience building data ingestion and change data capture using Golden Gate
Assist in the development of the pre-defined and ad-hoc reports and meet the coding and accessibility requirements.
Demonstrated experience with Oracle and SQL server databases
Proficient in SQL and Python
Implementing logical and physical data models

Knowledge Transfer

The Developer must have previous work experience in conducting Knowledge Transfer and training sessions, ensuring the resources will receive the required knowledge to support the system. The resource must develop learning activities using the review-watch-do methodology & demonstrate the ability to prepare and present.
Development of documentation and materials as part of a review and knowledge transfer to other members
Development and facilitation of classroom-based, or virtual instructor-led demo sessions for Developers
Monitor identified milestones and submission of status reports to ensure Knowledge Transfer is fully completed

Notes:
Hybrid Role- 3-days per week on site.

LI-GTT

  • Intern, Junior ETL Developer

    Found in: beBee jobs CA - 1 week ago

    Toronto, Ontario, Canada dentalcorp Full time

    This is a full time short-term internship opportunity starting May 2024 until August 2024.Application Deadline is April 16th, 2024Who you areYou are a service-oriented individual who is excited to be a part of a fast-growing organization that enables the best to be even better. You love working in a collaborative team environment, but also enjoy your...

  • Senior database developer

    Found in: beBee jobs CA - 1 week ago

    Toronto, Ontario, Canada RBC - Royal Bank Full time

    Job SummaryJob DescriptionWHAT IS THE OPPORTUNITY?At RBC Capital markets, we are looking for an experienced Database Developer to join our Client Banking Data & Digital team. The objective of the developer is to design stable, robust, and reliable database objects, and processes, to effectively manage large amounts of information.WHAT WILL YOU DO? ...

  • Business Intelligence Specialist – Senior

    Found in: beBee jobs CA - 1 week ago

    Toronto, Ontario, Canada Arthur Grand Technologies Inc Full time

    Company DescriptionArthur Grand Technologies ) is in the business of providing staffing and technology consulting services. We have doubled our revenue year over year for the past 5 years. This speaks to the long-lasting relationship and customer satisfaction that we have built in this short span of time. Our company is managed by a team of professionals who...

  • Lead Data Engineer

    Found in: beBee jobs CA - 1 week ago

    Toronto, Ontario, Canada RBC - Royal Bank Full time

    Job SummaryJob DescriptionWhat is the opportunity? The Lead Data Engineer will be responsible for developing and applying proper data architecture to optimize our ability to access and leverage data. The incumbent will create data pipelines to transform raw data, stored in a wide range of repositories, into useable datasets to enable a talented team of data...

  • Senior Development Manager

    Found in: beBee jobs CA - 1 week ago

    Toronto, Ontario, Canada RBC - Royal Bank Full time

    Job SummaryJob DescriptionRBC is seeking a Senior Development Manager to join US Cash Management (USCM) Technology team. The USCM Data, Analytics, & Insights team plays a key role in supporting the data requirements needed to support this new line of business. In this role you will be responsible for leading a team of Data Engineers and Quality Automation...

  • Lead Full Stack Developer

    Found in: beBee jobs CA - 3 days ago

    Toronto, Ontario, Canada Royal Bank of Canada Full time

    Job SummaryJob DescriptionWhat is the OpportunityRBC Royal Bank is seeking a lead full stack engineer for our US Cash Management Technology. This is a green field project to build a brand-new system to serve our corporate clients. You will be heavily involved in shaping the future technology landscape of RBC, by delivering key business values for a...

  • Solution Architect, Data

    Found in: beBee jobs CA - 1 week ago

    Toronto, Ontario, Canada Air Canada Full time

    Job Description Description Being part of Air Canada is to become part of an iconic Canadian symbol, recently ranked the best Airline in North America. Let your career take flight by joining our diverse and vibrant team at the leading edge of passenger aviation. This position may be located in Toronto or Montreal Are you looking to travel the world, work...

  • Senior Development Manager – Data, Analytics,

    Found in: beBee jobs CA - 1 week ago

    Toronto, Ontario, Canada Royal Bank of Canada Full time

    Job SummaryJob DescriptionRBC is seeking a Senior Development Manager to join US Cash Management (USCM) Technology team. The USCM Data, Analytics, & Insights team plays a key role in supporting the data requirements needed to support this new line of business. In this role you will be responsible for leading a team of Data Engineers and Quality Automation...

  • Data Operations Engineer

    Found in: beBee jobs CA - 3 days ago

    Toronto, Ontario, Canada Royal Bank of Canada Full time

    Job SummaryJob DescriptionWhat is the opportunity?With engineering mindset, working within the DNA team, to provide technical services and support for application testing, pre-production verification, and production support. You will partner with existing support team members, as well as numerous Lines of Business and will be a key player in providing...

  • Data Engineer

    Found in: beBee jobs CA - 2 days ago

    Toronto, Ontario, Canada Royal Bank of Canada Full time

    Job SummaryJob DescriptionWhat is the opportunity? As a Data Engineer, you will design, implement, and support Data Engineering solutions and processes across a global organization. We are looking for a Data Engineer with hands-on experience in designing and developing data platforms. This role brings strong data architecture and data engineering skills,...

  • Software Coding and Integration Engineer

    Found in: beBee jobs CA - 6 days ago

    Toronto, Ontario, Canada Toparo Full time

    Our client in Toronto is looking for a skilled Software Integrations Engineer to join their well-funded venture (USD 8.The venture is focused on tackling unique treasury, accounting, and asset management challenges. We're seeking a highly skilled software engineer to work on integrations to build the next generation of fintech applications. Design, develop,...

  • IT Architect

    Found in: beBee jobs CA - 1 week ago

    Toronto, Ontario, Canada Toronto Hydro Corporation Full time

    The IT Architect, is responsible for leading and promoting the enterprise architecture process within the organization including the creation of governing principles, policies, standards and procedures to guide solution decision making for the organization, and to lead the development of an implementation plan for the Enterprise Architecture program. The...

  • Remote Software Engineer

    Found in: beBee jobs CA - 1 week ago

    Toronto, Ontario, Canada Integral Full time

    We're looking for the right person...Are you a passionate and skilled Back End Software Engineer with a knack for building robust and scalable applications? Do you thrive in a collaborative environment, ready to contribute your expertise to revolutionize the fintech industry? If you're eager to work on cutting-edge technologies and contribute to impactful...

  • SAS Analyst@ Brampton, ON

    Found in: beBee jobs CA - 2 days ago

    Toronto, Ontario, Canada Atlantis IT group Full time

    Role: SAS AnalystLocation: Brampton, ONDuration: Long termRequired Skills:Proven experience with SAS programming (Base SAS and Advanced SAS). Strong expertise in SQL and experience with relational databases. Experience with ETL tools, preferably Informatica. Proficient in using SAS Enterprise Guide and SAS Viya. Familiarity with process management tools such...

  • Data Modeling Specialist

    Found in: beBee jobs CA - 2 weeks ago

    Toronto, Ontario, Canada Procom Full time

    Data Modeling Specialist - Financial Systems On behalf of our client in the Financial Services Sector, PROCOM is looking for a Data Modeling Specialist - Financial Systems. Data Modeling Specialist - Financial Systems - Job DescriptionDesign and implement data models and schemas to support analytical reporting requirements, reports, and dashboards, manage...

  • Senior I&IT Architect

    Found in: beBee jobs CA - 1 week ago

    Toronto, Ontario, Canada Ministry of Health Full time

    Effective April 1, 2024 the salary range for this position is $88,496 to $128,625 per year in compliance with AMAPCEO collective agreement provisions. The new rates, effective retroactive to April 1, 2024, were recently confirmed and dates for implementation of the new salary rates are still to be determined.Are you a Senior I&IT Architect expert looking...

  • Principal Engineer

    Found in: beBee jobs CA - 1 week ago

    Toronto, Ontario, Canada RBC - Royal Bank Full time

    Job SummaryJob DescriptionWhat is the opportunity?The Principal Engineer, Machine Learning is a hands-on leadership role responsible for driving and executing the implementation of MLOps and machine learning solutions. This role involves a combination of technical expertise, hands-on execution, and strategic thinking to drive the application of machine...

  • Senior Cloud Data Engineer, Mergers

    Found in: beBee jobs CA - 1 week ago

    Toronto, Ontario, Canada RBC - Royal Bank Full time

    Job SummaryJob DescriptionSenior Cloud Data Engineer WHAT IS THE OPPORTUNITY?As a Senior Cloud Data Engineer at RBC, the incumbent plays a pivotal role in facilitating the seamless integration of disparate data systems during pre- and post- mergers and acquisition (M&A) activities. The incumbent is responsible for architecting and implementing scalable...

  • ETL Developer

    Found in: beBee S CA - 2 weeks ago

    Toronto, Canada GTT, LLC Full time

    ETL Developer Job Responsibilities The ETL Developer will design, develop, and implement the ingestion framework from Oracle data source to Azure Data Lake - initial load and incremental ETL. Tools used are:Azure Data Factory (good knowledge required) to maintain the pipeline from Oracle to Azure Data LakeAzure Databricks/PySpark (good Python/PySpark...

  • ETL Developer

    Found in: Talent CA C2 - 6 days ago

    Toronto, Canada Maarut Inc Full time

    Job...

  • ETL Developer

    Found in: Whatjobs CA C2 - 2 days ago

    Toronto, Canada AMISEQ Full time

    MANDATORY REQUIREMENTS: 7+ years of experience in developing data conversion and migration Extensive experience in data migration in terms of digital transformation,ETL experience in migrating data from legacy applications to modernized solutions. Experience in migrating document attachments from legacy solution to a new modernized solution. Experience...

  • ETL Developer

    Found in: Appcast CA C2 Glassdoor - 3 days ago

    Toronto, Canada AMISEQ Full time

    MANDATORY REQUIREMENTS:7+ years of experience in developing data conversion and migrationExtensive experience in data migration in terms of digital transformation,ETL experience in migrating data from legacy applications to modernized solutions.Experience in migrating document attachments from legacy solution to a new modernized solution.Experience working...

  • ETL Developer

    Found in: Appcast CA A2 P - 2 days ago

    Toronto, Canada AMISEQ Full time

    MANDATORY REQUIREMENTS:7+ years of experience in developing data conversion and migrationExtensive experience in data migration in terms of digital transformation,ETL experience in migrating data from legacy applications to modernized solutions.Experience in migrating document attachments from legacy solution to a new modernized solution.Experience working...

  • Senior ETL Developer

    Found in: JG CA C2 - 4 days ago

    Toronto, Canada Procom Full time

    Senior ETL Developer On behalf of our client in the Government Services Sector, PROCOM is looking for a Senior ETL Developer. Senior ETL Developer - Job DescriptionThis role involves leading the migration of data and files from legacy systems to modernized platforms, ensuring best practice solutions and maintaining high standards of data integrity and...

  • Senior ETL Developer

    Found in: beBee S CA - 2 weeks ago

    Toronto, Canada GTT, LLC Full time

    Senior ETL Developer Job ResponsibilitiesDesign, develop, and implement ingestion framework from Oracle source to Azure Data Lake - initial load and incremental ETL. Used tools are:Azure Data Factory (expert knowledge) to maintain the pipeline from Oracle to Azure Data LakeAzure Synapse to build stored procedures and read data from the data lakeReview the...

  • ETL Developer

    Found in: Appcast CA A2 P - 7 days ago

    Toronto, Canada Maarut Inc Full time

    Knowledge & Skills MUST HAVE: • 5+ Years of experience in designing, developing, testing and implementing Extract/Transform/load (ETL) data pipelines and reporting with InfoSphere DataStage and/or Cognos • 4+ years’ experience in data modeling and working with common data warehouse models • 4+ years’ experience doing analysis and developing with...

  • ETL Developer

    1 week ago

    Toronto, Canada Maarut Inc Full time

    Knowledge & SkillsMUST HAVE:• 5+ Years of experience in designing, developing, testing and implementing Extract/Transform/load (ETL) data pipelines and reporting with InfoSphere DataStage and/or Cognos• 4+ years’ experience in data modeling and working with common data warehouse models• 4+ years’ experience doing analysis and developing with SQL...

  • ETL Developer

    7 days ago

    Toronto, Canada Maarut Inc Full time

    Knowledge & Skills MUST HAVE: • 5+ Years of experience in designing, developing, testing and implementing Extract/Transform/load (ETL) data pipelines and reporting with InfoSphere DataStage and/or Cognos • 4+ years’ experience in data modeling and working with common data warehouse models • 4+ years’ experience doing analysis and developing with...

  • ETL Developer

    7 days ago

    Toronto, Canada Maarut Inc Full time

    Knowledge & Skills MUST HAVE: • 5+ Years of experience in designing, developing, testing and implementing Extract/Transform/load (ETL) data pipelines and reporting with InfoSphere DataStage and/or Cognos • 4+ years’ experience in data modeling and working with common data warehouse models • 4+ years’ experience doing analysis and developing with...

  • ETL Developer

    7 days ago

    Toronto, Canada Maarut Inc Full time

    Knowledge & Skills MUST HAVE: • 5+ Years of experience in designing, developing, testing and implementing Extract/Transform/load (ETL) data pipelines and reporting with InfoSphere DataStage and/or Cognos • 4+ years’ experience in data modeling and working with common data warehouse models • 4+ years’ experience doing analysis and developing with...

  • ETL Developer

    Found in: Talent CA C2 - 6 days ago

    Toronto, Canada Maarut Inc Full time

    Job DescriptionJob...

  • ETL Developer

    7 days ago

    Toronto, Canada Maarut Inc Full time

    Knowledge & Skills MUST HAVE: • 5+ Years of experience in designing, developing, testing and implementing Extract/Transform/load (ETL) data pipelines and reporting with InfoSphere DataStage and/or Cognos • 4+ years’ experience in data modeling and working with common data warehouse models • 4+ years’ experience doing analysis and developing with...

  • ETL Developer

    Found in: Appcast CA A2 P - 6 days ago

    Toronto, Canada Tata Consultancy Services Full time

    About TCS TCS operates on a global scale, with a diverse talent base of more than 600,000 associates representing 153 nationalities across 55 countries. TCS has been recognized as a Global Top Employer by the Top Employers Institute - one of only eight companies worldwide to have achieved this status. Our organizational structure is domain-led and designed...

  • ETL Developer

    Found in: Whatjobs CA C2 - 2 weeks ago

    Toronto, Canada Tata Consultancy Services Full time

    About TCS TCS operates on a global scale, with a diverse talent base of more than 600,000 associates representing 153 nationalities across 55 countries. TCS has been recognized as a Global Top Employer by the Top Employers Institute - one of only eight companies worldwide to have achieved this status. Our organizational structure is domain-led and designed...

  • ETL Developer

    Found in: Appcast CA C2 Glassdoor - 2 weeks ago

    Toronto, Canada Tata Consultancy Services Full time

    About TCSTCS operates on a global scale, with a diverse talent base of more than 600,000 associates representing 153 nationalities across 55 countries. TCS has been recognized as a Global Top Employer by the Top Employers Institute - one of only eight companies worldwide to have achieved this status. Our organizational structure is domain-led and designed to...

  • ETL Developer

    Found in: Appcast CA C2 Glassdoor - 1 week ago

    Toronto, Canada Tata Consultancy Services Full time

    About TCS TCS operates on a global scale, with a diverse talent base of more than 600,000 associates representing 153 nationalities across 55 countries. TCS has been recognized as a Global Top Employer by the Top Employers Institute - one of only eight companies worldwide to have achieved this status. Our organizational structure is domain-led and designed...

  • ETL Developer

    Found in: Whatjobs CA C2 - 6 days ago

    Toronto, Canada Tata Consultancy Services Full time

    About TCS TCS operates on a global scale, with a diverse talent base of more than 600,000 associates representing 153 nationalities across 55 countries. TCS has been recognized as a Global Top Employer by the Top Employers Institute - one of only eight companies worldwide to have achieved this status. Our organizational structure is domain-led and...

  • ETL Developer

    Found in: Appcast CA A2 P - 2 weeks ago

    Toronto, Canada Tata Consultancy Services Full time

    About TCSTCS operates on a global scale, with a diverse talent base of more than 600,000 associates representing 153 nationalities across 55 countries. TCS has been recognized as a Global Top Employer by the Top Employers Institute - one of only eight companies worldwide to have achieved this status. Our organizational structure is domain-led and designed to...