ETL Data Engineer

NOTE: This position is currently listed as "Onsite"; however, the Assignment under this request will provisionally be "Hybrid", working 7.25 hours per calendar day, sometime between 8:00-5:00 PM (excluding lunch breaks) Monday to Friday inclusive for three (3) days onsite and two (2) days remote (offsite), unless otherwise identified. These conditions are subject to change as the OPS reflects on its current situation. During the duration of the assignment, you will be under the discretion of the Hiring Manager's requirements for the assigned Project.

Must Haves:

1. 7+ years of experience in developing and documenting ETL for data conversion and migration
2. Extensive experience in data migration and migration planning in terms of digital transformation, ETL experience in migrating data from legacy applications to modernized solutions.
3. Extensive experience with various database structures and RDMS like Oracle, MS SQL Server, Azure SQL Database, and write complex SQL queries, conduct data analysis, data validation, and solve complex technical problems
4. Experience in migrating document attachments from legacy solution to a new modernized solution.
5. Experience working in cloud DB technologies (such as Azure SQL).
6. Experience working with ETL tools such as Azure Data Factory, Informatica, etc.
7. Experience in development of documentation such as ETL mappings, data dictionaries, business case, data migration strategy and plan.
8. Knowledge and understanding of Information Management principles, concepts, policies and practices.
9. Excellent understanding of master data and transactional data concepts and interdependencies.

Description

SCOPE:

1. A senior Software Developer ETL is required to provide best practice migration solutions and oversee all facilities of the data and files migration from legacy application to a new solution

DELIVERABLES:

1. Provide best practice migration solutions and oversee all facilities of the data and files migration from legacy application to a new solution.
2. Establish a strong working relationship with clients, interact effectively at all levels and analyses legacy data and files stored in a variety of data sources and formats.
3. Analyze and complete data profiling and suggest any pre migration data cleansing activities.
4. Complete data migration strategy, data mapping, define interfaces, perform mock conversion, define enhancements and perform actual conversion.
5. Required to translate technical systems specifications into working, tested applications. This includes developing detailed programming specifications, writing and/or generating code, compiling data-driven programs, maintaining, and conducting unit tests.
6. Resolve and troubleshoot technical problems which arise during the use and operation of software packages, including technical assistance in implementation, conversion and migrations.
7. Work with importing files from heterogeneous platforms and coordinates data file migration.
8. Define testing strategy, plan and conducts testing to ensure data integrity and data comparisons.
9. Perform post migration audit and data reconciliation.
10. Generate data migration exception reporting and perform data cleansing as required.
11. Provides pre- and post-effective conversion support to business clients.

Experience and Skill Set Requirements

1. Full life-cycle data conversion experience with enterprise systems, including deployment experience.
2. Experience working with all steps of data migration activities such as data profiling, data mapping, developing data migration solutions, data validation and audit.
3. Proficiency in query languages such as SQL, PL-SQL.
4. Familiarity with and construction of complex query statements.
5. Knowledge of various database structures and RDMS like Oracle DB and MS SQL Server, Azure SQL Database, and write complex SQL queries.
6. Knowledge and understanding of mainframe data formats, data types, segments and non-relational data structures.
7. Experience ensuring the data migration solution is scalable.
8. Data analysis, investigative and logic skills with high attention to detail.
9. Experience with migrating file attachments from legacy applications to new solution.
10. Experience with data conversion scripts and various ETL tools such as Informatica, Azure Data Factory, etc.
11. Experience with overseeing /completing all tasks involved in the conversion process including data extraction, cleansing, transformation and loading.
12. Experience liaising with teams to understand to-be migration requirements.
13. Establish a strong working relationship with all groups, interact effectively with all levels of client personnel, and provide conversion support.
14. Experience completing mapping, interfaces, conversion work, documentation and verifying completeness and accuracy of converted data.
15. Experience delivering the required system changes and/or working with the development team or a dedicated conversion team to specify loads programs.
16. Experience providing support through the cutover process.
17. A team player with a track record for meeting deadlines, managing competing priorities and client relationship management experience.
18. Communication, facilitation, negotiation, consensus building, and problem-solving skills.

CRITERIA:

Criteria 1 - Data Knowledge Expertise Skills (35 Points)

1. 7+ years of experience in developing data conversion and migration.
2. At least one experience of working with migrating data from different legacy platforms to a new solution.
3. Full life-cycle data conversion experience with enterprise systems, including deployment experience.
4. Data analysis, investigative and logic skills, including the ability to troubleshoot and solve complex technical problems.
5. Experience with overseeing /completing all tasks involved in the conversion process including data extraction, profiling, cleansing, import data, manipulate data, transformation and loading.
6. Experience liaising with teams to understand to-be migration requirements.
7. Knowledge and understanding of Information Management principles, concepts, policies and practices.
8. Experience providing support through the cutover process.
9. Knowledge of data model of case management solutions and experience in data migration/conversion of large case management applications.
10. Experience with migrating attachment files from legacy applications to new solution.
11. Experience with document migration.

Criteria 2 - Technical Skills (35 Points)

1. Experience with industry leading ETL tools such as Informatica, Azure Data Factory and cloud technologies.
2. Proficiency in query languages such as Oracle SQL, PL-SQL, SQL Server, etc.
3. Exceptional level of knowledge on relationships between tables to perform and construct complex query statements from multiple data sources.
4. Knowledge of various database structures and RDMS like Oracle, MS SQL Server, Azure SQL Database, and write complex SQL queries.
5. Knowledge and understanding of mainframe data formats, data types, segments and non-relational data structures.
6. Data analysis, investigative and logic skills with high attention to details, including ability to troubleshoot and solve complex technical problems.
7. Experience with data conversion scripts and tools.
8. Experience with file migration from different file storages such as Azure BLOB, Azure file share, SharePoint, Oracle BLOBs.
9. Experience completing mapping, interfaces, conversion work, data exclusion and inclusion, documentation and verifying completeness and accuracy of converted data, including data dictionary development and updates.
10. Experience delivering the required system changes and/or working with the development team or a dedicated conversion team to specify loads programs.

Criteria 3 - Communication Skills (25 Points)

1. Communication, facilitation, negotiation, consensus building, and problem-solving skills.
2. Provide periodic status reports, present data migration strategy and approach to executives and other stakeholders.

Criteria 4 - Public Sector Experience (5 Points)

1. Previous experience working in Government or Public Sector organizations.