Senior Software Developer ETL

Do you have proficiency in Azure Data Factory, Azure Synapse workspaces, PolyBase, including knowledge of pipeline creation, data flows, integration runtimes, triggers, and monitoring? Do you have knowledge of integration technologies commonly used with Dynamics, such as DataVerse / Common Data Service (CDS), Data Entities, and APIs? If so, this would be a great opportunity for youOur client is looking for a Senior Software Developer ETL for a 6 month contract in Toronto.This is an onsite role.Advantages• Earn a competitive rate within the industry.• Location: working 7.25 hours per calendar day, sometime between 8:00 AM and 5:00 PM (excluding breaks) Monday to Friday inclusiveResponsibilities• Data Analysis: analyze the existing data in the legacy applications, understand its structure, quality, and relationships.• Data Mapping and Transformation: read the existing data migration code to understand the mapping of the data elements from the legacy application to the corresponding entities and fields in Dynamics 365 CE• Data Testing and Quality Assurance: conduct thorough testing to verify the accuracy and integrity of the migrated data; define test cases, perform data reconciliation, and address any issues or discrepancies that arise during the testing phase; develop KPIs to report on the progress, completeness, and quality of the data migration effort.• Data Migration Test Plans: Develop comprehensive test plans outlining the testing approach, scope, objectives, and the resources required for data migration quality assurance.• Data Migration Test Cases: Create detailed test cases and test scripts covering all aspects of data migration, including data extraction, transformation, loading, and validation.• Data Fix Development: Modify data migration code to address data migration issues.• Documentation: Maintain detailed documentation of test cases, test results, and any modifications made to the test plan during the project.• Ongoing Support: provide post-migration support, analyze, and address data-related issues or questions; help optimize data management processes in the new environment.• Other duties as assigned.QualificationsMust-haves:• 5+ years of proven working experience in an ETL role; strong understanding of ETL principles, including data extraction, transformation, and loading processes; knowledge of common ETL design patterns. Understanding of data pipeline architectures, Azure workflow orchestration tools, and concepts related to data ingestion, transformation, and movement.• Proficiency in Azure Data Factory, Azure Synapse workspaces, PolyBase, including knowledge of pipeline creation, data flows, integration runtimes, triggers, and monitoring.• Knowledge of integration technologies commonly used with Dynamics, such as DataVerse / Common Data Service (CDS), Data Entities, and APIs.Nice to have:• Azure cloud certifications (e.g. Azure fundamentals, Azure Data Engineer associate, Azure Database Administrator associate)• Experience with PowerApps platform, Power Automate, Dynamics CE and F&O.Desired Skills and Experience5+ years of proven working experience in an ETL role; strong understanding of ETL principles, including data extraction, transformation, and loading processes; knowledge of common ETL design patterns. Understanding of data pipeline architectures, Azure workflow orchestration tools, and concepts related to data ingestion, transformation, and movement.Experience in integrating various data sources and systems, both on-premises and in the cloud, using Azure ETL services or other ETL toolsKnowledge of integration technologies commonly used with Dynamics, such as DataVerse / Common Data Service (CDS), Data Entities, and APIs.Expertise in data transformation techniques, such as data cleansing, aggregation, enrichment, and normalization using Azure cloud technologiesUnderstanding of data quality management practices, including data profiling, data validation, and error handling within ETL processes.Understanding of data governance principles, data privacy regulations and experience working with high-sensitivity data, and knowledge of best practices for data security and compliance in Azure.Ability to monitor and troubleshoot ETL processes, optimize query performance, and implement efficient data processing techniques in Azure.Proficiency in Azure Data Factory, Azure Synapse workspaces, PolyBase, including knowledge of pipeline creation, data flows, integration runtimes, triggers, and monitoring.Strong SQL skills and experience working with Azure SQL Databases and Dataverse; good understanding of Azure storage concepts and technologies.Proficiency in scripting languages like Python, and experience with Azure-specific scripting using PowerShell or Azure CLI.Expert in data manipulation languages (T-SQL, PL/SQL), data definition languages, physical database design, data modelling, query performance analysis & tuningFamiliarity with version control systems (e.g., Azure Repos) and collaboration tools (e.g., Azure DevOps) for managing code, tracking changes, and collaborating with team members.Experience with continuous integration/continuous deployment (CI/CD) processes around DevOps, data workflows, Synapse workspaces.Experience with SQL Server Management Studio, Azure data management tools, XRM toolbox, data modeling tools (preferably, ERWIN).SummaryIf you are interested in the Senior Software Developer ETL role in Toronto, please apply online at www.randstad.ca. Qualified candidates will be contacted.Randstad Canada is committed to fostering a workforce reflective of all peoples of Canada. As a result, we are committed to developing and implementing strategies to increase the equity, diversity and inclusion within the workplace by examining our internal policies, practices, and systems throughout the entire lifecycle of our workforce, including its recruitment, retention and advancement for all employees. In addition to our deep commitment to respecting human rights, we are dedicated to positive actions to affect change to ensure everyone has full participation in the workforce free from any barriers, systemic or otherwise, especially equity-seeking groups who are usually underrepresented in Canada's workforce, including those who identify as women or non-binary/gender non-conforming; Indigenous or Aboriginal Peoples; persons with disabilities (visible or invisible) and; members of visible minorities, racialized groups and the LGBTQ2+ community.Randstad Canada is committed to creating and maintaining an inclusive and accessible workplace for all its candidates and employees by supporting their accessibility and accommodation needs throughout the employment lifecycle. We ask that all job applications please identify any accommodation requirements by sending an email to accessibility@randstad.ca to ensure their ability to fully participate in the interview process.