ETL Developer

4 weeks ago

Toronto, Canada Atlantis IT Group Full time

Role name: Data Bricks/ETL Developer

Role Description: ? Designing and implementing efficient data ingestion pipelines from multiple sources using Azure Data factory and/or Azure Databricks? Integrating the end-to-end data pipeline to take data from different source systems to target data repositories ensuring the quality and consistency of data.? Processing performance analysis and code optimization.

Competencies: Digital : Microsoft Azure

Experience (Years): 6-8

Essential Skills: ? Strong knowledge of Data Management and Principles? At least over 3 years of experience in Azure Enterprise data lake development, with 6 ? 8 years of total experience in Data Warehousing.? Hands-on experience designing and delivering solutions using Azure Data Lake? Experience in building ETL/ELT/ data warehouse? Experience of building data pipelines using Azure Data Factory and Apache Spark (preferably PySpark in Databricks).? Experience in working with structured and semi-structured data from various sources like blob (json/avro | delimited flat files | parquet... etc.) , rdbms etc.? Adept in Structured Query Language.? Ability to apply spark Dataframe api to complete data manipulation within Spark Session? Good understanding of Spark Architecture including spark core, spark sql, dataframe, driver node, worker node, fault tolerance, collection, executors and tasks? Experience in Delta Lake API.? Spark streaming ? nice to have

Desirable Skills: ? Strong knowledge of Data Management and Principles? At least over 3 years of experience in Azure Enterprise data lake development, with 6 ? 8 years of total experience in Data Warehousing.? Hands-on experience designing and delivering solutions using Azure Data Lake? Experience in building ETL/ELT/ data warehouse? Experience of building data pipelines using Azure Data Factory and Apache Spark (preferably PySpark in Databricks).? Experience in working with structured and semi-structured data from various sources like blob (json/avro | delimited flat files | parquet... etc.) , rdbms etc.? Adept in Structured Query Language.? Ability to apply spark Dataframe api to complete data manipulation within Spark Session? Good understanding of Spark Architecture including spark core, spark sql, dataframe, driver node, worker node, fault tolerance, collection, executors and tasks? Experience in Delta Lake API.? Spark streaming ? nice to have

  • ETL Developer

    4 weeks ago

    Old Toronto, Canada Zortechsolutions Full time

    Role: ETL DeveloperLocation: Toronto, ONDuration: Full TimeJob DescriptionSkills and Responsibilities: ETL data warehouse- MS SSIS/SSRS- IBM Netezza, MS SQL server/Sybase database Hadoop (Hive SQL and Pentaho ETL design) AWS Cloud services (Spark, Redshift and EMR) Knowledge in lending systems and functional knowledge on the same Knowledge in MDM systems for...

  • ETL Developer

    4 weeks ago

    Old Toronto, Canada Zortechsolutions Full time

    Role: ETL DeveloperLocation: Toronto, ONDuration: Full TimeJob DescriptionSkills and Responsibilities: ETL data warehouse- MS SSIS/SSRS- IBM Netezza, MS SQL server/Sybase database Hadoop (Hive SQL and Pentaho ETL design) AWS Cloud services (Spark, Redshift and EMR) Knowledge in lending systems and functional knowledge on the same Knowledge in MDM systems for...

  • ETL Developer

    2 weeks ago

    Toronto, Canada Sryas - an Orion Innovation Company Full time

    Position:Data Integration and ETL DeveloperDetails:Hybrid RoleLocation:Ontario, Canada (Toronto, Scarborough, Mississauga, Brampton, Markham, Richmond Hill, Waterloo, Kitchener, Ottawa)Job Description: Profiles- Key competencies:Analyze data sources in collaboration with source systems teams to produce technical specifications.Data mapping and data...

  • ETL Developer

    2 weeks ago

    Toronto, Canada Sryas - an Orion Innovation Company Full time

    Position:Data Integration and ETL DeveloperDetails:Hybrid RoleLocation:Ontario, Canada (Toronto, Scarborough, Mississauga, Brampton, Markham, Richmond Hill, Waterloo, Kitchener, Ottawa)Job Description: Profiles- Key competencies:Analyze data sources in collaboration with source systems teams to produce technical specifications.Data mapping and data...

  • ETL Developer

    6 days ago

    Toronto, Canada Atlantis IT Group Full time

    ETL developer with AWS Role name: Developer Role Description: Cloud DE Job Description1. Must have working knowledge in designing and implementing data pipelines on any of the cloud providers (AWS is preferred). Must be able to work with large volumes of data coming from various sources. Perform data cleansing, data validation etc.2. Hands on ETL developer...

  • ETL Developer

    7 days ago

    Toronto, Canada Atlantis IT Group Full time

    ETL developer with AWSRole name: DeveloperRole Description: Cloud DE Job Description1. Must have working knowledge in designing and implementing data pipelines on any of the cloud providers (AWS is preferred). Must be able to work with large volumes of data coming from various sources. Perform data cleansing, data validation etc.2. Hands on ETL developer who...

  • ETL Developer

    6 days ago

    Toronto, Canada Atlantis IT Group Full time

    ETL developer with AWSRole name: DeveloperRole Description: Cloud DE Job Description1. Must have working knowledge in designing and implementing data pipelines on any of the cloud providers (AWS is preferred). Must be able to work with large volumes of data coming from various sources. Perform data cleansing, data validation etc.2. Hands on ETL developer who...

  • ETL Developer

    6 days ago

    Toronto, Canada Atlantis IT Group Full time

    ETL developer with AWSRole name: DeveloperRole Description: Cloud DE Job Description1. Must have working knowledge in designing and implementing data pipelines on any of the cloud providers (AWS is preferred). Must be able to work with large volumes of data coming from various sources. Perform data cleansing, data validation etc.2. Hands on ETL developer who...

  • ETL Developer

    6 days ago

    Toronto, Canada Atlantis IT Group Full time

    ETL developer with AWSRole name: DeveloperRole Description: Cloud DE Job Description1. Must have working knowledge in designing and implementing data pipelines on any of the cloud providers (AWS is preferred). Must be able to work with large volumes of data coming from various sources. Perform data cleansing, data validation etc.2. Hands on ETL developer who...

  • ETL Developer

    4 weeks ago

    Old Toronto, Canada Nexus Systems Group Inc. Full time

    ETL Developer Typical Day in Role: • Write well designed, testable, efficient code by using best software development practices • Gather and refine specifications and requirements based on technical needs • Direct day-to-day activities in a manner consistent with our risk culture and the relevant risk appetite statement and limits and communicate it...

  • ETL Developer

    4 weeks ago

    Old Toronto, Canada Nexus Systems Group Inc. Full time

    ETL Developer Typical Day in Role: • Write well designed, testable, efficient code by using best software development practices • Gather and refine specifications and requirements based on technical needs • Direct day-to-day activities in a manner consistent with our risk culture and the relevant risk appetite statement and limits and communicate it...

  • ETL Developer

    4 days ago

    Toronto, Ontario, Canada Atlantis IT group Full time

    Role : ETL Developer ( AWS )Location : Toronto , ONDuration : ContractJob Description :1. Must have working knowledge in designing and implementing data pipelines on any of the cloud providers (AWS is preferred). Must be able to work with large volumes of data coming from various sources. Perform data cleansing, data validation etc.2. Hands on ETL developer...

  • ETL Developer

    1 month ago

    Toronto, Canada Atlantis IT Group Full time

    Role name: Data Bricks/ETL DeveloperRole Description: ? Designing and implementing efficient data ingestion pipelines from multiple sources using Azure Data factory and/or Azure Databricks? Integrating the end-to-end data pipeline to take data from different source systems to target data repositories ensuring the quality and consistency of data.? Processing...

  • ETL Developer

    1 month ago

    Toronto, Canada Atlantis IT Group Full time

    Role name: Data Bricks/ETL Developer Role Description: ? Designing and implementing efficient data ingestion pipelines from multiple sources using Azure Data factory and/or Azure Databricks? Integrating the end-to-end data pipeline to take data from different source systems to target data repositories ensuring the quality and consistency of data.?...

  • ETL Developer

    1 month ago

    Toronto, Canada Atlantis IT Group Full time

    Role name: Data Bricks/ETL DeveloperRole Description: ? Designing and implementing efficient data ingestion pipelines from multiple sources using Azure Data factory and/or Azure Databricks? Integrating the end-to-end data pipeline to take data from different source systems to target data repositories ensuring the quality and consistency of data.? Processing...

  • ETL Developer

    2 weeks ago

    Toronto, ON, Canada Sryas - an Orion Innovation Company Full time

    Position:Data Integration and ETL DeveloperDetails:Hybrid RoleLocation:Ontario, Canada (Toronto, Scarborough, Mississauga, Brampton, Markham, Richmond Hill, Waterloo, Kitchener, Ottawa)Job Description: Profiles- Key competencies:Analyze data sources in collaboration with source systems teams to produce technical specifications.Data mapping and data...

  • ETL Developer

    2 weeks ago

    Toronto, ON, Canada Sryas - an Orion Innovation Company Full time

    Position:Data Integration and ETL DeveloperDetails:Hybrid RoleLocation:Ontario, Canada (Toronto, Scarborough, Mississauga, Brampton, Markham, Richmond Hill, Waterloo, Kitchener, Ottawa)Job Description: Profiles- Key competencies:Analyze data sources in collaboration with source systems teams to produce technical specifications.Data mapping and data...

  • ETL Developer

    6 days ago

    Toronto, Canada Atlantis IT Group Full time

    ETL developer with AWS Role name: Developer Role Description: Cloud DE Job Description1. Must have working knowledge in designing and implementing data pipelines on any of the cloud providers (AWS is preferred). Must be able to work with large volumes of data coming from various sources. Perform dat

  • ETL Developer

    2 weeks ago

    Toronto, Canada Sryas - an Orion Innovation Company Full time

    Position: Data Integration and ETL Developer Details: Hybrid Role Location: Ontario, Canada (Toronto, Scarborough, Mississauga, Brampton, Markham, Richmond Hill, Waterloo, Kitchener, Ottawa) Job Description: Profiles- Key competencies: Analyze data sources in collaboration with source systems teams to produce technical specifications. Data mapping...

  • ETL Developer

    6 days ago

    Toronto, Canada Sryas - an Orion Innovation Company Full time

    Position:Data Integration and ETL DeveloperDetails:Hybrid RoleLocation:Ontario, Canada [Toronto, Scarborough, Mississauga, Brampton, Markham, Richmond Hill, Waterloo, Kitchener, Ottawa]Job Description: Profiles- Key competencies:Analyze data sources in collaboration with source systems teams to produce technical specifications.Data mapping and data...