![Atlantis IT Group](https://media.trabajo.org/img/noimg.jpg)
ETL Developer
1 month ago
Role name: Data Bricks/ETL Developer
Role Description: ? Designing and implementing efficient data ingestion pipelines from multiple sources using Azure Data factory and/or Azure Databricks? Integrating the end-to-end data pipeline to take data from different source systems to target data repositories ensuring the quality and consistency of data.? Processing performance analysis and code optimization.
Competencies: Digital : Microsoft Azure
Experience (Years): 6-8
Essential Skills: ? Strong knowledge of Data Management and Principles? At least over 3 years of experience in Azure Enterprise data lake development, with 6 ? 8 years of total experience in Data Warehousing.? Hands-on experience designing and delivering solutions using Azure Data Lake? Experience in building ETL/ELT/ data warehouse? Experience of building data pipelines using Azure Data Factory and Apache Spark (preferably PySpark in Databricks).? Experience in working with structured and semi-structured data from various sources like blob (json/avro | delimited flat files | parquet... etc.) , rdbms etc.? Adept in Structured Query Language.? Ability to apply spark Dataframe api to complete data manipulation within Spark Session? Good understanding of Spark Architecture including spark core, spark sql, dataframe, driver node, worker node, fault tolerance, collection, executors and tasks? Experience in Delta Lake API.? Spark streaming ? nice to have
Desirable Skills: ? Strong knowledge of Data Management and Principles? At least over 3 years of experience in Azure Enterprise data lake development, with 6 ? 8 years of total experience in Data Warehousing.? Hands-on experience designing and delivering solutions using Azure Data Lake? Experience in building ETL/ELT/ data warehouse? Experience of building data pipelines using Azure Data Factory and Apache Spark (preferably PySpark in Databricks).? Experience in working with structured and semi-structured data from various sources like blob (json/avro | delimited flat files | parquet... etc.) , rdbms etc.? Adept in Structured Query Language.? Ability to apply spark Dataframe api to complete data manipulation within Spark Session? Good understanding of Spark Architecture including spark core, spark sql, dataframe, driver node, worker node, fault tolerance, collection, executors and tasks? Experience in Delta Lake API.? Spark streaming ? nice to have
-
ETL Developer
4 weeks ago
Old Toronto, Canada Zortechsolutions Full timeRole: ETL DeveloperLocation: Toronto, ONDuration: Full TimeJob DescriptionSkills and Responsibilities: ETL data warehouse- MS SSIS/SSRS- IBM Netezza, MS SQL server/Sybase database Hadoop (Hive SQL and Pentaho ETL design) AWS Cloud services (Spark, Redshift and EMR) Knowledge in lending systems and functional knowledge on the same Knowledge in MDM systems for...
-
ETL Developer
4 weeks ago
Old Toronto, Canada Zortechsolutions Full timeRole: ETL DeveloperLocation: Toronto, ONDuration: Full TimeJob DescriptionSkills and Responsibilities: ETL data warehouse- MS SSIS/SSRS- IBM Netezza, MS SQL server/Sybase database Hadoop (Hive SQL and Pentaho ETL design) AWS Cloud services (Spark, Redshift and EMR) Knowledge in lending systems and functional knowledge on the same Knowledge in MDM systems for...
-
ETL Developer
2 weeks ago
Toronto, Canada Sryas - an Orion Innovation Company Full timePosition:Data Integration and ETL DeveloperDetails:Hybrid RoleLocation:Ontario, Canada (Toronto, Scarborough, Mississauga, Brampton, Markham, Richmond Hill, Waterloo, Kitchener, Ottawa)Job Description: Profiles- Key competencies:Analyze data sources in collaboration with source systems teams to produce technical specifications.Data mapping and data...
-
ETL Developer
2 weeks ago
Toronto, Canada Sryas - an Orion Innovation Company Full timePosition:Data Integration and ETL DeveloperDetails:Hybrid RoleLocation:Ontario, Canada (Toronto, Scarborough, Mississauga, Brampton, Markham, Richmond Hill, Waterloo, Kitchener, Ottawa)Job Description: Profiles- Key competencies:Analyze data sources in collaboration with source systems teams to produce technical specifications.Data mapping and data...
-
ETL Developer
6 days ago
Toronto, Canada Atlantis IT Group Full timeETL developer with AWS Role name: Developer Role Description: Cloud DE Job Description1. Must have working knowledge in designing and implementing data pipelines on any of the cloud providers (AWS is preferred). Must be able to work with large volumes of data coming from various sources. Perform data cleansing, data validation etc.2. Hands on ETL developer...
-
ETL Developer
7 days ago
Toronto, Canada Atlantis IT Group Full timeETL developer with AWSRole name: DeveloperRole Description: Cloud DE Job Description1. Must have working knowledge in designing and implementing data pipelines on any of the cloud providers (AWS is preferred). Must be able to work with large volumes of data coming from various sources. Perform data cleansing, data validation etc.2. Hands on ETL developer who...
-
ETL Developer
6 days ago
Toronto, Canada Atlantis IT Group Full timeETL developer with AWSRole name: DeveloperRole Description: Cloud DE Job Description1. Must have working knowledge in designing and implementing data pipelines on any of the cloud providers (AWS is preferred). Must be able to work with large volumes of data coming from various sources. Perform data cleansing, data validation etc.2. Hands on ETL developer who...
-
ETL Developer
6 days ago
Toronto, Canada Atlantis IT Group Full timeETL developer with AWSRole name: DeveloperRole Description: Cloud DE Job Description1. Must have working knowledge in designing and implementing data pipelines on any of the cloud providers (AWS is preferred). Must be able to work with large volumes of data coming from various sources. Perform data cleansing, data validation etc.2. Hands on ETL developer who...
-
ETL Developer
6 days ago
Toronto, Canada Atlantis IT Group Full timeETL developer with AWSRole name: DeveloperRole Description: Cloud DE Job Description1. Must have working knowledge in designing and implementing data pipelines on any of the cloud providers (AWS is preferred). Must be able to work with large volumes of data coming from various sources. Perform data cleansing, data validation etc.2. Hands on ETL developer who...
-
ETL Developer
4 weeks ago
Old Toronto, Canada Nexus Systems Group Inc. Full timeETL Developer Typical Day in Role: • Write well designed, testable, efficient code by using best software development practices • Gather and refine specifications and requirements based on technical needs • Direct day-to-day activities in a manner consistent with our risk culture and the relevant risk appetite statement and limits and communicate it...
-
ETL Developer
4 weeks ago
Old Toronto, Canada Nexus Systems Group Inc. Full timeETL Developer Typical Day in Role: • Write well designed, testable, efficient code by using best software development practices • Gather and refine specifications and requirements based on technical needs • Direct day-to-day activities in a manner consistent with our risk culture and the relevant risk appetite statement and limits and communicate it...
-
ETL Developer
4 days ago
Toronto, Ontario, Canada Atlantis IT group Full timeRole : ETL Developer ( AWS )Location : Toronto , ONDuration : ContractJob Description :1. Must have working knowledge in designing and implementing data pipelines on any of the cloud providers (AWS is preferred). Must be able to work with large volumes of data coming from various sources. Perform data cleansing, data validation etc.2. Hands on ETL developer...
-
ETL Developer
4 weeks ago
Toronto, Canada Atlantis IT Group Full timeRole name: Data Bricks/ETL DeveloperRole Description: ? Designing and implementing efficient data ingestion pipelines from multiple sources using Azure Data factory and/or Azure Databricks? Integrating the end-to-end data pipeline to take data from different source systems to target data repositories ensuring the quality and consistency of data.? Processing...
-
ETL Developer
1 month ago
Toronto, Canada Atlantis IT Group Full timeRole name: Data Bricks/ETL DeveloperRole Description: ? Designing and implementing efficient data ingestion pipelines from multiple sources using Azure Data factory and/or Azure Databricks? Integrating the end-to-end data pipeline to take data from different source systems to target data repositories ensuring the quality and consistency of data.? Processing...
-
ETL Developer
1 month ago
Toronto, Canada Atlantis IT Group Full timeRole name: Data Bricks/ETL DeveloperRole Description: ? Designing and implementing efficient data ingestion pipelines from multiple sources using Azure Data factory and/or Azure Databricks? Integrating the end-to-end data pipeline to take data from different source systems to target data repositories ensuring the quality and consistency of data.? Processing...
-
ETL Developer
2 weeks ago
Toronto, ON, Canada Sryas - an Orion Innovation Company Full timePosition:Data Integration and ETL DeveloperDetails:Hybrid RoleLocation:Ontario, Canada (Toronto, Scarborough, Mississauga, Brampton, Markham, Richmond Hill, Waterloo, Kitchener, Ottawa)Job Description: Profiles- Key competencies:Analyze data sources in collaboration with source systems teams to produce technical specifications.Data mapping and data...
-
ETL Developer
2 weeks ago
Toronto, ON, Canada Sryas - an Orion Innovation Company Full timePosition:Data Integration and ETL DeveloperDetails:Hybrid RoleLocation:Ontario, Canada (Toronto, Scarborough, Mississauga, Brampton, Markham, Richmond Hill, Waterloo, Kitchener, Ottawa)Job Description: Profiles- Key competencies:Analyze data sources in collaboration with source systems teams to produce technical specifications.Data mapping and data...
-
ETL Developer
6 days ago
Toronto, Canada Atlantis IT Group Full timeETL developer with AWS Role name: Developer Role Description: Cloud DE Job Description1. Must have working knowledge in designing and implementing data pipelines on any of the cloud providers (AWS is preferred). Must be able to work with large volumes of data coming from various sources. Perform dat
-
ETL Developer
2 weeks ago
Toronto, Canada Sryas - an Orion Innovation Company Full timePosition: Data Integration and ETL Developer Details: Hybrid Role Location: Ontario, Canada (Toronto, Scarborough, Mississauga, Brampton, Markham, Richmond Hill, Waterloo, Kitchener, Ottawa) Job Description: Profiles- Key competencies: Analyze data sources in collaboration with source systems teams to produce technical specifications. Data mapping...
-
ETL Developer
6 days ago
Toronto, Canada Sryas - an Orion Innovation Company Full timePosition:Data Integration and ETL DeveloperDetails:Hybrid RoleLocation:Ontario, Canada [Toronto, Scarborough, Mississauga, Brampton, Markham, Richmond Hill, Waterloo, Kitchener, Ottawa]Job Description: Profiles- Key competencies:Analyze data sources in collaboration with source systems teams to produce technical specifications.Data mapping and data...