Azure Big Data Engineer

4 weeks ago

Greater Toronto Area, Canada Apptoza Inc. Full time

Hai Everyone

Hope all are doing well,


Wondering if you are available for Contract Position for Azure Big Data with one our Client, if you are interested and need to get more information about this role please mail to aravind@apptoza.com


Role : Azure Big Data Engineer

Location : Toronto, ON

Hybrid Position


Responsibilities:

  1. Design, develop, and deploy scalable big data solutions on the Azure cloud platform.
  2. Implement data ingestion processes from various sources into Azure data storage solutions such as Azure Data Lake Storage, Azure Blob Storage, or Azure SQL Data Warehouse.
  3. Develop and maintain efficient data pipelines using Azure services like Azure Data Factory, Azure Databricks, Azure HDInsight, or Azure Synapse Analytics.
  4. Optimize data processing and transformation workflows for performance, reliability, and cost-effectiveness.
  5. Collaborate with data scientists and analysts to integrate machine learning models and analytical tools into big data solutions.
  6. Ensure data security, compliance, and governance standards are met throughout the data lifecycle.
  7. Monitor and troubleshoot data pipelines to identify and resolve issues in a timely manner.
  8. Document technical designs, configurations, and processes for knowledge sharing and future reference.
  9. Stay updated on emerging trends and best practices in big data technologies and cloud computing.

  • Big Data Administrator

    3 days ago

    Toronto, Canada Themesoft Inc. Full time

    Position: Big Data EngineerLocation: Toronto – HybridJob Description:Must have Spark, Hadoop, Hbase, Kafka, Yarn, Airflow, CloudGood to have (Dynatrace, Splunk, DB/unix),Nice to have (Dremio else equivalent experience of working in Databricks)Good knowledge with Azure Databricks, Azure Data Factory, ADLSAdmin, monitoring the Bigdata platform and...

  • Big Data Administrator

    4 days ago

    Toronto, Canada Themesoft Inc. Full time

    Position: Big Data EngineerLocation: Toronto – HybridJob Description:Must have Spark, Hadoop, Hbase, Kafka, Yarn, Airflow, CloudGood to have (Dynatrace, Splunk, DB/unix),Nice to have (Dremio else equivalent experience of working in Databricks)Good knowledge with Azure Databricks, Azure Data Factory, ADLSAdmin, monitoring the Bigdata platform and...

  • Big Data Administrator

    3 days ago

    Toronto, Canada Themesoft Inc. Full time

    Position : Big Data Engineer Location : Toronto – Hybrid Job Description : Must have Spark, Hadoop, Hbase, Kafka, Yarn, Airflow, Cloud Good to have (Dynatrace, Splunk, DB/unix), Nice to have (Dremio else equivalent experience of working in Databricks) Good knowledge with Azure Databricks, Azure Data Factory, ADLS Admin, monitoring the Bigdata platform and...

  • Azure Data Engineer

    7 days ago

    Toronto, Canada Integriti Group Inc Full time

    Requirements:Azure Data Engineer with a minimum of 8 years of experience.Azure Data Factory, Azure Data bricks Spark (PySpark or scala), SQLExperience in Azure ingestion from on-prem source, e.g. mainframe, SQL server, Oracle.Experience in Sqoop / HadoopMicrosoft Excel (for metadata files with requirements for ingestion)Any other certificate in Azure/AWS/GCP...

  • Azure Developer

    2 days ago

    Toronto, Canada Apex Systems Full time

    Azure Developer Apex Systems is a global IT services provider and our consulting practice has an opening for a Azure Developer who has experience with Azure Data Factory and Pyspark to drive the design, the development and maintenance of the solutions for at a Top Five Bank. Client: Big 5 Bank Location: HYbrid - Toronto Terms: 6 Month Contract, strong...

  • Azure Developer

    3 days ago

    Toronto, Canada Apex Systems Full time

    Azure Developer Apex Systems is a global IT services provider and our consulting practice has an opening for a Azure Developer who has experience with Azure Data Factory and Pyspark to drive the design, the development and maintenance of the solutions for at a Top Five Bank. Client: Big 5 Bank Location: HYbrid - Toronto Terms: 6 Month Contract, strong...

  • Azure Developer

    2 days ago

    Toronto, Canada Apex Systems Full time

    Azure Developer Apex Systems is a global IT services provider and our consulting practice has an opening for a Azure Developer who has experience with Azure Data Factory and Pyspark to drive the design, the development and maintenance of the solutions for at a Top Five Bank. Client: Big 5 Bank Location: HYbrid - Toronto Terms: 6 Month Contract, strong...

  • Azure Developer

    2 days ago

    Toronto, Canada Apex Systems Full time

    Azure Developer Apex Systems is a global IT services provider and our consulting practice has an opening for aAzure Developerwho has experience with Azure Data Factory and Pyspark to drive the design, the development and maintenance of the solutions for at a Top Five Bank. Client:Big 5 Bank Location:HYbrid - Toronto Terms:6 Month Contract, strong possibility...

  • Big Data Administrator

    3 days ago

    Toronto, Canada Themesoft Inc. Full time

    Position: Big Data EngineerLocation: Toronto – HybridJob Description:Must have Spark, Hadoop, Hbase, Kafka, Yarn, Airflow, CloudGood to have (Dynatrace, Splunk, DB/unix),Nice to have (Dremio else equivalent experience of working in Databricks)Good knowledge with Azure Databricks, Azure Data Factory, ADLSAdmin, monitoring the Bigdata platform and...

  • Azure Data Engineer(Databricks, Azure Synapse)

    2 weeks ago

    Toronto, Canada Ampstek Full time

    Role – Azure Data Engineer(Databricks, Azure Synapse) Location – Toronto, Ontario (Onsite) Short-term Contract. Job Description: Key skillsets: • Azure Cloud: Azure Databricks, ADLS Gen2, Azure Data Factory, Azure Synapse • ETL Tools: Visual Studio 2015 (SSIS), Informatica PowerCenter 10.1.1/9.1, DataStage • Certification – Azure data engineer...

  • Azure Data Engineer(Databricks, Azure Synapse)

    2 weeks ago

    Toronto, Canada Ampstek Full time

    Role – Azure Data Engineer(Databricks, Azure Synapse)Location – Toronto, Ontario (Onsite)Short-term Contract.Job Description:Key skillsets:• Azure Cloud: Azure Databricks, ADLS Gen2, Azure Data Factory, Azure Synapse• ETL Tools: Visual Studio 2015 (SSIS), Informatica PowerCenter 10.1.1/9.1, DataStage• Certification – Azure data...

  • Azure Developer

    3 days ago

    Toronto, Canada Apex Systems Full time

    Azure DeveloperApex Systems is a global IT services provider and our consulting practice has an opening for a Azure Developer who has experience with Azure Data Factory and Pyspark to drive the design, the development and maintenance of the solutions for at a Top Five Bank.Client: Big 5 BankLocation: HYbrid - Toronto Terms: 6 Month Contract, strong...

  • Data Engineer

    1 month ago

    Greater Toronto Area, Canada Procom Labs Full time

    The role: In collaboration with the Business Intelligence (BI) Manager, the Data Engineer will undertake the responsibility of executing and managing Azure Data Factory Pipelines. This includes the design and implementation of the Data Lake, as well as the optimization of data refresh performance. The role encompasses ownership (both execution and...

  • Azure Developer

    3 days ago

    Toronto, Canada Apex Systems Full time

    Azure DeveloperApex Systems is a global IT services provider and our consulting practice has an opening for a Azure Developer who has experience with Azure Data Factory and Pyspark to drive the design, the development and maintenance of the solutions for at a Top Five Bank.Client: Big 5 BankLocation: HYbrid - Toronto Terms: 6 Month Contract, strong...

  • Azure Developer

    2 days ago

    Toronto, Canada Apex Systems Full time

    Azure DeveloperApex Systems is a global IT services provider and our consulting practice has an opening for a Azure Developer who has experience with Azure Data Factory and Pyspark to drive the design, the development and maintenance of the solutions for at a Top Five Bank.Client: Big 5 BankLocation: HYbrid - Toronto Terms: 6 Month Contract, strong...

  • Azure Developer

    2 days ago

    Toronto, Canada Apex Systems Full time

    Azure Developer Apex Systems is a global IT services provider and our consulting practice has an opening for a Azure Developer who has experience with Azure Data Factory and Pyspark to drive the design, the development and maintenance of the solutions for at a Top Five Bank. Client: Big 5 Bank Location: HYbrid - Toronto Terms: 6 Month Contract,...

  • Azure Data Engineer

    7 days ago

    Toronto, Canada NAM Info Inc Full time

    Position: Azure Data Engineer-Clinical Location: Onsite-Toronto, CADuration: 12 Months Contract Responsibility of Role:ETL (Extract, Transform and Load) process.Strong knowledge of SQL and DB concepts.Strong experience in any one of the programming languages, like Python / PySpark.Hands-on experience with Azure Data Factory and its eco-system, Databricks,...

  • Big Data Administrator

    5 days ago

    Toronto, Canada Themesoft Inc. Full time

    Position: Big Data AdministratorLocation: Toronto – HybridJob Description:Must have Spark, Hadoop, Hbase, Kafka, Yarn, Airflow, CloudGood to have (Dynatrace, Splunk, DB/unix),Nice to have (Dremio else equivalent experience of working in Databricks)Good knowledge with Azure Databricks, Azure Data Factory, ADLSAdmin, monitoring the Bigdata platform and...

  • Big Data Administrator

    5 days ago

    Toronto, Canada Themesoft Inc. Full time

    Position: Big Data AdministratorLocation: Toronto – HybridJob Description:Must have Spark, Hadoop, Hbase, Kafka, Yarn, Airflow, CloudGood to have (Dynatrace, Splunk, DB/unix),Nice to have (Dremio else equivalent experience of working in Databricks)Good knowledge with Azure Databricks, Azure Data Factory, ADLSAdmin, monitoring the Bigdata platform and...

  • Big Data Administrator

    4 days ago

    Toronto, Canada Themesoft Inc. Full time

    Position : Big Data Administrator Location : Toronto – Hybrid Job Description : Must have Spark, Hadoop, Hbase, Kafka, Yarn, Airflow, Cloud Good to have (Dynatrace, Splunk, DB/unix), Nice to have (Dremio else equivalent experience of working in Databricks) Good knowledge with Azure Databricks, Azure Data Factory, ADLS Admin, monitoring the Bigdata platform...