Azure Data Engineer

3 weeks ago

Toronto, Canada Smart IT Frame LLC Full time

Hi,

Greetings from Smart IT Frame, Hope you are doing well

Smart IT Frame specializes in enabling you with your most critical line of resources. Whether it’s for permanent staffing, contract staffing, contract-to-hire or executive search, we understand the importance of delivering the most suitable talent; on time and within budget. With our Core focus in emerging technologies, we have provided global technology workforce solutions in North America, Canada & India. We take pride in delivering specialized talent, superior performance, and seamless execution to meet the challenging business needs of customers worldwide.

Role: Azure Data Engineer

Location: Toronto, CA (On-Site)


JD:

Job summary

We are seeking a highly skilled Sr. Developer (Sr. Associate - Projects) with 6-8 years of experience, specializing in Python, PySpark, and Azure technologies, to join our Life and Annuities Insurance domain team.

This role involves developing and optimizing data solutions, ensuring data integrity, and contributing to our mission of transforming data into actionable insights for our clients.

Experience 6 to 8 yrs

Required Skills Technical Skills- ,Python, PySpark, Azure Data Lake Store, Azure Monitor, Databricks Workflows, Databricks SQL

Domain Skills- ,Life and Annuities Insurance

Roles & Responsibilities-

Develop and maintain scalable data pipelines and build out new integrations to support continuing increases in data volume and complexity.-

Implement complex analytical projects with a focus on collecting, parsing, managing, analyzing, and visualizing large sets of data to turn information into insights using Python and PySpark.-

Utilize Azure Data Lake Store and Azure Monitor to ensure the availability and performance of our data solutions.-

Design and implement Databricks Workflows and Databricks SQL queries for efficient data manipulation and retrieval.-

Work closely with stakeholders to understand their needs and provide data-driven solutions.-

Ensure data integrity and quality by implementing robust data validation and testing mechanisms.-

Collaborate with cross-functional teams to support the integration of data solutions into the overall architecture.-

Stay up-to-date with industry trends and technologies to drive innovation within the team.-

Provide technical guidance and mentorship to junior team members.-

Optimize existing data solutions for improved performance and scalability.-

Document all processes and ensure best practices in data management and coding standards are followed.-

Qualifications- Must have strong experience in Python, PySpark, Azure Data Lake Store, Azure Monitor, Databricks Workflows, and Databricks SQL.-

Experience in the Life and Annuities Insurance domain is required.-

Strong analytical and problem-solving skills.-

Excellent communication and collaboration abilities.-

Nice to have experience with Azure Event Hub, Azure DevOps, Azure Key Vault, Kafka, Structured Streaming, Delta Live Pipelines, Databricks Unity Catalog, Databricks CLI, Databricks Workspace Admin, and Spark in Scala.

9.Job LocationPrimary: Toronto - ON CAN

Thanks & Regards



Vasanth G

Smart IT Frame - An E- Verify Employer

101 Hudson Street, Suite #2100, Jersey City, NJ 07302

vasanth@smartitframe.com | www.smartitframe.com

  • Azure Data Engineer

    3 days ago

    Toronto, Canada Integriti Group Inc Full time

    Requirements:Azure Data Engineer with a minimum of 8 years of experience.Azure Data Factory, Azure Data bricks Spark (PySpark or scala), SQLExperience in Azure ingestion from on-prem source, e.g. mainframe, SQL server, Oracle.Experience in Sqoop / HadoopMicrosoft Excel (for metadata files with requirements for ingestion)Any other certificate in Azure/AWS/GCP...

  • Azure Data Engineer(Databricks, Azure Synapse)

    6 days ago

    Toronto, Canada Ampstek Full time

    Role – Azure Data Engineer(Databricks, Azure Synapse)Location – Toronto, Ontario (Onsite)Short-term Contract.Job Description:Key skillsets:• Azure Cloud: Azure Databricks, ADLS Gen2, Azure Data Factory, Azure Synapse• ETL Tools: Visual Studio 2015 (SSIS), Informatica PowerCenter 10.1.1/9.1, DataStage• Certification – Azure data...

  • Azure Data Engineer(Databricks, Azure Synapse)

    1 week ago

    Toronto, Canada Ampstek Full time

    Role – Azure Data Engineer(Databricks, Azure Synapse)Location – Toronto, Ontario (Onsite)Short-term Contract.Job Description:Key skillsets:• Azure Cloud: Azure Databricks, ADLS Gen2, Azure Data Factory, Azure Synapse• ETL Tools: Visual Studio 2015 (SSIS), Informatica PowerCenter 10.1.1/9.1, DataStage• Certification – Azure data...

  • Azure Data Engineer(Databricks, Azure Synapse)

    6 days ago

    Toronto, Canada Ampstek Full time

    Role – Azure Data Engineer(Databricks, Azure Synapse)Location – Toronto, Ontario (Onsite)Short-term Contract.Job Description:Key skillsets:• Azure Cloud: Azure Databricks, ADLS Gen2, Azure Data Factory, Azure Synapse• ETL Tools: Visual Studio 2015 (SSIS), Informatica PowerCenter 10.1.1/9.1, DataStage• Certification – Azure data...

  • Azure Data Engineer(Databricks, Azure Synapse)

    1 week ago

    Toronto, Canada Ampstek Full time

    Role – Azure Data Engineer(Databricks, Azure Synapse) Location – Toronto, Ontario (Onsite) Short-term Contract. Job Description: Key skillsets: • Azure Cloud: Azure Databricks, ADLS Gen2, Azure Data Factory, Azure Synapse • ETL Tools: Visual Studio 2015 (SSIS), Informatica PowerCenter 10.1.1/9.1, DataStage • Certification – Azure data engineer...

  • Azure Data Engineer(Databricks, Azure Synapse)

    1 week ago

    Toronto, Canada Ampstek Full time

    Role – Azure Data Engineer(Databricks, Azure Synapse)Location – Toronto, Ontario (Onsite)Short-term Contract.Job Description:Key skillsets:• Azure Cloud: Azure Databricks, ADLS Gen2, Azure Data Factory, Azure Synapse• ETL Tools: Visual Studio 2015 (SSIS), Informatica PowerCenter 10.1.1/9.1, DataStage• Certification – Azure data...

  • Senior Azure Data Engineer

    6 days ago

    Toronto, Canada Epsilon Solutions Ltd. Full time

    Role: Senior Azure Data Engineer Location: Toronto, ON (Hybrid)Term: Fulltime• Azure Data Engineer (minimum 8 years exp) please do not submit any junior profile.• Azure Data Factory , Azure Data bricks Spark (PySpark or scala), SQL• Experience in Azure ingestion from on-prem source, e.g. mainframe, SQL server, Oracle.• Experience in Sqoop / Hadoop•...

  • Senior Azure Data Engineer

    6 days ago

    Toronto, Canada Epsilon Solutions Ltd. Full time

    Role: Senior Azure Data Engineer Location: Toronto, ON (Hybrid) Term: Fulltime • Azure Data Engineer (minimum 8 years exp) please do not submit any junior profile. • Azure Data Factory , Azure Data bricks Spark (PySpark or scala), SQL • Experience in Azure ingestion from on-prem source, e.g. mainframe, SQL server, Oracle. • Experience in Sqoop /...

  • Senior Azure Data Engineer

    1 week ago

    Toronto, Canada Epsilon Solutions Ltd. Full time

    Role: Senior Azure Data Engineer Location: Toronto, ON (Hybrid)Term: Fulltime• Azure Data Engineer (minimum 8 years exp) please do not submit any junior profile.• Azure Data Factory , Azure Data bricks Spark (PySpark or scala), SQL• Experience in Azure ingestion from on-prem source, e.g. mainframe, SQL server, Oracle.• Experience in Sqoop / Hadoop•...

  • Azure Data Engineer

    3 days ago

    Toronto, Canada NAM Info Inc Full time

    Position: Azure Data Engineer-Clinical Location: Onsite-Toronto, CADuration: 12 Months Contract Responsibility of Role:ETL (Extract, Transform and Load) process.Strong knowledge of SQL and DB concepts.Strong experience in any one of the programming languages, like Python / PySpark.Hands-on experience with Azure Data Factory and its eco-system, Databricks,...

  • Azure Data Engineer

    3 weeks ago

    Toronto, Canada Smart IT Frame LLC Full time

    Hi, Greetings from Smart IT Frame, Hope you are doing well!!! Smart IT Frame specializes in enabling you with your most critical line of resources. Whether it’s for permanent staffing, contract staffing, contract-to-hire or executive search, we understand the importance of delivering the most suitable talent; on time and within budget. With our Core focus...

  • Azure Data Engineer

    3 days ago

    Toronto, Canada NAM Info Inc Full time

    Position: Azure Data Engineer-Clinical Location: Onsite-Toronto, CA Duration: 12 Months Contract Responsibility of Role: ETL (Extract, Transform and Load) process. Strong knowledge of SQL and DB concepts. Strong experience in any one of the programming languages, like Python / PySpark. Hands-on experience with Azure Data Factory and its eco-system,...

  • Azure Data Engineer

    5 days ago

    Toronto, Canada NAM Info Inc Full time

    Position: Azure Data Engineer-Clinical Location: Onsite-Toronto, CADuration: 12 Months Contract Responsibility of Role:ETL (Extract, Transform and Load) process.Strong knowledge of SQL and DB concepts.Strong experience in any one of the programming languages, like Python / PySpark.Hands-on experience with Azure Data Factory and its eco-system, Databricks,...

  • Azure Data Engineer

    5 days ago

    Toronto, Canada NAM Info Inc Full time

    Position: Azure Data Engineer-Clinical Location: Onsite-Toronto, CADuration: 12 Months Contract Responsibility of Role:ETL (Extract, Transform and Load) process.Strong knowledge of SQL and DB concepts.Strong experience in any one of the programming languages, like Python / PySpark.Hands-on experience with Azure Data Factory and its eco-system, Databricks,...

  • Data Engineer

    4 weeks ago

    Toronto, Canada Tiger Analytics Full time

    Tiger Analytics is a fast-growing advanced analytics consulting firm. Our consultants bring deep expertise in Data Science, Machine Learning, and AI. We are the trusted analytics partner for multiple Fortune 500 companies, enabling them to generate business value from data. Our business value and leadership has been recognized by various market research...

  • Data Engineer

    3 weeks ago

    Toronto, Canada Tiger Analytics Full time

    Tiger Analytics is a fast-growing advanced analytics consulting firm. Our consultants bring deep expertise in Data Science, Machine Learning, and AI. We are the trusted analytics partner for multiple Fortune 500 companies, enabling them to generate business value from data. Our business value and leadership has been recognized by various market research...

  • Data Engineer

    3 weeks ago

    Toronto, Canada Tiger Analytics Full time

    Tiger Analytics is a fast-growing advanced analytics consulting firm. Our consultants bring deep expertise in Data Science, Machine Learning, and AI. We are the trusted analytics partner for multiple Fortune 500 companies, enabling them to generate business value from data. Our business value and leadership has been recognized by various market research...

  • Azure Data Lead

    1 week ago

    Toronto, ON, Canada Epsilon Solutions Ltd. Full time

    Role: Lead Azure Data Engineer Location: Toronto, ON (Hybrid) Term: Fulltime • Azure Data Engineer (minimum 8 years exp) please do not submit any junior profile. • Azure Data Factory , Azure Data bricks Spark (PySpark or scala), SQL • Experience in Azure ingestion from on-prem source, e.g. mainframe, SQL server, Oracle. • Experience in Sqoop /...

  • Azure Data Lead

    1 week ago

    Old Toronto, Canada Epsilon Solutions Ltd. Full time

    Role: Lead Azure Data Engineer Location: Toronto, ON (Hybrid)Term: Fulltime• Azure Data Engineer (minimum 8 years exp) please do not submit any junior profile.• Azure Data Factory , Azure Data bricks Spark (PySpark or scala), SQL• Experience in Azure ingestion from on-prem source, e.g. mainframe, SQL server, Oracle.• Experience in Sqoop / Hadoop•...

  • Azure Data Lead

    1 week ago

    Old Toronto, Canada Epsilon Solutions Ltd. Full time

    Role: Lead Azure Data Engineer Location: Toronto, ON (Hybrid)Term: Fulltime• Azure Data Engineer (minimum 8 years exp) please do not submit any junior profile.• Azure Data Factory , Azure Data bricks Spark (PySpark or scala), SQL• Experience in Azure ingestion from on-prem source, e.g. mainframe, SQL server, Oracle.• Experience in Sqoop / Hadoop•...