Azure Data Engineer
3 weeks ago
Hi,
Greetings from Smart IT Frame, Hope you are doing well
Smart IT Frame specializes in enabling you with your most critical line of resources. Whether it’s for permanent staffing, contract staffing, contract-to-hire or executive search, we understand the importance of delivering the most suitable talent; on time and within budget. With our Core focus in emerging technologies, we have provided global technology workforce solutions in North America, Canada & India. We take pride in delivering specialized talent, superior performance, and seamless execution to meet the challenging business needs of customers worldwide.
Role: Azure Data Engineer
Location: Toronto, CA (On-Site)
JD:
Job summary
We are seeking a highly skilled Sr. Developer (Sr. Associate - Projects) with 6-8 years of experience, specializing in Python, PySpark, and Azure technologies, to join our Life and Annuities Insurance domain team.
This role involves developing and optimizing data solutions, ensuring data integrity, and contributing to our mission of transforming data into actionable insights for our clients.
Experience 6 to 8 yrs
Required Skills Technical Skills- ,Python, PySpark, Azure Data Lake Store, Azure Monitor, Databricks Workflows, Databricks SQL
Domain Skills- ,Life and Annuities Insurance
Roles & Responsibilities-
Develop and maintain scalable data pipelines and build out new integrations to support continuing increases in data volume and complexity.-
Implement complex analytical projects with a focus on collecting, parsing, managing, analyzing, and visualizing large sets of data to turn information into insights using Python and PySpark.-
Utilize Azure Data Lake Store and Azure Monitor to ensure the availability and performance of our data solutions.-
Design and implement Databricks Workflows and Databricks SQL queries for efficient data manipulation and retrieval.-
Work closely with stakeholders to understand their needs and provide data-driven solutions.-
Ensure data integrity and quality by implementing robust data validation and testing mechanisms.-
Collaborate with cross-functional teams to support the integration of data solutions into the overall architecture.-
Stay up-to-date with industry trends and technologies to drive innovation within the team.-
Provide technical guidance and mentorship to junior team members.-
Optimize existing data solutions for improved performance and scalability.-
Document all processes and ensure best practices in data management and coding standards are followed.-
Qualifications- Must have strong experience in Python, PySpark, Azure Data Lake Store, Azure Monitor, Databricks Workflows, and Databricks SQL.-
Experience in the Life and Annuities Insurance domain is required.-
Strong analytical and problem-solving skills.-
Excellent communication and collaboration abilities.-
Nice to have experience with Azure Event Hub, Azure DevOps, Azure Key Vault, Kafka, Structured Streaming, Delta Live Pipelines, Databricks Unity Catalog, Databricks CLI, Databricks Workspace Admin, and Spark in Scala.
9.Job LocationPrimary: Toronto - ON CAN
Thanks & Regards
Vasanth G
Smart IT Frame - An E- Verify Employer
101 Hudson Street, Suite #2100, Jersey City, NJ 07302
vasanth@smartitframe.com | www.smartitframe.com
-
Azure Data Engineer
3 days ago
Toronto, Canada Integriti Group Inc Full timeRequirements:Azure Data Engineer with a minimum of 8 years of experience.Azure Data Factory, Azure Data bricks Spark (PySpark or scala), SQLExperience in Azure ingestion from on-prem source, e.g. mainframe, SQL server, Oracle.Experience in Sqoop / HadoopMicrosoft Excel (for metadata files with requirements for ingestion)Any other certificate in Azure/AWS/GCP...
-
Toronto, Canada Ampstek Full timeRole – Azure Data Engineer(Databricks, Azure Synapse)Location – Toronto, Ontario (Onsite)Short-term Contract.Job Description:Key skillsets:• Azure Cloud: Azure Databricks, ADLS Gen2, Azure Data Factory, Azure Synapse• ETL Tools: Visual Studio 2015 (SSIS), Informatica PowerCenter 10.1.1/9.1, DataStage• Certification – Azure data...
-
Toronto, Canada Ampstek Full timeRole – Azure Data Engineer(Databricks, Azure Synapse)Location – Toronto, Ontario (Onsite)Short-term Contract.Job Description:Key skillsets:• Azure Cloud: Azure Databricks, ADLS Gen2, Azure Data Factory, Azure Synapse• ETL Tools: Visual Studio 2015 (SSIS), Informatica PowerCenter 10.1.1/9.1, DataStage• Certification – Azure data...
-
Toronto, Canada Ampstek Full timeRole – Azure Data Engineer(Databricks, Azure Synapse)Location – Toronto, Ontario (Onsite)Short-term Contract.Job Description:Key skillsets:• Azure Cloud: Azure Databricks, ADLS Gen2, Azure Data Factory, Azure Synapse• ETL Tools: Visual Studio 2015 (SSIS), Informatica PowerCenter 10.1.1/9.1, DataStage• Certification – Azure data...
-
Toronto, Canada Ampstek Full timeRole – Azure Data Engineer(Databricks, Azure Synapse) Location – Toronto, Ontario (Onsite) Short-term Contract. Job Description: Key skillsets: • Azure Cloud: Azure Databricks, ADLS Gen2, Azure Data Factory, Azure Synapse • ETL Tools: Visual Studio 2015 (SSIS), Informatica PowerCenter 10.1.1/9.1, DataStage • Certification – Azure data engineer...
-
Toronto, Canada Ampstek Full timeRole – Azure Data Engineer(Databricks, Azure Synapse)Location – Toronto, Ontario (Onsite)Short-term Contract.Job Description:Key skillsets:• Azure Cloud: Azure Databricks, ADLS Gen2, Azure Data Factory, Azure Synapse• ETL Tools: Visual Studio 2015 (SSIS), Informatica PowerCenter 10.1.1/9.1, DataStage• Certification – Azure data...
-
Senior Azure Data Engineer
6 days ago
Toronto, Canada Epsilon Solutions Ltd. Full timeRole: Senior Azure Data Engineer Location: Toronto, ON (Hybrid)Term: Fulltime• Azure Data Engineer (minimum 8 years exp) please do not submit any junior profile.• Azure Data Factory , Azure Data bricks Spark (PySpark or scala), SQL• Experience in Azure ingestion from on-prem source, e.g. mainframe, SQL server, Oracle.• Experience in Sqoop / Hadoop•...
-
Senior Azure Data Engineer
6 days ago
Toronto, Canada Epsilon Solutions Ltd. Full timeRole: Senior Azure Data Engineer Location: Toronto, ON (Hybrid) Term: Fulltime • Azure Data Engineer (minimum 8 years exp) please do not submit any junior profile. • Azure Data Factory , Azure Data bricks Spark (PySpark or scala), SQL • Experience in Azure ingestion from on-prem source, e.g. mainframe, SQL server, Oracle. • Experience in Sqoop /...
-
Senior Azure Data Engineer
7 days ago
Toronto, Canada Epsilon Solutions Ltd. Full timeRole: Senior Azure Data Engineer Location: Toronto, ON (Hybrid)Term: Fulltime• Azure Data Engineer (minimum 8 years exp) please do not submit any junior profile.• Azure Data Factory , Azure Data bricks Spark (PySpark or scala), SQL• Experience in Azure ingestion from on-prem source, e.g. mainframe, SQL server, Oracle.• Experience in Sqoop / Hadoop•...
-
Azure Data Engineer
3 days ago
Toronto, Canada NAM Info Inc Full timePosition: Azure Data Engineer-Clinical Location: Onsite-Toronto, CADuration: 12 Months Contract Responsibility of Role:ETL (Extract, Transform and Load) process.Strong knowledge of SQL and DB concepts.Strong experience in any one of the programming languages, like Python / PySpark.Hands-on experience with Azure Data Factory and its eco-system, Databricks,...
-
Azure Data Engineer
3 weeks ago
Toronto, Canada Smart IT Frame LLC Full timeHi, Greetings from Smart IT Frame, Hope you are doing well!!! Smart IT Frame specializes in enabling you with your most critical line of resources. Whether it’s for permanent staffing, contract staffing, contract-to-hire or executive search, we understand the importance of delivering the most suitable talent; on time and within budget. With our Core focus...
-
Azure Data Engineer
3 days ago
Toronto, Canada NAM Info Inc Full timePosition: Azure Data Engineer-Clinical Location: Onsite-Toronto, CA Duration: 12 Months Contract Responsibility of Role: ETL (Extract, Transform and Load) process. Strong knowledge of SQL and DB concepts. Strong experience in any one of the programming languages, like Python / PySpark. Hands-on experience with Azure Data Factory and its eco-system,...
-
Azure Data Engineer
5 days ago
Toronto, Canada NAM Info Inc Full timePosition: Azure Data Engineer-Clinical Location: Onsite-Toronto, CADuration: 12 Months Contract Responsibility of Role:ETL (Extract, Transform and Load) process.Strong knowledge of SQL and DB concepts.Strong experience in any one of the programming languages, like Python / PySpark.Hands-on experience with Azure Data Factory and its eco-system, Databricks,...
-
Azure Data Engineer
5 days ago
Toronto, Canada NAM Info Inc Full timePosition: Azure Data Engineer-Clinical Location: Onsite-Toronto, CADuration: 12 Months Contract Responsibility of Role:ETL (Extract, Transform and Load) process.Strong knowledge of SQL and DB concepts.Strong experience in any one of the programming languages, like Python / PySpark.Hands-on experience with Azure Data Factory and its eco-system, Databricks,...
-
Data Engineer
4 weeks ago
Toronto, Canada Tiger Analytics Full timeTiger Analytics is a fast-growing advanced analytics consulting firm. Our consultants bring deep expertise in Data Science, Machine Learning, and AI. We are the trusted analytics partner for multiple Fortune 500 companies, enabling them to generate business value from data. Our business value and leadership has been recognized by various market research...
-
Data Engineer
3 weeks ago
Toronto, Canada Tiger Analytics Full timeTiger Analytics is a fast-growing advanced analytics consulting firm. Our consultants bring deep expertise in Data Science, Machine Learning, and AI. We are the trusted analytics partner for multiple Fortune 500 companies, enabling them to generate business value from data. Our business value and leadership has been recognized by various market research...
-
Data Engineer
3 weeks ago
Toronto, Canada Tiger Analytics Full timeTiger Analytics is a fast-growing advanced analytics consulting firm. Our consultants bring deep expertise in Data Science, Machine Learning, and AI. We are the trusted analytics partner for multiple Fortune 500 companies, enabling them to generate business value from data. Our business value and leadership has been recognized by various market research...
-
Azure Data Lead
1 week ago
Toronto, ON, Canada Epsilon Solutions Ltd. Full timeRole: Lead Azure Data Engineer Location: Toronto, ON (Hybrid) Term: Fulltime • Azure Data Engineer (minimum 8 years exp) please do not submit any junior profile. • Azure Data Factory , Azure Data bricks Spark (PySpark or scala), SQL • Experience in Azure ingestion from on-prem source, e.g. mainframe, SQL server, Oracle. • Experience in Sqoop /...
-
Azure Data Lead
1 week ago
Old Toronto, Canada Epsilon Solutions Ltd. Full timeRole: Lead Azure Data Engineer Location: Toronto, ON (Hybrid)Term: Fulltime• Azure Data Engineer (minimum 8 years exp) please do not submit any junior profile.• Azure Data Factory , Azure Data bricks Spark (PySpark or scala), SQL• Experience in Azure ingestion from on-prem source, e.g. mainframe, SQL server, Oracle.• Experience in Sqoop / Hadoop•...
-
Azure Data Lead
1 week ago
Old Toronto, Canada Epsilon Solutions Ltd. Full timeRole: Lead Azure Data Engineer Location: Toronto, ON (Hybrid)Term: Fulltime• Azure Data Engineer (minimum 8 years exp) please do not submit any junior profile.• Azure Data Factory , Azure Data bricks Spark (PySpark or scala), SQL• Experience in Azure ingestion from on-prem source, e.g. mainframe, SQL server, Oracle.• Experience in Sqoop / Hadoop•...