AWS Databrciks Engineer

Location: Toronto, ON Hybrid (3 days Onsite- Tue, Wed, Thursday)

Total Experience: 8-10 Years

AWS: 5 Years

Databricks: 1-2 Years.

Note: Citizens or PR only considered for the TCS role, sorry, OWP won't work.

Responsibilities

• Design, develop, and maintain scalable and robust data pipelines on Databricks.
• Collaborate with data scientists and analysts to understand data requirements and deliver solutions.
• Optimize and troubleshoot existing data pipelines for performance and reliability.
• Ensure data quality and integrity across various data sources.
• Implement data security and compliance best practices.
• Monitor data pipeline performance and conduct necessary maintenance and updates.
• Document data pipeline processes and technical specifications.

Qualifications

• Bachelor's degree in Computer Science, Engineering, or a related field.
• 5+ years of experience in data engineering.
• Proficiency with Databricks and Spark.
• Strong SQL skills and experience with relational databases.
• Experience with big data technologies (e.g., Hadoop, Kafka).
• Knowledge of data warehousing concepts and ETL processes.
• Excellent problem-solving and analytical skills.

Skills

• Databricks
• SQL
• Python
• Data Warehousing
• ETL
• Hadoop
• Kafka

Seniority level

Mid-Senior level

Employment type

Contract

Job function

• Information Technology
• Banking