Senior Data Engineer

3 hours ago

Halifax, Nova Scotia, Canada Xforia Global Talent & Technology Solutions Full-time
  • Strong experience in Python Scripting and PySpark for data processing
  • Proficiency in SQL, dealing with big data processing
  • Experience in AWS cloud platform and its data services (S3, Redshift, Lambda, EMR, Airflow, Glue)
  • Expertise in BASH/Shell scripting
  • Strong understanding of healthcare insurance domain and experience leading data engineering teams
  • Experience in Agile environments.
  • Excellent problem-solving skills and attention to detail.
  • Effective communication and collaboration skills.

Responsibilities:

  • Leads development of data pipelines and architectures that handle large-scale data sets.
  • Designs, constructs, and tests data architecture aligned with business requirements.
  • Provides technical leadership for data projects, ensuring best practices and high-qualitydata solutions.
  • Collaborates with product, finance, and other business units to ensure data pipelines meet business requirements.
  • Oversees development of data solutions that enable predictive and prescriptive analytics.
  • Ensures the technical quality of solutions, managing data as it moves across environments.