DataBricks Architect

2 weeks ago


Markham, Ontario, Canada Astellas Pharma Full time $104,000 - $130,878 per year

Do you want to be part of an inclusive team that works to develop innovative therapies for patients? Every day, we are driven to develop and deliver innovative and effective new medicines to patients and physicians. If you want to be part of this exciting work, you belong at Astellas

Astellas Pharma Inc. is a pharmaceutical company conducting business in more than 70 countries around the world. We are committed to turning innovative science into medical solutions that bring value and hope to patients and their families. Keeping our focus on addressing unmet medical needs and conducting our business with ethics and integrity enables us to improve the health of people throughout the world. For more information on Astellas, please visit our website at .

This position is based in Ontario, Canada and may require on-site work from time to time.

Hybrid work from certain locations may be permitted in accordance with Astellas' Responsible Flexibility Guidelines.

Purpose And Scope
DigitalX our new information technology function is spearheading this value driven transformation across Astellas. We are looking for people who excel in embracing change, manage technical challenges and have exceptional communication skills.

We are seeking committed and talented DataBricks Engineers with 8-10 years progressive experience to join our new InformationX team- which lies at the heart of DigitalX. As a member of our team within InformationX, you will be responsible for ensuring our data driven systems are operational, scalable and continue to contain the right data to drive business value.

Essential Job Responsibilities

  • End-to-End Data Solutions:
  • Design end-to-end scalable data streams, storage, data serving systems, and analytical workflows using Databricks.
  • Define overall architecture, capabilities, platforms, tools, and governing processes.
  • Data Pipeline Development:
  • Build data pipelines to extract, transform, and load data from various sources.
  • Set up metadata and master data structures to support transformation pipelines in Databricks.
  • Data Warehousing and Data Lakes:
  • Create data warehouses and data lakes for efficient data storage and management.
  • Develop and deploy data processing and analytics tools.
  • Collaboration with DataX and other key stakeholder value teams:
  • Collaborate with data modelers to create advanced data structures and models within the Databricks environment.
  • Develop and maintain Python scripts for data processing, transformation, and analysis.
  • Utilize Azure and AWS cloud services (e.g., Azure Data Lake, AWS S3, Redshift) for data storage and processing.
  • Apply expertise in Databricks to enhance data architecture, performance, and reliability. Lead relevantdata governance initiatives and ensure compliance with industry standards.
  • Work closely with data scientists to develop and deploy data-driven solutions.
  • Provide technical direction to Data Engineers and perform code reviews.
  • Continuous Learning:
  • Stay up to date on the latest data technologies, trends, and best practices.
  • Participate in smaller focused mission teams to deliver value driven solutions aligned to our global and bold move priority initiatives and beyond.
  • Collaborate with cross functional teams and practises across the organisation including Commercial, Manufacturing, Medical, DataX, GrowthX and support other X (transformation) Hubs and Practices as appropriate, to understand user needs and translate them into technical solutions.
  • Provide Level 3 and 4 Technical Support to internal users troubleshooting complex issues and ensuring system uptime as soon as possible.
  • Champion continuous improvement initiatives identifying opportunities to optimise performance security and maintainability of existing data and platform architecture and other technology investments.
  • Participate in the continuous delivery pipeline Adhering to DevOps best practises for version control automation and deployment. Ensuring effective management of the FoundationX backlog.
  • Leverage your knowledge of Machine Learning (ML) and data engineering principles to integrate with existing data pipelines and explore new possibilities for data utilization.
  • Stay up to date on the latest trends and technologies in full-stack-development, data engineering and cloud platforms.

Qualifications
Required

  • Bachelor's or Master's degree in Computer Science, Engineering, or related field.
  • 3-5 years+ of experience as a Data Engineer or DataBricks Developer.
  • Proficiency in Python for data manipulation, scripting, and analytics.
  • Strong understanding of data modelling concepts and practices.

Any relevant cloud-based DataBricks, AWS or Azure certifications for example:

  • Databricks Data Engineer
  • AWS Certified Data Analytics Speciality – Professional / Associate (will be considered with relevant experience)
  • Microsoft Certified Azure Data Engineer Associate
  • Microsoft Certified Azure Database Administrator
  • Microsoft Certified Azure Developer
  • Experience using ETL tools like Talend / Talend Cloud and DataStage (Essential)
  • Knowledge and experience using Azure DevOps (Essential)
  • Knowledge and experience of working with SalesForce / SAP (Desirable)
  • Experience in working with MPP Databases like AWS Redshift
  • Experience of delivering architectural solutions effectively within Lifesciences or Pharma Domains.

Preferred

  • Experience analysing and building star schema data warehouses
  • Experiencing writing SQL and creating stored procedures is essentialData Analysis and Automation Skills: Proficient in identifying, standardizing, and automating critical reporting metrics and modelling tools.
  • Analytical Thinking: Demonstrated ability to lead ad hoc analyses, identify performance gaps, and foster a culture of continuous improvement.
  • Experience in integrating data from multiple Data sources like relational Databases, Salesforce, SAP and API calls.
  • Agile Champion: Adherence to DevOps principles and a proven track record with CI/CD pipelines for continuous delivery.
  • Understand and Interpret business requirements and can term them into technical requirements.
  • Create and maintain technical documentation as part of CI/CD principles

Working Environment

  • This is a Permanent position.
  • Remote/ Hybrid: candidates must be located within commutable distance from the office.
  • Astellas is a global company. Successful candidates will be expected to work across different time zones and according to regions or specific locations based upon demand.

Category TechX

Astellas is committed to equality of opportunity in all aspects of employment.

EOE including Disability/Protected Veterans


  • Databricks Architect

    2 weeks ago


    Markham, Ontario, Canada Adastra Corporation Full time $120,000 - $180,000 per year

    Overview Are you eager to invest your skills and expertise into creating impactful and sustainable data and analytical solutions? Adastra may have just what you are looking for. As a Cloud Architect, you will be at the forefront of our value-driven approach to delivering top-quality IT solutions. Your expertise will help build reliable, scalable, and...


  • Markham, Ontario, Canada Adastra Corporation Full time $15,000 - $250,000 per year

    OverviewAre you eager to invest your skills and expertise into creating impactful and sustainable data and analytical solutions? Adastra may have just what you are looking for.As a Cloud Architect, you will be at the forefront of our value-driven approach to delivering top-quality IT solutions. Your expertise will help build reliable, scalable, and secure...


  • Markham, Ontario, Canada Adastra Corporation Full time $120,000 - $180,000 per year

    OverviewAre you eager to invest your skills and expertise into creating impactful and sustainable data and analytical solutions? Adastra may have just what you are looking for.As a Cloud Architect, you will be at the forefront of our value-driven approach to delivering top-quality IT solutions. Your expertise will help build reliable, scalable, and secure...


  • Markham, Ontario, Canada Nestlé Full time $80,000 - $120,000 per year

    Position SnapshotBusiness areas: Nestlé CanadaJob title: Associate Product Ownership – Jr. Data Engineer (12-months contract)Location: North York, ON located at 25 Sheppard Ave W, North York, ON M2N 6S8;HybridA little bit about usWhile Nestlé is known for KitKat, Gerber, Nescafe, and Häagen-Dazs, our recipe for success comes down to one thing: our...


  • Markham, Ontario, Canada Frontier Dental CA Full time US$60,000 - US$120,000 per year

    ** Must be willing to work on-site in Markham office 5 days/week **Come work with us to do what you love and stay for the Frontier TRACK …Team Centric : We each take responsibility for fostering an environment of personal and professional growth. We are eager to help, support and collaborate with one another recognizing that we are better when we work...


  • Markham, Ontario, Canada Nestlé Full time

    Position SnapshotBusiness areas: Nestlé CanadaJob title: Specialist Product Ownership-Data Engineer (1-year contract)Location:North York, ON located at 25 Sheppard Ave W, North York, ON M2N 6S8;HybridA little bit about usWhile Nestlé is known for KitKat, Gerber, Nescafe, and Häagen-Dazs, our recipe for success comes down to one thing: our people.We strive...


  • Markham, Ontario, Canada Xplore. Full time $90,000 - $150,000 per year

    Headquartered in Woodstock, New Brunswick, Xplore Inc. is one of Canada's leading broadband service providers. For over a decade, Xplore has been providing innovative broadband solutions to rural customers at work, home and play across Canada. Today, Xplore offers voice and data communication services through its unique Fiber, Wireless and Satellite...

  • Software Engineer

    1 week ago


    Markham, Ontario, Canada Advanced Micro Devices, Inc Full time $120,000 - $180,000 per year

    WHAT YOU DO AT AMD CHANGES EVERYTHING At AMD, our mission is to build great products that accelerate next-generation computing experiences—from AI and data centers, to PCs, gaming and embedded systems. Grounded in a culture of innovation and collaboration, we believe real progress comes from bold ideas, human ingenuity and a shared passion to create...


  • Markham, Ontario, Canada Xplore Inc. Full time $90,000 - $120,000 per year

    Position Overview:*Headquartered in Woodstock, New Brunswick, Xplore Inc. is one of Canada's leading broadband service providers. For over a decade, Xplore has been providing innovative broadband solutions to rural customers at work, home and play across Canada. Today, Xplore offers voice and data communication services through its unique Fiber, Wireless and...


  • Markham, Ontario, Canada Frontier Dental Supply Full time $120,000 - $180,000 per year

    ** Must be willing to work on-site in Markham office 5 days/week **   Come work with us to do what you love and stay for the Frontier TRACK … Team Centric: We each take responsibility for fostering an environment of personal and professional growth. We are eager to help, support and collaborate with one another recognizing that we are better when we...