Data Engineer

IntroductionThe Australian Institute of Company Directors (AICD) is committed to strengthening society through world-class governance. We aim to be the independent and trusted voice of governance, building the capability of a community of leaders for the benefit of society. Our membership of more than 50000 includes directors and senior leaders from business, government and the not-for-profit sectors.DescriptionAbout the teamTheData Analytics & AI teamworks to harness the power of data analytics and AI to drive strategic decision-making elevate member experiences and enable a culture of innovation and transparency.About the RoleWe are seeking a Data Engineer to join our growing Data Analytics and AI team. This is a fantastic opportunity to leverage your existing expertise as you will be central to building and maintaining the data infrastructure that powers analytics reporting and AI initiatives. This role involves designing implementing and optimising data models and pipelines using Microsoft Azure and Databricks technologies. A key part of your role will be transforming raw data into reliable timely insights that enable the organisation to make strategic data-informed decisions at scale. Collaborate closely with data scientists analysts and business stakeholders in a fast-paced supportive environment focused on innovation and continuous improvement.ResponsibilitiesDesign build and maintain scalable data lakehouse solutions using Azure Databricks and cloud-native toolsDevelop and optimize data ingestion pipelines (batch and real-time) leveraging ETL / ELT best practicesPerform data cleaning preparation and exploration to ensure data quality and relevanceDeliver robust analytics reporting and dashboards to support business insights and decision‑makingApply dimensional modelling principles (Kimball or Inmon) to design effective data structuresCollaborate on AI and analytics initiatives ensuring data pipelines meet performance and governance standardsImplement and uphold data governance security and data quality frameworksDrive process improvements and documentation promoting reusable code automation and DevOps practices (including CI / CD)Engage with stakeholders to understand and translate business requirements into data solutionsQualificationsYou will have strong technical aptitude and previous relevant experience and you will champion the AICD values of: Accountability, Respect, Excellence and Collaboration. In addition you will also have the following:Tertiary qualifications in a relevant field with 4 years of experience in data engineering or a related disciplineProficiency in Microsoft Azure cloud services especially Azure Databricks and Azure DevOpsStrong coding skills in SQL and Python for data manipulation and pipeline developmentDeep understanding of data warehousing and lakehouse modelling principles (Kimball or Inmon)Hands‑on experience building scalable high‑performance data architectures supporting batch and streaming data ingestionExperience with DevOps processes CI / CD pipelines and infrastructure as codeProven ability to perform data cleaning analysis and visualization using tools such as Power BIStrong organisation and prioritising skillsExcellent communication and collaboration skills with a proven track record of working across technical and business teamsAbility to take ownership of tasks or issues and manage through to resolutionYour career at the AICDOur ValuesAccountability, Respect, Excellence and CollaborationBenefitsHybrid / flexible working arrangements.Access to salary sacrificing and salary continuance (income protection) insurance.Personal wellbeing support through AICDs robust employee assistance program for you and your immediate family.A solutions focused and collaborative organisation that celebrates a One Team culture.The AICD is committed to developing its people through a capability framework and ongoing professional development plan. We support your career through access to our education platform with a wide range of training courses and webinars professional coaching and external education support.An opportunity to contribute to an organisation that is widely respected and considered the gold standard of governance policy and leadership.An opportunity to attend highly sought-after events with influential speakers.We welcome applications from people of all ages, genders, sexuality, cultural and linguistic backgrounds, Aboriginal and Torres Strait Islander Peoples and people with a disability.We provide reasonable adjustments including alternate formats to the recruitment process for individuals with disability. If you require an adjustment to be made during the recruitment process please email .For further information on what its like to work with us please visit our Careers and LinkedIn Life pages :Our Careers page : LinkedIn page : To ApplyPlease submit a resume and cover letter detailing why you are the best person for the position by clicking Apply. Please note applications close on 2 November 2025. We will be in touch with shortlisted candidates shortly after this date. If you have any queries regarding this particular opportunity please contact Lola Perez Lira Talent Acquisition Consultant via email onKey SkillsApache Hive,S3,Hadoop,Redshift,Spark,AWS,Apache Pig,NoSQL,Big Data,Data Warehouse,Kafka,ScalaEmployment Type : Full-TimeExperience : yearsVacancy : 1 #J-18808-Ljbffr