Assistant Director, Data Engineer

National Archives of Australia – Darwin NT As part of the Digital First program, the Unified Data View (UDV) will provide a complete, accurate, and up-to-date data for Business Intelligence, data analysis, and enhanced collection search capability. The Unified Data View aggregates, unifies and presents collection metadata from multiple, disparate sources into a single, cohesive view to facilitate better decision making, improve data accessibility, and enhance data analysis capabilities for staff across the National Archives of Australia. The underpinning technologies are based on Microsoft cloud technologies, including Microsoft Fabric OneLake data warehouse, Power BI business intelligence and Microsoft Azure Application Programming Interface Management (APIM). To sustain, maintain and further develop these new technologies, Technology Branch have a vacancy for an EL1 Data Engineer to manage ongoing operations of the Unified Data View. Under limited direction, the main duties of the role are to: Lead and manage the team responsible for delivery of the Unified Data View. Oversee the sustainment and development of the unified data warehouse and associated data engineering solutions. Design and implement complex ETL data flows to integrate collection system data into the warehouse, enabling the creation of business intelligence products while ensuring robust data security and governance. Manage data warehouse architecture and configuration, establish standardised data modelling guidelines, and implement industry best practices. Define and enforce data quality standards, processes, and controls, continuously monitoring data quality and integrity, and addressing issues promptly to ensure reliability. Collaborate with stakeholders to identify and prioritise data sets for ingestion into the warehouse, aligning with current and future business reporting requirements. Maintain, or ability to gain, skills in database fundamentals, Python and Power BI, Microsoft Azure SQL, Azure DevOps and MS Fabric. Relevant certifications or equivalent qualifications would be well regarded. Perform detailed analyses on data and business processes, translating business needs into actionable and effective data solutions. Support the Unified Data View’s self-service function for the wider National Archive users. Lead the development and enhancement of data engineering frameworks and best practices, focusing on optimising the availability, security, and performance of data assets and maintenance of data pipelines. Apply the principles of APS Values, Code of Conduct, workplace diversity principles, work health and safety and participative management within a work and team environment. Promote and apply the National Archives’ Vision, Mission and Commitments as expressed in in Strategy 2025–2030: Evolving National Archives and Our Values Who we are National Archives provides leadership in the best practice management of the official record of the Commonwealth and ensures that Australia Government information of enduring significance is secured, preserved and available to government agencies, researchers and the community. Our vision: Australia’s cultural identity and democracy are strengthened by connecting people with the evidence of Australian Government activities and decisions. We operate in a complex, challenging and changing environment requiring professional and robust risk management. We support a positive risk culture where risks are discussed regularly and either accepted or actively managed to prevent or reduce their impact. National Archives recognises that the factors that generate risks can also create opportunities, particularly in our rapidly changing digital environment. National Archives is committed to: inclusion National Archives is also committed to developing the capability and expertise of our staff, we offer a Studies Assistance Program that supports staff to achieve individual goals as well as increasing their capacity to help achieve National Archives’ strategic objectives. Our Health and Wellbeing program encourages and supports a healthier workplace and healthy lifestyle changes for employees. Are you eligible? To be eligible for the role you must be an Australian citizen. If you are selected, you will be required to successfully undergo a pre-employment check and be able to obtain and maintain a security clearance at a Baseline clearance level. How to apply You need to apply through our e-recruitment system. Your application will need to include: the names and contact details of at least two referees, one of whom should be a current supervisor. statement (maximum 1000 words) describing how your skills, knowledge, and experience/qualifications would enable you to perform the duties of the role taking into account the “Performance Expectations” at the relevant classification and the National Archives’ Vision, Mission and Commitments as expressed in Strategy 2025–2030: Evolving National Archives and Our Values. Be careful - Don’t provide your bank or credit card details when applying for jobs. Don't transfer any money or complete suspicious online surveys. If you see something suspicious, report this job ad. #J-18808-Ljbffr