Senior Data Engineer

About the role You will play a key role in turning data into business value by designing, building, testing, deploying and maintaining scalable data solutions on the Azure Data Platform. Reporting to the Manager Data Platforms Engineering and Delivery you will: Deliver robust data pipelines, models and integrations using Azure Databricks, SQL and Python. Implement security & access controls, auditing and monitoring to safeguard data. Monitor pipeline health (throughput / latency) and drive continuous performance improvements. Diagnose / troubleshoot complex issues and outages across data flows, pipelines and infrastructure. Contribute technical input to architecture blueprints, design documents, standards and procedures. Collaborate with data architects, BAs and stakeholders to translate business needs into scalable solutions and oversee implementation details. Keep current with emerging data tech to enhance our platform and practices. Qualifications & Experience Several years experience in data engineering with expertise in integration modelling and warehousing. Proficiency with Databricks, SQL and Python; strong grasp of cloud architecture and distributed computing. ETL / ELT design and implementation; metadata management for data engineering. Practical experience translating business requirements into technical solutions and defining end‑to‑end data flows / pipelines with BAs and architects. Data modelling expertise (3NF, Kimball). Working knowledge of Git and DevOps practices (Azure DevOps desirable). Strong analytical skills with attention to detail and accuracy. Leadership and mentoring abilities to guide junior engineers. Excellent communication, collaboration and technical writing skills. Degree in Computer Science, Information Technology, Engineering or demonstrated capability. About You You’re an experienced data engineering professional who thrives on building reliable, secure and performant data platforms and enjoys collaborating across teams. You communicate clearly (written & verbal) and balance hands‑on engineering with sound design judgement. You’ll bring Several years experience in data engineering with expertise in integration modelling and warehousing. Proficiency with Databricks, SQL and Python; strong grasp of cloud architecture and distributed computing. ETL / ELT design and implementation; metadata management for data engineering. Practical experience translating business requirements into technical solutions and defining end‑to‑end data flows / pipelines with BAs and architects. Data modelling expertise (3NF, Kimball). Working knowledge of Git and DevOps practices (Azure DevOps desirable). Strong analytical skills with attention to detail and accuracy. Leadership and mentoring abilities to guide junior engineers. Excellent communication, collaboration and technical writing skills. Why Essential Energy We offer competitive remuneration commensurate with skills and experience, 16.5% superannuation, 26 weeks paid parental leave and extensive learning and development opportunities. Health and wellbeing programs include a fitness passport. For more information on our benefits please visit the employee benefits page. Essential Energy is proud to be recognised as a WORK180 Endorsed Employer for All Women. As a pivotal player in the future energy industry, our organisation takes a future‑horizon perspective and isn’t afraid to make decisions for the long term. Our people do the same, knowing that their perspective, effort and achievements are critical to the success of our whole organisation. We offer a diverse range of opportunities in a future‑focused environment where you can build a career and invest in your own future wherever you live. Applications close on Sunday 2 November 2025 at 11:55pm. Passionate people. Global thinking. Regional heart. Building a better energy future. Commitment to Diversity and Inclusion Essential Energy is committed to building a culturally diverse and inclusive workplace and strongly encourages applicants to apply regardless of gender, age, ethnicity, sexual orientation or disability. As an organisation, we aim to champion inclusivity in the workplace and celebrate the difference in all employees. We support adjustments throughout the recruitment and selection process as well as during employment. We actively support and encourage people with disability to apply to Essential Energy (including alternate formats of application forms or alternate ways for accessibility). To discuss adjustment requirements please contact or call us. Required Experience Senior IC Key Skills Apache Hive, S3, Hadoop, Redshift, Spark, AWS, Apache Pig, NoSQL, Big Data, Data Warehouse, Kafka, Scala Employment Details Employment Type : Full‑Time Experience : years Vacancy : 1 #J-18808-Ljbffr