Data Engineer: Azure Databricks

Responsibilities Design and develop scalable data pipelines using Azure Databricks , Delta Lake, and PySpark. Build and optimize ETL/ELT workflows across Azure Data Lake Storage (ADLS) and other data sources. Implement Delta Lake for ACID transactions, versioning, and high-performance data processing. Integrate Databricks with Azure services such as Azure...

A leading retail business is seeking a Senior Data Engineer to support the development of an Azure Databricks platform. The role involves designing and developing data pipelines, optimising workflows, and ensuring data quality and integrity. Ideal candidates should have extensive experience in Azure Databricks, proficiency in PySpark and SQL, and knowledge...

A leading technology company in Australia seeks a highly skilled Azure Data Platform Engineer. This role requires designing and managing robust data solutions on Microsoft Azure, with a focus on Azure Synapse and Azure Databricks. The ideal candidate will possess deep expertise in cloud infrastructure management, security protocols, and performance...

Senior Data Engineer required to support the development of an Azure Databricks platform for a leading retail business. Responsibilities: design and development of pipelines using Databricks and Lakehouse optimisation and maintenance of data workflows, ensuring quality and integrity performance tuning and monitoring set up and manage CI/CD pipelines Notebook...

A major infrastructure services provider in Melbourne is seeking a Data Engineer for a 12-month contract. The role involves designing end-to-end data architecture solutions, utilizing Azure Databricks and Data Factory, and ensuring data quality and performance. Candidates should have tertiary qualifications in IT, strong skills in relevant technologies, and...

A leading global insurance broker is seeking a Data Engineer to drive their data transformation journey. This role involves designing scalable data architectures, building high-performance data pipelines using Azure Databricks, and ensuring data governance and security. The ideal candidate will have experience in data engineering, strong SQL and Python...

A prominent technology group in Australia is looking for a Data Engineer with at least 5 years of experience. The role involves designing, building, and optimizing data pipelines using Azure Databricks. Candidates should be proficient in SQL and have strong programming skills in Python, Scala, or Java. You will implement monitoring processes and work...

Role: Data Engineer - Databricks & FabricSalary: $160K - $180K PackageContract Length: 12-month FTCLocation: Remote in Australia We are partnering with a large, complex enterprise undergoing a major transformation of its cloud data and analytics platform. This program is focused on building a modern, secure and automated environment across Azure Databricks,...

A leading consulting firm is seeking an experienced Data Engineer in Sydney to design and optimize data solutions using Azure Databricks and Fabric. Responsibilities include developing robust data pipelines, mentoring junior engineers, and implementing data quality frameworks. The ideal candidate will have 5+ years in data engineering, strong communication...

A leading consulting firm is looking for an experienced Data Engineer to enhance their team in Sydney & Melbourne. The ideal candidate will excel in designing data pipelines, optimizing data quality, and collaborating with cross-functional teams to deliver effective data products. Essential skills include strong expertise in Azure, Databricks, and Python....