AWS Data Engineer Consultant| PySpark, Delta Lake

A leading consultancy firm in Australia is seeking an experienced Data Engineer Consultant to support large-scale data processing and compliance initiatives. The role involves designing, building, and maintaining scalable data pipelines using modern technologies like PySpark, Delta Lake, and Databricks. Applicants should have several years' experience in...

A leading consultancy firm is seeking an experienced Data Engineer Consultant to support large-scale data processing and compliance initiatives. This technical role focuses on designing and maintaining data pipelines using technologies such as PySpark, Delta Lake, and Apache Airflow. The ideal candidate has extensive experience with AWS and a solid...

5 days ago Be among the first 25 applicants Get AI-powered advice on this job and more exclusive features. InfoCentric is a leading consultancy specialising in data engineering, compliance-driven data ecosystems, and modern data platform solutions. We help organisations build robust, scalable, and secure data foundations by delivering expertise across Data...

InfoCentric is a leading consultancy specialising in data engineering, compliance-driven data ecosystems, and modern data platform solutions. We help organisations build robust, scalable, and secure data foundations by delivering expertise across Data Engineering, Cloud Platforms, Advanced Analytics, and Data Governance. About the role: We are looking for an...

Design, build, and optimize scalable data pipelines using PySpark within distributed data processing frameworks. Develop clean, efficient, and reusable Python scripts for ETL, automation, and data transformation tasks. Work with Spark SQL , Data Frames, and RDDs to process large-scale structured and unstructured datasets. Implement highly performant data...

This range is provided by Humanised Group. Your actual pay will be based on your skills and experience — talk with your recruiter to learn more. Base Pay Range A$ / hr - A$ / hr Direct message the job poster from Humanised Group Recruitment Consultant | Data Analytics & AI | Data Mornings - Helping Data Professionals Network & Grow 3 Month Contract |...

Software/Data Engineer (Databricks) Core Responsibilities Build, enhance, and maintain data pipelines in Databricks notebooks using Python and SQL. Work with Delta Lake for structured and semi‑structured data. Develop and automate Databricks Jobs / Workflows for scheduled processing. Transform and clean data across bronze/silver/gold layers, using dbt...

Data Engineer (AWS, Python, PySpark) – Kaizen Global Technologies Employment: Permanent Role | Experience: 7+ years | Location: Sydney, Australia – Hybrid | Eligibility: Candidates must have the right to work in Australia (Citizen, PR, Valid Visa holders). We are seeking a Data Engineer with strong expertise in AWS, Python, PySpark, and data...

Join DataIQ as we expand our Data & AI practice to build modern data products on Microsoft Fabric. You'll be part of the team that owns ingestion, orchestration and transformation Microsoft Fabric, Spark and Power BI, delivering a variety of services to our clients that power enterprise semantic models and reports. Australian work rights are required for...

Responsibilities Design and develop scalable data pipelines using Azure Databricks , Delta Lake, and PySpark. Build and optimize ETL/ELT workflows across Azure Data Lake Storage (ADLS) and other data sources. Implement Delta Lake for ACID transactions, versioning, and high-performance data processing. Integrate Databricks with Azure services such as Azure...