Principal / Senior Data Engineer (Data Platforms)
vor 2 Wochen
Principal / Senior Data Engineer (Data Platforms) Location: Darlinghurst, Sydney, Australia Company Overview Simple Machines is a leading independent boutique technology firm with a global presence, including teams in London, Sydney, San Francisco, and New Zealand. We specialise in creating technology solutions at the intersection of data, AI, machine learning, data engineering, and software engineering. Our mission is to help enterprises, technology companies, and governments better connect with and understand their organisations, their people, their customers, and citizens. We design and build bespoke data platforms and unique software products, create and deploy intelligent systems, and bring engineering expertise to life by transforming data into actionable insights and tangible outcomes. Responsibilities Develop and optimise real‑time and batch data pipelines using modern streaming technologies such as Kafka, Flink, and orchestration tools like Airflow and Dataflow. Implement data‑mesh architectures, data contracts, and data products to enable a consumer‑oriented approach to data management. Build and maintain cloud data services across AWS (Redshift, S3), Google Cloud (BigQuery, Cloud Storage), and Snowflake, ensuring high performance and interoperability. Embed security by design and comply with data governance and regulatory requirements. Provide expert client advisory on data practices and solutions that align with business goals. Consulting Responsibilities Deliver client advisory on optimal data practices and solution design. Lead professional development, training, and empowerment initiatives, continuously upgrading skills and enabling client teams to maintain solutions. Ideal Skills and Experience Proficiency in SQL, Spark, and Databricks; familiarity with Snowflake and cloud storage technologies. Experience with pipeline orchestration tools such as Glue, Airflow, and DBT, and streaming technologies like Kafka, Kinesis, Pub/Sub, and Event Hubs. Knowledge of data warehousing technologies (BigQuery, Snowflake, Databricks) and data storage formats (Parquet, Delta, ORC, Avro, JSON). Infrastructure‑as‑code skills using Terraform or Pulumi. Programming skills in Python and SQL; experience in Java, Scala, Go, or Rust is an advantage. Continuous integration and deployment expertise with tools such as GitHub Actions or ArgoCD. Agile, scrum, and kanban project delivery experience. Experience in consultancy or professional services, translating business requirements into data engineering strategies. Professional Experience & Qualifications 8+ years of data engineering or equivalent experience in commercial, enterprise, or start‑up environments; consulting experience is highly beneficial. Degree or equivalent experience in computer science or a related field. Must have full Australian working rights and reside in Sydney. Employment Details Seniority level: Mid‑Senior. Employment type: Full‑time. Job function: Information Technology. #J-18808-Ljbffr
-
Principal Data Platforms Engineer
Vor 2 Tagen
Council of the City of Sydney, Österreich Simple Machines VollzeitA leading independent technology firm in Sydney is seeking a Principal/Senior Data Engineer to design and build advanced data platforms that drive innovative data solutions. The ideal candidate will have over 8 years of data engineering experience, proficiency in SQL and Spark, and the ability to work with cloud-based systems. Responsibilities include...
-
Principal / Senior Data Engineer (Data Platforms)
vor 3 Wochen
Council of the City of Sydney, Österreich Simple Machines VollzeitSimple Machines is a leading independent boutique technology firm with a global presence, including teams in London, Sydney, San Francisco, and New Zealand. We specialise in creating technology solutions at the intersection of data, AI, machine learning, data engineering, and software engineering. Our mission is to help enterprises, technology companies, and...
-
Data Engineer
vor 1 Woche
Sydney, Österreich Data#3 VollzeitOverview: We are seeking an experienced Data Engineer to join a large-scale program for an initial 3-month contract. The role will focus on building and optimising data pipelines in an Azure environment, working closely with technical teams to deliver efficient, high-quality data solutions. Responsibilities: Design, build, and maintain ETL pipelines using...
-
Council of the City of Sydney, Österreich Simple Machines VollzeitSimple Machines is a leading independent boutique technology firm with a global presence, including teams in London, Sydney, San Francisco, and New Zealand. We specialise in creating technology solutions at the intersection of data, AI, machine learning, data engineering, and software engineering. Our mission is to help enterprises, technology companies, and...
-
Principal Data
vor 3 Wochen
Council of the City of Sydney, Österreich Evolution Australia Vollzeit2 days ago Be among the first 25 applicants Direct message the job poster from Evolution Australia Building Data & AI teams across Australia @ Evolution Join a leading Australian enterprise to work on a greenfield AI platform initiative that will build the foundations for secure, scalable, and production-ready AI across the organisation. This is a hands‑on...
-
Senior Data Engineer
vor 3 Wochen
Council of the City of Sydney, Österreich Xprt Dev VollzeitSenior Data Engineer / Principal Data Engineer - Sydney On-site Posted 1 day ago Snowflake / SQL Salary: $145,000 - $165,000 + super Hybrid 2 days per week in office We’re looking for a Data Engineer / Principal Data Engineer to help shape modern, scalable data platforms that power smarter decisions and drive transformation across the business. In this...
-
Senior Data Engineer
vor 3 Wochen
Council of the City of Sydney, Österreich Talent Insights Group VollzeitTalent Insights Group provided pay range This range is provided by Talent Insights Group. Your actual pay will be based on your skills and experience — talk with your recruiter to learn more. Base pay range A$155,000.00/yr - A$165,000.00/yr Principal Data Consultant at Talent Insights - dbt | Databricks | Looker | Snowflake Senior Data Engineer ( SQL /...
-
Azure Data And Ai Principal Consultant
Vor 2 Tagen
Council of the City of Sydney, Österreich Data-Driven Ai VollzeitAzure Data and AI Principal Consultant (Anywhere in Aus) We're looking for a Fabric Principal Consultant to join our fast-growing Data and AI consultancy. You can work from anywhere in Australia, with 80% WFH. We're recognised as the go‑to experts in Microsoft Fabric and deliver exciting projects that push the boundaries with GenAI and intelligent agents....
-
Lead Platform Engineer – Data Protection
vor 9 Stunden
Council of the City of Sydney, Österreich Commonwealth Bank VollzeitA leading financial institution is seeking a Principal Platform Engineer – Data Protection in New South Wales. The successful candidate will be a senior technical leader responsible for designing and delivering scalable data protection platforms in both on-prem and cloud environments. The role demands significant expertise in storage and backup...
-
Junior Data Engineer
vor 2 Wochen
City of Melbourne, Österreich Gamma Data VollzeitGamma Data is a cloud platform and integration service provider based in Melbourne, VIC. We specialise in delivering engineering, architecture, leadership, and governance for transformation initiatives and large-scale cloud adoption programs. Our expertise spans across all cloud providers and we offer cloud platform, integration, and application design...
