Lead Data Engineer

Vor 5 Tagen


Melbourne, Österreich Clearcompany Vollzeit

Lead Data Engineer required to lead the design and development of end-to-end data pipelines for a leading financial services business.Responsibilities:Design and development of pipelines using Databricks and Lakehouse.Optimisation and maintenance of data workflows, ensuring quality and integrity.Performance tuning and monitoring.Notebook development using Pyspark and Spark SQL.Implementation of best practices for data engineering, including governance and security.Mentoring and coaching of junior Data Engineers.Requirements:Extensive experience building data pipelines in a Databricks Lakehouse environment.Well-versed with Spark and other big data technologies.Excellent coding skills using SQL and Python.Expertise working on Azure platform.
#J-18808-Ljbffr


  • Data Engineer

    vor 2 Monaten


    Melbourne, Österreich Data Privacy Vollzeit

    Contract role initially until 30th June 2022Geelong based organisation - hybrid work modelGenerous rateThis is an opportunity for a Senior Data Engineer to join an organisation undertaking a business transformation, that is not only improving the way they operate, improving customer experience, but contains data and analytics as one of its pillars.The role...


  • Melbourne, Österreich Ntt Data Business Solutions Vollzeit

    NTT DATA is heavily investing globally in providing state of the art analytical solutions to its clients. Our capability has been focused locally, regionally in APAC and globally by forming strategic partnerships including Microsoft Azure, SAP Analytics, Snowflake, Matillion and many more, leveraging the strength of our cloud and network assets via the NTT...


  • Melbourne, Österreich Ecf Data, Llc Vollzeit

    Capgemini is a global strategic and technological expert collective, operating in over 50 countries with more than 350,000 professionals.They partner with renowned clients to transform businesses using cloud, data, AI, and digital engineering.The company has significantly expanded in Australia and New Zealand, with over 3,500 team members.Join their rapidly...


  • Melbourne, Österreich Buscojobs Vollzeit

    Job Description for Lead Data Engineer in Sydney. Experience: 10+ years in Software Engineering, Cloud Computing, Databricks, and Big Data.Key Responsibilities: Data EngineeringData WarehousingSolution DesignData AnalysisVisualizationData ModelingProgramming Languages: Python, Scala, SQLCloud Technologies: Azure and DatabricksBig Data Technologies: Cloudera...

  • Lead Engineer

    vor 1 Woche


    Melbourne, Österreich Buscojobs Vollzeit

    Global Technology Solutions (GTS) at ResMed is a division dedicated to creating innovative, scalable, and secure platforms and services for patients, providers, and people across ResMed.The primary goal of GTS is to accelerate well-being and growth by transforming the core, enabling patient, people, and partner outcomes, and building future-ready...

  • Data Engineer

    vor 1 Monat


    Melbourne, Österreich State Government Of Victoria, Australia Vollzeit

    Organisation: Office of the Director-GeneralOccupation: IT and TelecommunicationsReference: 5901About this OpportunityThe Reporting and Analytics team in the Office of Director-General (ODG) is responsible for enabling better consumption of data and reporting for stakeholders across the Victorian Infrastructure Delivery Authority (VIDA) by maintaining an...

  • Data Engineer

    vor 1 Monat


    Melbourne, Österreich State Government Of Victoria, Australia Vollzeit

    Organisation: Office of the Director-GeneralOccupation: IT and TelecommunicationsReference: 5901About this OpportunityThe Reporting and Analytics team in the Office of Director-General (ODG) is responsible for enabling better consumption of data and reporting for stakeholders across the Victorian Infrastructure Delivery Authority (VIDA) by maintaining an...

  • Data Engineer

    vor 1 Monat


    Melbourne, Österreich State Government Of Victoria, Australia Vollzeit

    Organisation: Office of the Director-GeneralOccupation: IT and TelecommunicationsReference: 5901About this Opportunity The Reporting and Analytics team in the Office of Director-General (ODG) is responsible for enabling better consumption of data and reporting for stakeholders across the Victorian Infrastructure Delivery Authority (VIDA) by maintaining an...

  • Data Engineer

    vor 1 Monat


    Melbourne, Österreich State Government Of Victoria, Australia Vollzeit

    Organisation: Office of the Director-GeneralOccupation: IT and TelecommunicationsReference: 5901About this Opportunity The Reporting and Analytics team in the Office of Director-General (ODG) is responsible for enabling better consumption of data and reporting for stakeholders across the Victorian Infrastructure Delivery Authority (VIDA) by maintaining an...

  • Data Engineer

    vor 2 Wochen


    Melbourne, Österreich National Film And Sound Archive Of Australia Vollzeit

    The Data Engineer will play a key role in enhancing the NFSA's ability to manage, analyse, and report on data across multiple domains.Working closely with the software engineering and ICT teams, the Data Engineer will drive the development of advanced data infrastructure to support NFSA's data-driven decisions during early system and process...

  • Data Engineer

    vor 2 Monaten


    Melbourne, Österreich Experis Manpowergroup Sp. Z O.O. Vollzeit

    Are you a skilled Data Engineer with expertise in data modelling and a strong background in Microsoft Azure?Do you have a passion for working with large datasets and geospatial data?If so, we want to hear from you!A dynamic organisation is seeking a Data Engineer to join their team and help improve the performance of a critical database used for airspace...

  • Senior Data Engineer

    vor 4 Wochen


    Melbourne, Österreich Tridant Pty Ltd Vollzeit

    We are seeking an experienced Data Engineer or Senior Data Engineer to design, implement, and maintain data solutions using Microsoft Fabric and related technologies. The ideal candidate will bridge the gap between business needs and technical solutions, working within an Agile framework to deliver scalable data platforms.Key Responsibilities Lead the design...

  • Data Engineer

    vor 1 Monat


    Melbourne, Österreich Victorian Infrastructure Delivery Authority Vollzeit

    Company description: VIDA is established as an Administrative Office under the Public Administration Act 2004 as a specialist organisation.The Victorian Infrastructure Delivery Authority (VIDA) is responsible for delivering the biggest transport and health infrastructure program in Victorian history.This includes more than 200 projects such as the Metro...


  • Melbourne, Österreich Suncorp Vollzeit

    Flexible Locations of Brisbane, Sydney, Melbourne Lead and mentor a high-performing team while advancing your technical expertise Collaborate with cutting-edge technologies such as Databricks, DBT and AWS Redshift Suncorp is looking for a talented Senior Data Engineer to join our Insurance & Enterprise Technology (IET) team and lead the development of...

  • Data Engineering Lead

    vor 2 Monaten


    Melbourne, Österreich Randstad Vollzeit

    Lead Data Architect/EngineerRate: $900-1050 /Day Inclusive of SuperannuationLocation: Melbourne CBDOpportunity: To work on challenging and impactful projects. This role will give the successful applicant the opportunity to have an impact on people across Victoria and really refine their existing Data Architecture, Modelling, Engineering, Integration, and...

  • Data Engineering Lead

    vor 2 Monaten


    Melbourne, Österreich Randstad Vollzeit

    Lead Data Architect/Engineer Rate: $900-1050 /Day Inclusive of Superannuation Location: Melbourne CBD Opportunity: To work on challenging and impactful projects.This role will give the successful applicant the opportunity to have an impact on people across Victoria and really refine their existing Data Architecture, Modelling, Engineering, Integration, and...

  • Data Engineer

    vor 3 Monaten


    Melbourne, Österreich Ultradynamix Vollzeit

    Role: Data Engineer Client: Federal Government Contract: 12 Months Extension: 12 Months(2) Clearance: baseline Location: ACT or Offsite Requirements The CIO Division provides a range of enabling services and operations delivery to the department and to Australian businesses and is seeking an experienced and motivated data engineer to assist with the delivery...

  • Data Engineer

    vor 1 Woche


    Melbourne, Österreich Energy Australia Vollzeit

    This is a Data Engineer - Customer role with one of the leading companies in AU right now 🔥 -- Energy Australia -- with an amazing team. They are continuing to grow rapidly. This is the chance to join right as the 🚀 takes off.More About the Role at Energy Australia 🧐🧐**About the role…** ‘Powering EnergyAustralia to make better data driven...


  • Melbourne, Österreich Buscojobs Vollzeit

    Data Engineer Hays Adelaide, AustraliaExciting Onsite - Initial 6-Month Contract Opportunity for a Data EngineerYour new company One of our clients is seeking a highly skilled Principal Data Engineer to join the dynamic team.This role is crucial for delivering quality-assured data products and managing the broader data architecture.You will lead a team of...

  • Data Engineering Lead

    vor 2 Monaten


    Melbourne, Österreich Tideri Jobbörse Vollzeit

    About this role Who we are:Urbis is people focused, and we want the best for our team, our clients, and our communities.We are a community of passionate problem solvers, sought out by clients for our fresh thinking and approach to their city-shaping projects.Our mission is to help create meaningful, sustainable cities & communities.Urbis is an employer of...