Principal Data Engineer

Vor 6 Tagen


Sydney, Österreich Tideri Jobbörse Vollzeit

You are a passionate data engineering professional & keen learner with deep multi-disciplinary background in end-to-end data & analytics delivery value chain activities and modern data engineering technologies/ tooling/ practices.
We are a values-driven high performing team.
Together we can deliver an exemplary experience for our stakeholders and the Group.
Do work that matters "Data Delivery Group Practice" is part of "Data Products & Data Delivery" domain within CDAO.
We are a multi-disciplinary team of passionate end-to-end data & analytics delivery professionals that enables data delivery democratisation/ autonomy, uplift data maturity and literacy across the Group.
We provide data delivery thought leadership/ guidance and create leading examples of delivering data safely and swiftly for the Group, using latest data & AI strategies, cutting edge solutions, latest technology tooling, simplified delivery patterns & new ways of working.
See yourself in our team Reporting to Group Practice Lead Data Delivery, you will provide thought leadership and expertise across a range of data specific domains and technologies, leading the technical strategy across technology initiatives and large and complex data engineering platforms and products.
Responsibilities Accelerated data delivery: Understand business problems and devise data & analytics driven solutions.
Innovate to continuously identify opportunities to simplify, automate & improve data delivery speed.
Lead technically to deliver proof of concepts/ technical spikes and leading examples of accelerated data delivery using new solution patterns/ capabilities.
Lead/ execute end-to-end data delivery iteratively through requirements, solutioning, data profiling, data design/ modelling, development, testing, release management and operate in production.
Provide technical ownership and direction of data assets as required.
Set standards and ensure industry best practices of engineering and Data Dev Sec Ops are followed.
Partner with key stakeholders at a Group level to engineer improvements to the scaling and reliability of our services.
Provide advisory data engineering practice at enterprise level.
Provide thought leadership and mentoring on data engineering principles and practices, including holding platform-wide educational sessions.
Data delivery practice: Provide data delivery guidance for evolving needs from federation, strategy and transformation.
Create/ lead data delivery knowledge management outcomes via playbooks, learning materials & education sessions.
Create/ lead data maturity outcomes and data literacy initiatives.
Work with other group practices to collectively align towards data, analytics, AI & engineering outcomes.
We're interested in hearing from people who have: Over 5 years of experience at Principal/ Staff data engineer level in large Banks/ organizations.
Strong expertise in data intensive environments including databases, data lake houses, data warehouses and data platforms.
Strong understanding of data delivery life cycle & associated concepts including data analysis, data profiling, data design, data modelling, data ingestion, data cleansing, data extraction, data definitions/dictionary, data lineage mapping, data classification, data quality, etc.
Extensive experience in Big Data solutions using Cloudera Hadoop eco-systems, Teradata platform using Spark/TCF and various ETL frameworks.
Experience with AWS Cloud platform and Snowflake.
Good understanding of Data management/Data governance processes, and tools like Alation/Collibra.
Experience in data modelling concepts/ frameworks, design patterns (FSLDM, IBM IFW DW, BIAN) and techniques such as Data Vault, Kimball, 3 NF.
Skills: Advanced skills in writing SQL scripts (Spark SQL or any RDBMS), scripting in Java or Python.
Advanced scripting skills in Java or Python.
Extensive experience in building data pipelines & ETL tools like Ab Initio.
Extensive experience in designing and developing ETL test scripts for structured and unstructured data.
Advanced skills testing solutions with large data volumes and complex data transformation rules.
If this sounds like you then apply today
At Comm Bank/Bankwest, we advocate and facilitate a culture of inclusion and respect, celebrating all cultures, abilities, genders, expressions of gender and sexual orientation.
We believe in working for a place that works for you.
We have many flexible working options within our team so talk to us about which arrangements would work best for you.
#J-18808-Ljbffr



  • Sydney, Österreich Karlka Recruiting Group Vollzeit

    Contract until 30/06/2025 | Parramatta Location | State Government Agency | Full time positionContract until 30/06/2025State Government AgencyParramatta LocationAbout the companyKarlka Recruiting Group has partnered with a State Government Agency to engage a Principal Data Engineer. This position is located in their busy Parramatta office for an initial...


  • Sydney, Österreich Data Privacy Vollzeit

    This trailblazing financial services industry leader where innovation, excellence, and integrity are the cornerstones of everything they do requires a Data Engineer.They're dedicated to driving financial empowerment and success for their stakeholders through innovative data solutions.The team values creativity, collaboration, and continuous growth.As a...


  • Sydney, Österreich Karlka Recruiting Group Vollzeit

    Contract until 30/06/2025 | Parramatta Location | State Government Agency | Full time positionContract until 30/06/2025State Government AgencyParramatta LocationAbout the companyKarlka Recruiting Group has partnered with a State Government Agency to engage a Principal Data Engineer. This position is located in their busy Parramatta office for an initial...


  • Sydney, Österreich Clearcompany Vollzeit

    Contract until 30/06/2025 | Parramatta Location | State Government Agency | Full time position Contract until 30/06/2025 State Government Agency Parramatta Location About the company Karlka Recruiting Group has partnered with a State Government Agency to engage a Principal Data Engineer .This position is located in their busy Parramatta office for an initial...


  • Sydney, Österreich Tideri Jobbörse Vollzeit

    Contract until 30/06/2025 | Parramatta Location | State Government Agency | Full time position Contract until 30/06/2025 State Government Agency Parramatta Location About the companyKarlka Recruiting Group has partnered with a State Government Agency to engage a Principal Data Engineer .This position is located in their busy Parramatta office for an initial...


  • Sydney, Österreich Future Secure Ai Vollzeit

    Engineering - Software (Information & Communication Technology)Future Secure AI is a tech startup that is jointly developed with one of the world's largest financial institutions.Operating as an agile startup with deep relationships at C-suite with large global enterprises, we believe humans and AI agents will work together and give everyone the ability to...


  • Sydney, Österreich Tideri Jobbörse Vollzeit

    Engineering - Software (Information & Communication Technology) Future Secure AI is a tech startup that is jointly developed with one of the world's largest financial institutions.Operating as an agile startup with deep relationships at C-suite with large global enterprises, we believe humans and AI agents will work together and give everyone the ability to...


  • Sydney, Österreich Commonwealth Bank Vollzeit

    You are a passionate data engineering professional & keen learner with deep multi-disciplinary background in end-to-end data & analytics delivery value chain activities and modern data engineering technologies/ tooling/ practices. We are a values-driven high performing team.Together we can deliver an exemplary experience for our stakeholders and the Group....


  • Sydney, Österreich Commonwealth Bank Vollzeit

    You are a passionate data engineering professional & keen learner with deep multi-disciplinary background in end-to-end data & analytics delivery value chain activities and modern data engineering technologies/ tooling/ practices.We are a values-driven high performing team. Together we can deliver an exemplary experience for our stakeholders and the Group.Do...


  • Sydney, Österreich Datadog Vollzeit

    Datadog's mission is to provide observability, analytics and insight into companies' infrastructure environment in the cloud age to solve problems for Dev and Ops teams globally.Software engineeringFull-timeOffice | Sydney, NSW, AustraliaJunior · A role for someone with some basic skills, good motivation and ability to learn.Typically 1-2 years of...


  • Sydney, Österreich Tideri Jobbörse Vollzeit

    Datadog's mission is to provide observability, analytics and insight into companies' infrastructure environment in the cloud age to solve problems for Dev and Ops teams globally.Software engineering Full-time Office | Sydney, NSW, Australia Junior · A role for someone with some basic skills, good motivation and ability to learn.Typically 1-2 years of...

  • Data Engineer

    vor 2 Wochen


    Sydney, Österreich Rich Data Co. Vollzeit

    Hybrid and flexible working arrangementsAbout RDCRich Data Co (RDC) Delivering the Future of Credit, Today! We believe credit should be accessible, fair, inclusive, and sustainable. We are passionate about AI and developing new techniques that leverage traditional and non-traditional data to get the right decision in a clear and explainable way. Global...

  • Data Engineer

    vor 2 Wochen


    Sydney, Österreich Rich Data Co. Vollzeit

    Hybrid and flexible working arrangementsAbout RDC Rich Data Co (RDC) Delivering the Future of Credit, Today!We believe credit should be accessible, fair, inclusive, and sustainable.We are passionate about AI and developing new techniques that leverage traditional and non-traditional data to get the right decision in a clear and explainable way.Global leading...


  • Sydney, Österreich Atlassian Vollzeit

    Senior Principal Software Engineer - Team HealthEngineering | Sydney, Australia | Full-TimeWe're looking for a Senior Principal Software Engineer with at least 10 years of relevant experience to join the Engineering Health team within our Core Engineering organisation, reporting to the Head of Engineering in a fully remote position.With experience in driving...


  • Sydney, Österreich Atlassian Vollzeit

    Senior Principal Software Engineer - Team Health Engineering | Sydney, Australia | Full-Time We're looking for a Senior Principal Software Engineer with at least 10 years of relevant experience to join the Engineering Health team within our Core Engineering organisation, reporting to the Head of Engineering in a fully remote position.With experience in...

  • Senior Data Engineer

    vor 3 Wochen


    Sydney, Österreich Cdc Data Centres Vollzeit

    About us:Established in 2007, CDC Data Centres is Australia's leading operator of sovereign, secure, world-class data centre facilities.Headquartered in Canberra with multiple facilities in the ACT, NSW and New Zealand, CDC's diversified operations provide secure data centre configurations that support co-location, containerised and hyperscale compute...

  • Principal Engineer

    vor 3 Wochen


    Sydney, Österreich Hellofresh Vollzeit

    Engineering - Software (Information & Communication Technology)As a Principal Engineer - Internally your title at HelloFresh will be a Staff Software Engineer, you will play a key role in shaping and directing the systems behind HelloFresh's global twelve billion dollar operations.Based in our Chippendale office you'll work with multiple squads across...

  • Principal Engineer

    vor 2 Wochen


    Sydney, Österreich Hellofresh Vollzeit

    The roleAs a Principal Engineer - Internally your title in HelloFresh will be a Staff Software Engineer, you will play a key role in shaping and directing the systems behind HelloFresh's global twelve billion dollar operations. Based in our Chippendale office you'll work with multiple squads across critical domains like order processing, logistics, and...

  • Principal Engineer

    vor 3 Wochen


    Sydney, Österreich Hellofresh Vollzeit

    The roleAs a Principal Engineer - Internally your title in HelloFresh will be a Staff Software Engineer, you will play a key role in shaping and directing the systems behind HelloFresh's global twelve billion dollar operations.Based in our Chippendale office you'll work with multiple squads across critical domains like order processing, logistics, and...


  • Sydney, Österreich Clearcompany Vollzeit

    Principal EngineerCurrently looking for a Principal Engineer for an initial 6 month day rate contract paying up to $1200 per day inclusive of super for one of our leading financial services providers in Sydney.Contract extensions on offer too.If you have any knowledge in:Experience across Privileged Access ManagementExtensive experience with Hashicorp Vault...