Staff / Lead Data Engineer (AWS, Big Data)

vor 2 Wochen

Council of the City of Sydney, Österreich Commonwealth Bank Vollzeit

Join to apply for the Staff / Lead Data Engineer (AWS, Big Data) role at Commonwealth Bank . About the role As a Staff Data Engineer with expertise in software development and a passion for building data‑driven solutions, you’ll work at the forefront of Big Data and Data Warehouse technologies. Your work will help improve the standard of digital banking, using the latest tech to solve our customers’ most complex data‑centric problems. The Risk Data Analytics and Insights team delivers data, insights and software outcomes to support Risk Management and other business units. You’ll work across platforms such as AWS Cloud, Cloudera Hadoop, Teradata, Ab Initio, and emerging Generative AI solutions. Qualities we look for Experience driving cost‑effective, technologically feasible solutions that meet operational and strategic goals. Thought leadership and contribution to design of technical solutions, including data security and data management. Responsibility for technical governance, implementation, risk management and adoption for programs of work. Technical leadership and mentoring of engineers in Agile teams delivering project work or initiatives. Strong communication and coordination skills with internal stakeholders and consultants. Ability to build group data products from scratch, integrating large data sets from internal and external sources in alignment with data mesh principles, patterns, guardrails or architecture blueprints. Technical Skills Designing, building, and delivering enterprise‑wide data ingestion, integration and pipeline solutions using Scala, Java or Python on Big Data and Data Warehouse platforms. Experience with Hadoop, Spark, MapReduce, Sqoop, Kafka and ETL frameworks for distributed data processing and storage. Experience with AWS Cloud technologies such as EMR, Glue, Kinesis, MSK/Kafka, Data Zone, SageMaker, Event Bridge, MWAA, Redshift/PostgreSQL, DocumentDB/MongoDB, S3, Athena, Lambda. Proficiency in SQL and complex query writing for pipeline construction. Experience with source control, DevSecOps, CI/CD tooling (GitHub Actions), CloudFormation, GitOps and serverless frameworks. Ability to fine‑tune ETL jobs, query performance and cost efficiencies. Knowledge of data warehousing and/or data mart build experience in Teradata is a plus. Certifications in Cloudera CDP, Hadoop, Spark, Teradata or AWS Data Engineer are desirable. Working with us We value diversity, inclusion and flexibility. You can work remotely most days but will connect with us at least half a month’s time in the office. Flexible hours, part‑time arrangements and job‑share options are also available. If this sounds like the role for you, we would love to hear from you. Apply today For Commonwealth Bank Group members, please apply through Sidekick to submit a valid application. #J-18808-Ljbffr

  • Staff / Lead Data Engineer (AWS, Big Data)

    vor 3 Wochen

    Council of the City of Sydney, Österreich Commonwealth Bank Vollzeit

    Staff Data Engineer (AWS, Big Data) You are determined to stay ahead of the latest Cloud, Big Data and Data warehouse technologies. We're one of the largest and most advanced Data Engineering teams in the country. Together we can build state‑of‑the‑art data solutions that power seamless experiences for millions of customers. Do work that matters As a...

  • Staff Data Engineer

    vor 3 Wochen

    Council of the City of Sydney, Österreich Commonwealth Bank Vollzeit

    A leading financial institution in New South Wales is seeking a Staff Data Engineer with expertise in AWS and Big Data technologies. The ideal candidate will drive innovative data solutions and mentor junior engineers while collaborating across teams to enhance digital banking capabilities. This role offers a flexible work environment and opportunities to...

  • Remote Staff Data Engineer — AWS, Big Data

    vor 2 Wochen

    Townsville City, Österreich Commonwealth Bank Vollzeit

    A leading banking institution is seeking a Staff / Lead Data Engineer to develop innovative data-driven solutions utilizing AWS Cloud and other emerging technologies. This role involves mentoring team members, designing technical solutions, and ensuring data security and governance. Candidates should have strong programming skills in Scala, Java, or Python,...

  • AWS Data Engineer

    vor 4 Wochen

    Council of the City of Sydney, Österreich Recmatrix Consulting Vollzeit

    Direct message the job poster from Recmatrix Consulting Director/Recruitment Specialist @ Recmatrix | IT & Non-IT Hiring | Ex-HCL Job Title: AWS Data Engineer Role: Contract Location: Sydney, Australia Experience: 6-10 years About the Position: The Data Engineer will play a crucial role in designing, developing, and executing data processing and migration...

  • Staff / Lead Data Engineer (Oracle, AWS)

    vor 2 Wochen

    Council of the City of Sydney, Österreich Commonwealth Bank Vollzeit

    Staff Data Engineer (Oracle, AWS) As a Staff Data engineer with expertise in data engineering, software development/programming and a passion for building data-driven solutions, you’re ahead of trends and work at the forefront of AWS Cloud, AI, and data warehouse technologies. This role is a perfect fit for a data‑savvy engineer committed to improving...

  • Staff Data Platform Engineer

    vor 2 Wochen

    Council of the City of Sydney, Österreich Commonwealth Bank Vollzeit

    A leading financial institution in Sydney is seeking a Staff Platform Engineer to architect and build its enterprise-scale data lake on AWS. This role involves creating reusable patterns for data ingestion, implementing data governance frameworks, and leading the migration of legacy systems to modern platforms. The ideal candidate should have extensive...

  • Staff Data Engineer: AWS Data Lake

    vor 3 Wochen

    Council of the City of Sydney, Österreich CommBank Vollzeit

    A leading Australian bank is seeking a Staff Data Engineer to build data-driven solutions using AWS Cloud and Data Lake technologies. You will design secure interfaces, migrate data from Oracle to AWS, and oversee data outcomes. The ideal candidate has expertise in large-scale data processing, ETL processes, and strong programming skills in Python and SQL....

  • Data Engineer

    vor 2 Wochen

    Council of the City of Sydney, Österreich Amazon Web Services (AWS) Vollzeit

    Data Engineer – AWS Data Center Infrastructure Operations As a Data Engineer, you will enable data‑driven decision making within the Amazon Web Services (AWS) Data Center Infrastructure Operations organization. The Infrastructure Operations Team is responsible for planning, implementing, monitoring and continuously improving the global Amazon Data Center...

  • Data Engineer

    vor 2 Wochen

    Council of the City of Sydney, Österreich Amazon Web Services (AWS) Vollzeit

    Join to apply for the Data Engineer role at Amazon Web Services (AWS) . Job Overview As a Data Engineer you will enable data-driven decision making within the Amazon Web Services (AWS) Data Center Infrastructure Operations organization. Infrastructure Operations The Infrastructure Operations Team is responsible for planning, implementing, monitoring and...

  • Staff Data Engineer

    vor 2 Wochen

    Council of the City of Sydney, Österreich Commonwealth Bank Vollzeit

    A leading financial institution is looking for a mid-senior Staff Data Engineer to work on innovative data-driven solutions. This role involves design and delivery of mobile customer interfaces, migration of legacy data to cloud systems, and overseeing data outcomes for payment services. Ideal candidates should have strong skills in data engineering, Oracle,...