Big Data Lead Engineer

vor 1 Monat


Sydney, Österreich Paxus - Technology + Digital Talent Vollzeit

Responsibilities: Design, develop, test, and support future-ready data solutions for customers across industry verticals.Produce detailed solution design and support data engineers and testers as a technical lead in a data project.Develop, test, and support end-to-end batch and near real-time data flows/pipelines.Demonstrate understanding in data architectures, modern data platforms, big data, data modelling, ML/AI, analytics, cloud platforms, data governance, and information management and associated technologies.Develop and demonstrate proof of concepts and working demos.Skills Required: Must understand and navigate large organizations' governance and processes with ease.Must have exceptional interpersonal skills and be able to present solution design with confidence in large technical forums.Minimum of 5+ years of experience as a solution designer, tech lead, developer, tester, or support role in IT consulting or other technology business units across the industry, with a preference for Banking/FSS.Minimum of 3+ years of hands-on development, testing, and administration experience with Big Data/Data Lake services in cloud and on-premise.Experience in applying industry best practices, design patterns, and first-of-a-kind technical solutions as a developer or administrator on data and non-data specific platforms and applications.Experience in NoSQL databases such as HBase.Experience in implementing near real-time data flows/pipelines and distributed streaming applications using technology such as Apache Kafka.Understanding of various data modelling concepts and techniques such as Entity Relationship Modelling, Third Normal Form, Dimensional Modelling.Understanding of Data Mesh Architecture and Domain Data Products.Experience in implementing traditional ETL, data warehousing, and BI solutions.Hands-on implementation of services sensitive to performance SLAs with high availability, fault-tolerance, automatic fail-over, and geographical redundancy.Working knowledge and hands-on experience with cloud platforms such as Azure, AWS, GCP, and IBM, and other modern data platforms.Solid understanding of containerization, virtualization, infrastructure, and networking.Diverse experience in software development methodologies and project delivery frameworks such as Agile Sprints, Kanban, Waterfall, etc.Application Process: Outstanding opportunity to join an industry giant.
Apply now.
To be considered for the role, click the 'apply' button or for more information about this and other opportunities, please contact James McVey on or email: and quote the above job reference number.
Paxus values diversity and welcomes applications from Indigenous Australians, people from diverse cultural and linguistic backgrounds, and people living with a disability.
If you require an adjustment to the recruitment process, including the application form in an alternate format, please contact me on the above contact details.
#J-18808-Ljbffr


  • Lead Engineer

    vor 2 Monaten


    Sydney, Österreich Experis Manpowergroup Sp. Z O.O. Vollzeit

    Experis are proud to be representing a prestigious financial services organisation who are recruiting for an experienced Lead Engineer - Big Data to join their team on a contract basis and lead the design, development, and delivery of future-ready data solutions.As a technical lead, you will work closely with cross-functional teams to provide cutting-edge...

  • Lead Engineer

    vor 1 Monat


    Sydney, Österreich Tideri Jobbörse Vollzeit

    Experis are proud to be representing a prestigious financial services organisation who are recruiting for an experienced Lead Engineer - Big Data to join their team on a contract basis and lead the design, development, and delivery of future-ready data solutions.As a technical lead, you will work closely with cross-functional teams to provide cutting-edge...


  • Sydney, Österreich Zone It Solutions Vollzeit

    We are seeking a Big Data Solution Engineer.This role involves designing and implementing scalable big data solutions to support our clients' analytical needs. Responsibilities and Qualifications Minimum of 5 years of experience in Big Data technologies and architectures. Proficient in Hadoop ecosystem components (HDFS, Hive, Pig, Spark, etc.)and relevant...


  • Sydney, Österreich Tideri Jobbörse Vollzeit

    We are seeking a Big Data Solution Engineer.This role involves designing and implementing scalable big data solutions to support our clients' analytical needs.Responsibilities and Qualifications Minimum of 5 years of experience in Big Data technologies and architectures.Proficient in Hadoop ecosystem components (HDFS, Hive, Pig, Spark, etc.)and relevant data...

  • Lead Data Engineer

    vor 2 Wochen


    Sydney, Österreich Cognizant Vollzeit

    Position Title: Lead Data Engineer Company OverviewCognizant (NASDAQ: CTSH) is a leading provider of information technology, consulting, and business process services, dedicated to helping the world's leading companies build stronger businesses. Headquartered in Teaneck, New Jersey (U.S.), Cognizant combines a passion for client satisfaction, technology...


  • Sydney, Österreich Tideri Jobbörse Vollzeit

    If you have GCP experience and you're seeking a new job in Sydney, we want to hear from you.Cognizant is recruiting a Lead GCP Data Engineer, and the role comes with an attractive salary and benefits package.In this role, you will cultivate innovation within your team and partners and will demonstrate and encourage life-long learning.In your first few weeks...

  • Data Engineer

    vor 2 Monaten


    Sydney, Österreich Open Axcss Vollzeit

    The Data Engineer is responsible for building and supporting the big data platform.As a Data Engineer, your responsibilities include: Develop, test and support future-ready data solutions for customers across industry verticals.Develop, test and support end-to-end batch and near real-time data flows/pipelines.Demonstrate understanding in data architectures,...

  • Data Engineer

    vor 4 Wochen


    Sydney, Österreich Commonwealth Bank Vollzeit

    This is a Data Engineer - Big Data and Visualization role with one of the leading companies in AU right now 🔥 -- Commonwealth Bank -- with an amazing team. They are continuing to grow rapidly. This is the chance to join right as the 🚀 takes off.More About the Role at Commonwealth Bank 🧐🧐Do work that matters: As a Data engineer, you’ll be...

  • Data Engineer

    vor 1 Monat


    Sydney, Österreich Open Axcss Vollzeit

    The Data Engineer is responsible for building and supporting the big data platform. As a Data Engineer, your responsibilities include:Develop, test and support future-ready data solutions for customers across industry verticals.Develop, test and support end-to-end batch and near real-time data flows/pipelines.Demonstrate understanding in data architectures,...

  • Senior Data Engineer

    vor 1 Monat


    Sydney, Österreich M&T Resources Vollzeit

    Sydney IT & Telecomms DBA / Database Developer Big 4 banking experience highly beneficial Azure / Data Migration/ Pyspark / Data Warehousing Hybrid working environment / Day Rate contract Are you an experienced Data Engineer with a passion for driving large scale data migrations?Do you have a strong background in building data platforms and automated...

  • Azure Data Engineer

    vor 3 Wochen


    Sydney, Österreich M&T Resources Vollzeit

    Sydney IT & Telecomms DBA / Database Developer Big 4 banking experience highly beneficial Azure / Data Migration/ Pyspark / Data Warehousing Hybrid working environment / Day Rate contract Are you an experienced Data Engineer with a passion for driving large scale data migrations?Do you have a strong background in building data platforms and automated...

  • Principle Chapter Lead

    vor 4 Wochen


    Sydney, Österreich Big W X Vollzeit

    Principle Chapter Lead - Engineering | BIG WXEngineering - Software (Information & Communication Technology)Full timeIt's the start of something bigger.There are over 15,000 of us, in the biggest cities and the tiniest towns.And each of us have an important role to play.If you have a passion for great customer service, a desire to make a real difference for...


  • Sydney, Österreich Cognizant Vollzeit

    Cognizant has an exciting opportunity for a skilled and collaborative Senior /Lead Data Engineers with hands-on experience in Pyspark & Scala to join our thriving team. This full-time role is based in Sydney and offers an attractive salary and benefits. You'll be joining a collaborative and inclusive team seeking to be at the forefront of the business unit...


  • Sydney, Österreich Tideri Jobbörse Vollzeit

    Cognizant has an exciting opportunity for a skilled and collaborative Senior /Lead Data Engineers with hands-on experience in Pyspark & Scala to join our thriving team.This full-time role is based in Sydney and offers an attractive salary and benefits.You'll be joining a collaborative and inclusive team seeking to be at the forefront of the business unit and...

  • Lead Data Engineer

    vor 3 Wochen


    Sydney, Österreich West Recruitment Pty Ltd Vollzeit

    Call: West Sector: Technology Job Summary Join this certified 'Great Place to Work' business.Spearhead a Data Transformation initiative.Western Sydney Location - Defined WFH Policy.Job Description About Your New Employer:West Technology is proud to be partnering with an Australian owned group that has grown to become a genuine market leader across multiple...


  • Sydney, Österreich Experis Manpowergroup Sp. Z O.O. Vollzeit

    On behalf of our client, a leading financial services organization, we are seeking a Solution Engineer/Designer to join their innovative data solutions team on a contract basis.This is a high-impact role that operates at the intersection of data engineering, analytics, platforms, and project delivery, providing thought leadership and innovation in the design...

  • Lead Data Engineer

    vor 1 Monat


    Sydney, Österreich Baptistcare Nsw & Act Vollzeit

    Fulltime permanent position in Norwest | Hybrid office environmentNewly created role supporting the Data & Analytics StrategyDesign, implement & optimise data platform with an industry leading NFPAbout the role: Reporting to the Data and Analytics (D&A) Manager, the Lead Data Engineer will design and implement data warehouse and foundational data assets in...

  • Lead Data Engineer

    vor 2 Monaten


    Sydney, Österreich Baptistcare Nsw & Act Vollzeit

    Fulltime permanent position in Norwest | Hybrid office environment Newly created role supporting the Data & Analytics Strategy Design, implement & optimise data platform with an industry leading NFP About the role: Reporting to the Data and Analytics (D&A) Manager, the Lead Data Engineer will design and implement data warehouse and foundational data assets...

  • Data Engineer

    vor 3 Wochen


    Sydney, Österreich Attribute Group Vollzeit

    Data Engineer Permanent  $130k-$140k + Super  Our client is seeking a seasoned Data Engineer with expertise in the Cloudera Data Platform (CDP) and Spark-based ingestion pipelines.This role is ideal for a professional with a strong background in building and optimising data pipelines and a track record of working with large-scale data infrastructures.Key...

  • Data Engineer

    vor 2 Wochen


    Sydney, Österreich Finxl Vollzeit

    Data Engineer x 2 Term: 6-12mths ++ Location: Sydney preferred but maybe Melbourne Hybrid working: (3days) & WFH (2days) Key requirements: DBT with Redshift/Snowflake or likewiseGood understanding of Data Warehouse design and data modelsExpert level skill on writing and debugging SQL on big data platforms (Redshift,PRESTO SQL etc)Good understanding of CI/CD...