Big Data Lead Engineer

vor 3 Monaten

Sydney, Österreich Paxus - Technology + Digital Talent Vollzeit

Responsibilities: Design, develop, test, and support future-ready data solutions for customers across industry verticals.Produce detailed solution design and support data engineers and testers as a technical lead in a data project.Develop, test, and support end-to-end batch and near real-time data flows/pipelines.Demonstrate understanding in data architectures, modern data platforms, big data, data modelling, ML/AI, analytics, cloud platforms, data governance, and information management and associated technologies.Develop and demonstrate proof of concepts and working demos.Skills Required: Must understand and navigate large organizations' governance and processes with ease.Must have exceptional interpersonal skills and be able to present solution design with confidence in large technical forums.Minimum of 5+ years of experience as a solution designer, tech lead, developer, tester, or support role in IT consulting or other technology business units across the industry, with a preference for Banking/FSS.Minimum of 3+ years of hands-on development, testing, and administration experience with Big Data/Data Lake services in cloud and on-premise.Experience in applying industry best practices, design patterns, and first-of-a-kind technical solutions as a developer or administrator on data and non-data specific platforms and applications.Experience in NoSQL databases such as HBase.Experience in implementing near real-time data flows/pipelines and distributed streaming applications using technology such as Apache Kafka.Understanding of various data modelling concepts and techniques such as Entity Relationship Modelling, Third Normal Form, Dimensional Modelling.Understanding of Data Mesh Architecture and Domain Data Products.Experience in implementing traditional ETL, data warehousing, and BI solutions.Hands-on implementation of services sensitive to performance SLAs with high availability, fault-tolerance, automatic fail-over, and geographical redundancy.Working knowledge and hands-on experience with cloud platforms such as Azure, AWS, GCP, and IBM, and other modern data platforms.Solid understanding of containerization, virtualization, infrastructure, and networking.Diverse experience in software development methodologies and project delivery frameworks such as Agile Sprints, Kanban, Waterfall, etc.Application Process: Outstanding opportunity to join an industry giant.
Apply now.
To be considered for the role, click the 'apply' button or for more information about this and other opportunities, please contact James McVey on or email: and quote the above job reference number.
Paxus values diversity and welcomes applications from Indigenous Australians, people from diverse cultural and linguistic backgrounds, and people living with a disability.
If you require an adjustment to the recruitment process, including the application form in an alternate format, please contact me on the above contact details.
#J-18808-Ljbffr

  • Lead Engineer

    vor 3 Monaten

    Sydney, Österreich Experis Manpowergroup Sp. Z O.O. Vollzeit

    Experis are proud to be representing a prestigious financial services organisation who are recruiting for an experienced Lead Engineer - Big Data to join their team on a contract basis and lead the design, development, and delivery of future-ready data solutions.As a technical lead, you will work closely with cross-functional teams to provide cutting-edge...

  • Lead Engineer-Big Data

    vor 2 Wochen

    Sydney, Österreich Kirra Services Vollzeit

    Design, Develop, test and support future-ready data solutions for customers across industry verticalsProduce Detailed Solution Design and support data engineers and testers as a technical lead in a data projectDevelop, test and support end-to-end batch and near real-time data flows/pipelineDemonstrate understanding in data architectures, modern data...

  • Lead Engineer-Big Data

    vor 2 Wochen

    Sydney, Österreich Kirra Services Vollzeit

    Design, Develop, test and support future-ready data solutions for customers across industry verticalsProduce Detailed Solution Design and support data engineers and testers as a technical lead in a data projectDevelop, test and support end-to-end batch and near real-time data flows/pipelineDemonstrate understanding in data architectures, modern data...

  • Big Data Solution Engineer

    vor 3 Monaten

    Sydney, Österreich Zone It Solutions Vollzeit

    We are seeking a Big Data Solution Engineer.This role involves designing and implementing scalable big data solutions to support our clients' analytical needs. Responsibilities and Qualifications Minimum of 5 years of experience in Big Data technologies and architectures. Proficient in Hadoop ecosystem components (HDFS, Hive, Pig, Spark, etc.)and relevant...

  • Lead Data Engineer

    Vor 6 Tagen

    Sydney, Österreich Pyramid Global Technologies Vollzeit

    Job Description for Lead Data Engineer in Sydney.Experience: 10+ years in Software Engineering, Cloud Computing, Databricks, and Big Data.Key Responsibilities:Data EngineeringData WarehousingSolution DesignData AnalysisVisualizationData ModelingProgramming Languages: Python, Scala, SQLCloud Technologies: Azure and DatabricksBig Data Technologies: Cloudera...

  • Lead Data Engineer

    vor 3 Wochen

    Sydney, Österreich Clearcompany Vollzeit

    Lead Data Engineer Sydney, Australia $220,000 (including Super) + Bonus About the Role: Join a high-performing Data Team at a leading financial services institution to lead regulatory initiatives and drive innovation in data engineering, utilizing AI and automation to enhance platform efficiency.Key Responsibilities: Lead the development and transformation...

  • Kirra Services | Lead Engineer-Big Data

    Vor 6 Tagen

    Sydney, Österreich Tideri Jobbörse Vollzeit

    Design, Develop, test and support future-ready data solutions for customers across industry verticals Produce Detailed Solution Design and support data engineers and testers as a technical lead in a data project Develop, test and support end-to-end batch and near real-time data flows/pipeline Demonstrate understanding in data architectures, modern data...

  • Pyramid Global Technologies | Lead Data Engineer

    Vor 4 Tagen

    Sydney, Österreich Tideri Jobbörse Vollzeit

    Job Description for Lead Data Engineer in Sydney .Experience: 10+ years in Software Engineering, Cloud Computing, Databricks, and Big Data.Key Responsibilities: Data Engineering Data Warehousing Solution Design Data Analysis Visualization Data Modeling Programming Languages: Python, Scala, SQL Cloud Technologies: Azure and Databricks Big Data Technologies:...

  • Senior Data Engineer

    vor 4 Wochen

    Sydney, Österreich Efinancialcareers Ltd. Vollzeit

    Senior Data Engineer (Big Data Platforms)Commonwealth Bank of Australia, Sydney, AustraliaDo work that matters:As a Senior Data Engineer with proven expertise in software development and a passion for providing data-driven solutions, you're ahead of trends and work at the forefront of Big Data and Data warehouse technologies. Here, you'll be part of a team...

  • Big Data Engineers

    vor 2 Wochen

    Sydney, Österreich Igreendata Vollzeit

    Developers/Programmers (Information & Communication Technology)Full timeiGreenData - A Synechron company is a next-generation technology company focusing on Cloud, Data, and Digital first solutions that are changing how technology provides value to businesses, empowering organizations to take advantage of the scalability, reliability, and improved...

  • Big Data Engineers

    vor 2 Wochen

    Sydney, Österreich Igreendata Vollzeit

    Developers/Programmers (Information & Communication Technology) Full time iGreenData - A Synechron company is a next-generation technology company focusing on Cloud, Data, and Digital first solutions that are changing how technology provides value to businesses, empowering organizations to take advantage of the scalability, reliability, and improved...

  • Tideri Jobbörse | Experis Manpowergroup Sp. Z O.O. | Lead Engineer

    vor 3 Wochen

    sydney, Österreich Tideri Jobbörse Vollzeit

    Experis are proud to be representing a prestigious financial services organisation who are recruiting for an experienced Lead Engineer - Big Data to join their team on a contract basis and lead the design, development, and delivery of future-ready data solutions. As a technical lead, you will work closely with cross-functional teams to provide cutting-edge...

  • Data Engineer

    vor 3 Monaten

    Sydney, Österreich Open Axcss Vollzeit

    The Data Engineer is responsible for building and supporting the big data platform.As a Data Engineer, your responsibilities include: Develop, test and support future-ready data solutions for customers across industry verticals.Develop, test and support end-to-end batch and near real-time data flows/pipelines.Demonstrate understanding in data architectures,...

  • Lead Data Engineer

    vor 1 Woche

    Sydney, Österreich Macquarie Bank Limited Vollzeit

    Join our high performing Data Team focused on collaborating across a wide range of business and technical stakeholders to deliver a transformation project within Macquarie's Banking and Financial Services division. This is an excellent opportunity for an ambitious, problem-solving and technical data professional to contribute and grow rapidly within the...

  • Lead Data Engineer

    Vor 6 Tagen

    Sydney, Österreich Macquarie Bank Limited Vollzeit

    Join our high performing Data Team focused on collaborating across a wide range of business and technical stakeholders to deliver a transformation project within Macquarie's Banking and Financial Services division.This is an excellent opportunity for an ambitious, problem-solving and technical data professional to contribute and grow rapidly within the...

  • Data Engineer Lead

    vor 4 Wochen

    Sydney, Österreich West Recruitment Pty Ltd Vollzeit

    Email: Call: West Sector: TechnologyJob SummaryFlexible working arrangementsAward winning businessExcellent package and benefitsJob DescriptionOur client is seeking a highly experienced Data Engineer to join their technology team on a permanent basis.The role will play a pivotal part in the business's data transformation initiative.The ideal candidate will...

  • Data Engineer

    vor 3 Monaten

    Sydney, Österreich Open Axcss Vollzeit

    The Data Engineer is responsible for building and supporting the big data platform. As a Data Engineer, your responsibilities include:Develop, test and support future-ready data solutions for customers across industry verticals.Develop, test and support end-to-end batch and near real-time data flows/pipelines.Demonstrate understanding in data architectures,...

  • Lead Data Engineer

    Vor 6 Tagen

    Sydney, Österreich Macquarie Bank Limited Vollzeit

    Join our high performing Data Team focused on collaborating across a wide range of business and technical stakeholders to deliver a transformation project within Macquarie's Banking and Financial Services division. This is an excellent opportunity for an ambitious, problem solving and technical data professional to contribute and grow rapidly within the...

  • Efinancialcareers Ltd. | Senior Data Engineer

    vor 4 Wochen

    Sydney, Österreich Tideri Jobbörse Vollzeit

    Senior Data Engineer (Big Data Platforms) Commonwealth Bank of Australia, Sydney, AustraliaDo work that matters: As a Senior Data Engineer with proven expertise in software development and a passion for providing data-driven solutions, you're ahead of trends and work at the forefront of Big Data and Data warehouse technologies.Here, you'll be part of a team...

  • Lead Data Engineer

    Vor 4 Tagen

    Sydney, Österreich Clearcompany Vollzeit

    Sydney CBD with some WFH12 + 12 + 12 month contractNV1 Security Clearance preferredOur client, a large and well-funded Federal Government entity focused on agriculture, is seeking a Lead Data Engineer to join their team in March.Responsibilities: Design and develop scalable data pipelines for ingesting, transforming, and storing structured and unstructured...