Lead Engineer-Big Data

vor 2 Wochen

Sydney, Österreich Kirra Services Vollzeit

Design, Develop, test and support future-ready data solutions for customers across industry verticalsProduce Detailed Solution Design and support data engineers and testers as a technical lead in a data projectDevelop, test and support end-to-end batch and near real-time data flows/pipelineDemonstrate understanding in data architectures, modern data platforms, big data, data modelling, ML/AI, analytics, cloud platforms, data governance and information management and associated technologiesDevelop and demonstrate Proof of Concepts and Working DemosSupport and collaborate with other internal/external consultants in consulting, workshops and delivery engagementsMentor junior IBM consultants in the practice and delivery engagementsMandatory Requirements: Must have leadership qualities applicable for the project team and beyondMust understand and navigate large organisation's governance and processes with easeMust have exceptional inter-personal skills and able to present solution design with confidence in large technical forumsMinimum of 5+ years of experience as a solution designer, tech lead, developer, tester or support role in IT Consulting or other technology business units across the industry but Banking/FSS is preferrableMinimum of 3+ years of hands-on development, testing and administration experience with Big Data/Data Lake services in cloud and on-premiseExperience in applying industry best practices, design patterns and first-of-a-kind technical solutions as developer or administrator on data and non-data specific platforms and applicationsExperience in NoSQL databases such as HBase(Expert in design and dev)Experience in implementing near real-time data flows/pipelines and distributed streaming applications using technology such as Apache Kafka (Expert in design and dev)Understanding of various data modelling concepts and techniques such as Entity Relationship Modelling, Third Normal Form, Dimensional Modelling etcUnderstanding of Data Mesh Architecture and Domain Data ProductsExperience in implementing traditional ETL, data warehousing and BI solutionsHands-on development experience and working skill level in Scala (Expert), Python, SQL, shell scripting and other programming/scripting languagesHands-on implementation of services sensitive to performance SLAs with high availability, fault-tolerance, automatic fail-over and geographical redundancyWorking knowledge and hands-on experience with Cloud Platform such as Azure, AWS, GCP and IBM and other modern data platformsSolid understanding of containerisation, virtualisation, infrastructure and networkingDiverse experience in software development methodologies and project delivery frameworks such as Agile Sprints, Kanban, Waterfall etcDesired Attributes and Skills: Degree in Computer Science, Information Technology or related Engineering coursesOne or more industry-recognised technology certifications or badges #J-18808-Ljbffr

  • Lead Engineer

    vor 3 Monaten

    Sydney, Österreich Experis Manpowergroup Sp. Z O.O. Vollzeit

    Experis are proud to be representing a prestigious financial services organisation who are recruiting for an experienced Lead Engineer - Big Data to join their team on a contract basis and lead the design, development, and delivery of future-ready data solutions.As a technical lead, you will work closely with cross-functional teams to provide cutting-edge...

  • Big Data Lead Engineer

    vor 3 Monaten

    Sydney, Österreich Paxus - Technology + Digital Talent Vollzeit

    Responsibilities: Design, develop, test, and support future-ready data solutions for customers across industry verticals.Produce detailed solution design and support data engineers and testers as a technical lead in a data project.Develop, test, and support end-to-end batch and near real-time data flows/pipelines.Demonstrate understanding in data...

  • Lead Engineer-Big Data

    vor 2 Wochen

    Sydney, Österreich Kirra Services Vollzeit

    Design, Develop, test and support future-ready data solutions for customers across industry verticalsProduce Detailed Solution Design and support data engineers and testers as a technical lead in a data projectDevelop, test and support end-to-end batch and near real-time data flows/pipelineDemonstrate understanding in data architectures, modern data...

  • Big Data Solution Engineer

    vor 3 Monaten

    Sydney, Österreich Zone It Solutions Vollzeit

    We are seeking a Big Data Solution Engineer.This role involves designing and implementing scalable big data solutions to support our clients' analytical needs. Responsibilities and Qualifications Minimum of 5 years of experience in Big Data technologies and architectures. Proficient in Hadoop ecosystem components (HDFS, Hive, Pig, Spark, etc.)and relevant...

  • Lead Data Engineer

    Vor 6 Tagen

    Sydney, Österreich Pyramid Global Technologies Vollzeit

    Job Description for Lead Data Engineer in Sydney.Experience: 10+ years in Software Engineering, Cloud Computing, Databricks, and Big Data.Key Responsibilities:Data EngineeringData WarehousingSolution DesignData AnalysisVisualizationData ModelingProgramming Languages: Python, Scala, SQLCloud Technologies: Azure and DatabricksBig Data Technologies: Cloudera...

  • Kirra Services | Lead Engineer-Big Data

    Vor 6 Tagen

    Sydney, Österreich Tideri Jobbörse Vollzeit

    Design, Develop, test and support future-ready data solutions for customers across industry verticals Produce Detailed Solution Design and support data engineers and testers as a technical lead in a data project Develop, test and support end-to-end batch and near real-time data flows/pipeline Demonstrate understanding in data architectures, modern data...

  • Lead Data Engineer

    vor 3 Wochen

    Sydney, Österreich Clearcompany Vollzeit

    Lead Data Engineer Sydney, Australia $220,000 (including Super) + Bonus About the Role: Join a high-performing Data Team at a leading financial services institution to lead regulatory initiatives and drive innovation in data engineering, utilizing AI and automation to enhance platform efficiency.Key Responsibilities: Lead the development and transformation...

  • Pyramid Global Technologies | Lead Data Engineer

    Vor 5 Tagen

    Sydney, Österreich Tideri Jobbörse Vollzeit

    Job Description for Lead Data Engineer in Sydney .Experience: 10+ years in Software Engineering, Cloud Computing, Databricks, and Big Data.Key Responsibilities: Data Engineering Data Warehousing Solution Design Data Analysis Visualization Data Modeling Programming Languages: Python, Scala, SQL Cloud Technologies: Azure and Databricks Big Data Technologies:...

  • Senior Data Engineer

    vor 4 Wochen

    Sydney, Österreich Efinancialcareers Ltd. Vollzeit

    Senior Data Engineer (Big Data Platforms)Commonwealth Bank of Australia, Sydney, AustraliaDo work that matters:As a Senior Data Engineer with proven expertise in software development and a passion for providing data-driven solutions, you're ahead of trends and work at the forefront of Big Data and Data warehouse technologies. Here, you'll be part of a team...

  • Big Data Engineers

    vor 2 Wochen

    Sydney, Österreich Igreendata Vollzeit

    Developers/Programmers (Information & Communication Technology)Full timeiGreenData - A Synechron company is a next-generation technology company focusing on Cloud, Data, and Digital first solutions that are changing how technology provides value to businesses, empowering organizations to take advantage of the scalability, reliability, and improved...

  • Big Data Engineers

    vor 2 Wochen

    Sydney, Österreich Igreendata Vollzeit

    Developers/Programmers (Information & Communication Technology) Full time iGreenData - A Synechron company is a next-generation technology company focusing on Cloud, Data, and Digital first solutions that are changing how technology provides value to businesses, empowering organizations to take advantage of the scalability, reliability, and improved...

  • Tideri Jobbörse | Experis Manpowergroup Sp. Z O.O. | Lead Engineer

    vor 3 Wochen

    sydney, Österreich Tideri Jobbörse Vollzeit

    Experis are proud to be representing a prestigious financial services organisation who are recruiting for an experienced Lead Engineer - Big Data to join their team on a contract basis and lead the design, development, and delivery of future-ready data solutions. As a technical lead, you will work closely with cross-functional teams to provide cutting-edge...

  • Data Engineer

    vor 3 Monaten

    Sydney, Österreich Open Axcss Vollzeit

    The Data Engineer is responsible for building and supporting the big data platform.As a Data Engineer, your responsibilities include: Develop, test and support future-ready data solutions for customers across industry verticals.Develop, test and support end-to-end batch and near real-time data flows/pipelines.Demonstrate understanding in data architectures,...

  • Lead Data Engineer

    vor 1 Woche

    Sydney, Österreich Macquarie Bank Limited Vollzeit

    Join our high performing Data Team focused on collaborating across a wide range of business and technical stakeholders to deliver a transformation project within Macquarie's Banking and Financial Services division. This is an excellent opportunity for an ambitious, problem-solving and technical data professional to contribute and grow rapidly within the...

  • Lead Data Engineer

    Vor 7 Tagen

    Sydney, Österreich Macquarie Bank Limited Vollzeit

    Join our high performing Data Team focused on collaborating across a wide range of business and technical stakeholders to deliver a transformation project within Macquarie's Banking and Financial Services division.This is an excellent opportunity for an ambitious, problem-solving and technical data professional to contribute and grow rapidly within the...

  • Data Engineer Lead

    vor 4 Wochen

    Sydney, Österreich West Recruitment Pty Ltd Vollzeit

    Email: Call: West Sector: TechnologyJob SummaryFlexible working arrangementsAward winning businessExcellent package and benefitsJob DescriptionOur client is seeking a highly experienced Data Engineer to join their technology team on a permanent basis.The role will play a pivotal part in the business's data transformation initiative.The ideal candidate will...

  • Data Engineer

    vor 3 Monaten

    Sydney, Österreich Open Axcss Vollzeit

    The Data Engineer is responsible for building and supporting the big data platform. As a Data Engineer, your responsibilities include:Develop, test and support future-ready data solutions for customers across industry verticals.Develop, test and support end-to-end batch and near real-time data flows/pipelines.Demonstrate understanding in data architectures,...

  • Lead Data Engineer

    Vor 7 Tagen

    Sydney, Österreich Macquarie Bank Limited Vollzeit

    Join our high performing Data Team focused on collaborating across a wide range of business and technical stakeholders to deliver a transformation project within Macquarie's Banking and Financial Services division. This is an excellent opportunity for an ambitious, problem solving and technical data professional to contribute and grow rapidly within the...

  • Efinancialcareers Ltd. | Senior Data Engineer

    vor 4 Wochen

    Sydney, Österreich Tideri Jobbörse Vollzeit

    Senior Data Engineer (Big Data Platforms) Commonwealth Bank of Australia, Sydney, AustraliaDo work that matters: As a Senior Data Engineer with proven expertise in software development and a passion for providing data-driven solutions, you're ahead of trends and work at the forefront of Big Data and Data warehouse technologies.Here, you'll be part of a team...

  • Lead Data Engineer

    Vor 5 Tagen

    Sydney, Österreich Clearcompany Vollzeit

    Sydney CBD with some WFH12 + 12 + 12 month contractNV1 Security Clearance preferredOur client, a large and well-funded Federal Government entity focused on agriculture, is seeking a Lead Data Engineer to join their team in March.Responsibilities: Design and develop scalable data pipelines for ingesting, transforming, and storing structured and unstructured...