Lead Data Engineer

Vor 3 Tagen


Sydney, Österreich Clearcompany Vollzeit

Hybrid work - Any state in Australia - Sydney, CBD, NSW12 + 12 + 12 months - Baseline clearance requiredData Engineering, ELT, Coding, Data Modelling, DevOpsIntegrated cargo clearance system for biosecurity risk managementOur client, a biosecurity focussed Federal Government department in Melbourne CBD, requires an experienced Lead Data Engineer for a 12 + 12 + 12 month contract.DutiesUnderstand data requirements and deliver effective solutions.Design, develop, and maintain data pipelines and code-first ELT processes.Optimise pipeline performance through performance-tuning techniques.Ensure data quality, reliability, and availability across different sources and destinations.Design and maintain reference data tables according to the team's reference data standards using manual and automated mechanisms.Implement defined data governance, security, and privacy policies and standards.Monitor, troubleshoot, and optimise data pipeline performance and issues.Write clear, meaningful, code documentation that explains the intent and mechanics of scripts.Selection CriteriaData Modelling, Architecture and IntegrationProficiency with relational databases;Experience in designing and managing data warehouses; proven ability to data model, including schema design, and normalization for relational and non-relational databases.Experience in data partitioning, sharding, and indexing for optimisation.Programming Language and ToolsCompetent capability in programming languages such as Python, Java, Scala, or SQL.Experience working with cloud services for data storage, processing, and management.Competence with Docker, Kubernetes, and CI/CD pipelines to deploy and manage data infrastructure.To apply for this long Lead Data Engineer contract, please click the Quick Apply button to forward your CV to Andy at the Recruitment Hive.Please note our internal Job ID is AE 10316 and this RFQ closes on the 20th of December 2024.
#J-18808-Ljbffr


  • Lead Data Engineer

    Vor 3 Tagen


    Sydney, Österreich Pyramid Global Technologies Vollzeit

    Job Description for Lead Data Engineer in Sydney.Experience: 10+ years in Software Engineering, Cloud Computing, Databricks, and Big Data.Key Responsibilities:Data EngineeringData WarehousingSolution DesignData AnalysisVisualizationData ModelingProgramming Languages: Python, Scala, SQLCloud Technologies: Azure and DatabricksBig Data Technologies: Cloudera...

  • Lead Data Engineer

    vor 1 Tag


    Sydney, Österreich Clearcompany Vollzeit

    Sydney CBD with some WFH12 + 12 + 12 month contractNV1 Security Clearance preferredOur client, a large and well-funded Federal Government entity focused on agriculture, is seeking a Lead Data Engineer to join their team in March.Responsibilities: Design and develop scalable data pipelines for ingesting, transforming, and storing structured and unstructured...

  • Lead Data Engineer

    Vor 5 Tagen


    Sydney, Österreich Clearcompany Vollzeit

    Hybrid work - Any state in Australia - Sydney, CBD, NSW12 + 12 + 12 months - Baseline clearance requiredData Engineering, ELT, Coding, Data Modelling, DevOpsIntegrated cargo clearance system for biosecurity risk managementOur client, a biosecurity focussed Federal Government department in Melbourne CBD, requires an experienced Lead Data Engineer for a 12 +...

  • Lead Data Engineer

    vor 2 Wochen


    Sydney, Österreich Clearcompany Vollzeit

    Lead Data Engineer Sydney, Australia $220,000 (including Super) + Bonus About the Role: Join a high-performing Data Team at a leading financial services institution to lead regulatory initiatives and drive innovation in data engineering, utilizing AI and automation to enhance platform efficiency.Key Responsibilities: Lead the development and transformation...

  • Lead Data Engineer

    vor 1 Monat


    Sydney, Österreich Cognizant Vollzeit

    Position Title: Lead Data Engineer Company OverviewCognizant (NASDAQ: CTSH) is a leading provider of information technology, consulting, and business process services, dedicated to helping the world's leading companies build stronger businesses. Headquartered in Teaneck, New Jersey (U.S.), Cognizant combines a passion for client satisfaction, technology...

  • Lead Data Engineer

    vor 2 Monaten


    Sydney, Österreich West Recruitment Pty Ltd Vollzeit

    Call: West Sector: Technology Job Summary Join this certified 'Great Place to Work' business.Spearhead a Data Transformation initiative.Western Sydney Location - Defined WFH Policy.Job Description About Your New Employer:West Technology is proud to be partnering with an Australian owned group that has grown to become a genuine market leader across multiple...

  • Lead Data Engineer

    vor 3 Monaten


    Sydney, Österreich Baptistcare Nsw & Act Vollzeit

    Fulltime permanent position in Norwest | Hybrid office environment Newly created role supporting the Data & Analytics Strategy Design, implement & optimise data platform with an industry leading NFP About the role: Reporting to the Data and Analytics (D&A) Manager, the Lead Data Engineer will design and implement data warehouse and foundational data assets...


  • Sydney, Österreich Tideri Jobbörse Vollzeit

    Hybrid work - Any state in Australia - Sydney, CBD, NSW 12 + 12 + 12 months - Baseline clearance required Data Engineering, ELT, Coding, Data Modelling, DevOps Integrated cargo clearance system for biosecurity risk management Our client, a biosecurity focussed Federal Government department in Melbourne CBD, requires an experienced Lead Data Engineer for a 12...

  • Lead Data Engineer

    vor 2 Monaten


    Sydney, Österreich Baptistcare Nsw & Act Vollzeit

    Fulltime permanent position in Norwest | Hybrid office environmentNewly created role supporting the Data & Analytics StrategyDesign, implement & optimise data platform with an industry leading NFPAbout the role:Reporting to the Data and Analytics (D&A) Manager, the Lead Data Engineer will design and implement data warehouse and foundational data assets in...

  • Lead Engineer

    vor 3 Monaten


    Sydney, Österreich Experis Manpowergroup Sp. Z O.O. Vollzeit

    Experis are proud to be representing a prestigious financial services organisation who are recruiting for an experienced Lead Engineer - Big Data to join their team on a contract basis and lead the design, development, and delivery of future-ready data solutions.As a technical lead, you will work closely with cross-functional teams to provide cutting-edge...


  • Sydney, Österreich Tideri Jobbörse Vollzeit

    Job Description for Lead Data Engineer in Sydney .Experience: 10+ years in Software Engineering, Cloud Computing, Databricks, and Big Data.Key Responsibilities: Data Engineering Data Warehousing Solution Design Data Analysis Visualization Data Modeling Programming Languages: Python, Scala, SQL Cloud Technologies: Azure and Databricks Big Data Technologies:...

  • Data Insights Lead

    vor 3 Monaten


    Sydney, Österreich Data Privacy Vollzeit

    The role focuses on leading data and analytics requirements within the People & Culture function at NRMA.It involves managing monthly data reporting, seeking efficiency improvements, and providing data insights that drive operational excellence.The position requires collaboration with various business partners to understand data requirements and deliver...

  • Lead Data Engineer

    Vor 3 Tagen


    Sydney, Österreich Macquarie Bank Limited Vollzeit

    Join our high performing Data Team focused on collaborating across a wide range of business and technical stakeholders to deliver a transformation project within Macquarie's Banking and Financial Services division.This is an excellent opportunity for an ambitious, problem-solving and technical data professional to contribute and grow rapidly within the...

  • Lead Data Engineer

    Vor 5 Tagen


    Sydney, Österreich Macquarie Bank Limited Vollzeit

    Join our high performing Data Team focused on collaborating across a wide range of business and technical stakeholders to deliver a transformation project within Macquarie's Banking and Financial Services division. This is an excellent opportunity for an ambitious, problem-solving and technical data professional to contribute and grow rapidly within the...

  • Lead Data Engineer

    vor 1 Monat


    Sydney, Österreich Lendi Group Vollzeit

    Department: Data Design & Emerging ProductCompany DescriptionIn May 2021, Lendi and Aussie Home Loans merged to create Lendi Group. Today, Lendi Group is Australia's largest retail mortgage broker, with a loan book in excess of $70 billion, over 1300 brokers and 225 retail stores across the country.We're passionate about what we do and like to do things...

  • Lead Data Engineer

    vor 1 Monat


    Sydney, Österreich Lendi Group Vollzeit

    Department: Data Design & Emerging ProductCompany DescriptionIn May 2021, Lendi and Aussie Home Loans merged to create Lendi Group.Today, Lendi Group is Australia's largest retail mortgage broker, with a loan book in excess of $70 billion, over 1300 brokers and 225 retail stores across the country.We're passionate about what we do and like to do things...

  • Lead Data Engineer

    Vor 3 Tagen


    Sydney, Österreich Macquarie Bank Limited Vollzeit

    Join our high performing Data Team focused on collaborating across a wide range of business and technical stakeholders to deliver a transformation project within Macquarie's Banking and Financial Services division. This is an excellent opportunity for an ambitious, problem solving and technical data professional to contribute and grow rapidly within the...

  • Data Engineer

    vor 4 Wochen


    Sydney, Österreich Rich Data Co. Vollzeit

    Hybrid and flexible working arrangementsAbout RDCRich Data Co (RDC) is delivering the future of credit today! We believe credit should be accessible, fair, inclusive, and sustainable. We are passionate about AI and developing new techniques that leverage traditional and non-traditional data to get the right decision in a clear and explainable way. Global...

  • Data Engineer

    vor 4 Wochen


    Sydney, Österreich Rich Data Co. Vollzeit

    Hybrid and flexible working arrangementsAbout RDC Rich Data Co (RDC) is delivering the future of credit today!We believe credit should be accessible, fair, inclusive, and sustainable.We are passionate about AI and developing new techniques that leverage traditional and non-traditional data to get the right decision in a clear and explainable way.Global...

  • Data Engineer

    vor 4 Wochen


    Sydney, Österreich Rich Data Co. Vollzeit

    Hybrid and flexible working arrangementsAbout RDC Rich Data Co (RDC) is delivering the future of credit today!We believe credit should be accessible, fair, inclusive, and sustainable.We are passionate about AI and developing new techniques that leverage traditional and non-traditional data to get the right decision in a clear and explainable way.Global...