Lead Data Engineer
Vor 3 Tagen
Hybrid work - Any state in Australia - Sydney, CBD, NSW12 + 12 + 12 months - Baseline clearance requiredData Engineering, ELT, Coding, Data Modelling, DevOpsIntegrated cargo clearance system for biosecurity risk managementOur client, a biosecurity focussed Federal Government department in Melbourne CBD, requires an experienced Lead Data Engineer for a 12 + 12 + 12 month contract.DutiesUnderstand data requirements and deliver effective solutions.Design, develop, and maintain data pipelines and code-first ELT processes.Optimise pipeline performance through performance-tuning techniques.Ensure data quality, reliability, and availability across different sources and destinations.Design and maintain reference data tables according to the team's reference data standards using manual and automated mechanisms.Implement defined data governance, security, and privacy policies and standards.Monitor, troubleshoot, and optimise data pipeline performance and issues.Write clear, meaningful, code documentation that explains the intent and mechanics of scripts.Selection CriteriaData Modelling, Architecture and IntegrationProficiency with relational databases;Experience in designing and managing data warehouses; proven ability to data model, including schema design, and normalization for relational and non-relational databases.Experience in data partitioning, sharding, and indexing for optimisation.Programming Language and ToolsCompetent capability in programming languages such as Python, Java, Scala, or SQL.Experience working with cloud services for data storage, processing, and management.Competence with Docker, Kubernetes, and CI/CD pipelines to deploy and manage data infrastructure.To apply for this long Lead Data Engineer contract, please click the Quick Apply button to forward your CV to Andy at the Recruitment Hive.Please note our internal Job ID is AE 10316 and this RFQ closes on the 20th of December 2024.
#J-18808-Ljbffr
-
Lead Data Engineer
Vor 3 Tagen
Sydney, Österreich Pyramid Global Technologies VollzeitJob Description for Lead Data Engineer in Sydney.Experience: 10+ years in Software Engineering, Cloud Computing, Databricks, and Big Data.Key Responsibilities:Data EngineeringData WarehousingSolution DesignData AnalysisVisualizationData ModelingProgramming Languages: Python, Scala, SQLCloud Technologies: Azure and DatabricksBig Data Technologies: Cloudera...
-
Lead Data Engineer
vor 1 Tag
Sydney, Österreich Clearcompany VollzeitSydney CBD with some WFH12 + 12 + 12 month contractNV1 Security Clearance preferredOur client, a large and well-funded Federal Government entity focused on agriculture, is seeking a Lead Data Engineer to join their team in March.Responsibilities: Design and develop scalable data pipelines for ingesting, transforming, and storing structured and unstructured...
-
Lead Data Engineer
Vor 5 Tagen
Sydney, Österreich Clearcompany VollzeitHybrid work - Any state in Australia - Sydney, CBD, NSW12 + 12 + 12 months - Baseline clearance requiredData Engineering, ELT, Coding, Data Modelling, DevOpsIntegrated cargo clearance system for biosecurity risk managementOur client, a biosecurity focussed Federal Government department in Melbourne CBD, requires an experienced Lead Data Engineer for a 12 +...
-
Lead Data Engineer
vor 2 Wochen
Sydney, Österreich Clearcompany VollzeitLead Data Engineer Sydney, Australia $220,000 (including Super) + Bonus About the Role: Join a high-performing Data Team at a leading financial services institution to lead regulatory initiatives and drive innovation in data engineering, utilizing AI and automation to enhance platform efficiency.Key Responsibilities: Lead the development and transformation...
-
Lead Data Engineer
vor 1 Monat
Sydney, Österreich Cognizant VollzeitPosition Title: Lead Data Engineer Company OverviewCognizant (NASDAQ: CTSH) is a leading provider of information technology, consulting, and business process services, dedicated to helping the world's leading companies build stronger businesses. Headquartered in Teaneck, New Jersey (U.S.), Cognizant combines a passion for client satisfaction, technology...
-
Lead Data Engineer
vor 2 Monaten
Sydney, Österreich West Recruitment Pty Ltd VollzeitCall: West Sector: Technology Job Summary Join this certified 'Great Place to Work' business.Spearhead a Data Transformation initiative.Western Sydney Location - Defined WFH Policy.Job Description About Your New Employer:West Technology is proud to be partnering with an Australian owned group that has grown to become a genuine market leader across multiple...
-
Lead Data Engineer
vor 3 Monaten
Sydney, Österreich Baptistcare Nsw & Act VollzeitFulltime permanent position in Norwest | Hybrid office environment Newly created role supporting the Data & Analytics Strategy Design, implement & optimise data platform with an industry leading NFP About the role: Reporting to the Data and Analytics (D&A) Manager, the Lead Data Engineer will design and implement data warehouse and foundational data assets...
-
Clearcompany | Lead Data Engineer
vor 1 Tag
Sydney, Österreich Tideri Jobbörse VollzeitHybrid work - Any state in Australia - Sydney, CBD, NSW 12 + 12 + 12 months - Baseline clearance required Data Engineering, ELT, Coding, Data Modelling, DevOps Integrated cargo clearance system for biosecurity risk management Our client, a biosecurity focussed Federal Government department in Melbourne CBD, requires an experienced Lead Data Engineer for a 12...
-
Lead Data Engineer
vor 2 Monaten
Sydney, Österreich Baptistcare Nsw & Act VollzeitFulltime permanent position in Norwest | Hybrid office environmentNewly created role supporting the Data & Analytics StrategyDesign, implement & optimise data platform with an industry leading NFPAbout the role:Reporting to the Data and Analytics (D&A) Manager, the Lead Data Engineer will design and implement data warehouse and foundational data assets in...
-
Lead Engineer
vor 3 Monaten
Sydney, Österreich Experis Manpowergroup Sp. Z O.O. VollzeitExperis are proud to be representing a prestigious financial services organisation who are recruiting for an experienced Lead Engineer - Big Data to join their team on a contract basis and lead the design, development, and delivery of future-ready data solutions.As a technical lead, you will work closely with cross-functional teams to provide cutting-edge...
-
Sydney, Österreich Tideri Jobbörse VollzeitJob Description for Lead Data Engineer in Sydney .Experience: 10+ years in Software Engineering, Cloud Computing, Databricks, and Big Data.Key Responsibilities: Data Engineering Data Warehousing Solution Design Data Analysis Visualization Data Modeling Programming Languages: Python, Scala, SQL Cloud Technologies: Azure and Databricks Big Data Technologies:...
-
Data Insights Lead
vor 3 Monaten
Sydney, Österreich Data Privacy VollzeitThe role focuses on leading data and analytics requirements within the People & Culture function at NRMA.It involves managing monthly data reporting, seeking efficiency improvements, and providing data insights that drive operational excellence.The position requires collaboration with various business partners to understand data requirements and deliver...
-
Lead Data Engineer
Vor 3 Tagen
Sydney, Österreich Macquarie Bank Limited VollzeitJoin our high performing Data Team focused on collaborating across a wide range of business and technical stakeholders to deliver a transformation project within Macquarie's Banking and Financial Services division.This is an excellent opportunity for an ambitious, problem-solving and technical data professional to contribute and grow rapidly within the...
-
Lead Data Engineer
Vor 5 Tagen
Sydney, Österreich Macquarie Bank Limited VollzeitJoin our high performing Data Team focused on collaborating across a wide range of business and technical stakeholders to deliver a transformation project within Macquarie's Banking and Financial Services division. This is an excellent opportunity for an ambitious, problem-solving and technical data professional to contribute and grow rapidly within the...
-
Lead Data Engineer
vor 1 Monat
Sydney, Österreich Lendi Group VollzeitDepartment: Data Design & Emerging ProductCompany DescriptionIn May 2021, Lendi and Aussie Home Loans merged to create Lendi Group. Today, Lendi Group is Australia's largest retail mortgage broker, with a loan book in excess of $70 billion, over 1300 brokers and 225 retail stores across the country.We're passionate about what we do and like to do things...
-
Lead Data Engineer
vor 1 Monat
Sydney, Österreich Lendi Group VollzeitDepartment: Data Design & Emerging ProductCompany DescriptionIn May 2021, Lendi and Aussie Home Loans merged to create Lendi Group.Today, Lendi Group is Australia's largest retail mortgage broker, with a loan book in excess of $70 billion, over 1300 brokers and 225 retail stores across the country.We're passionate about what we do and like to do things...
-
Lead Data Engineer
Vor 3 Tagen
Sydney, Österreich Macquarie Bank Limited VollzeitJoin our high performing Data Team focused on collaborating across a wide range of business and technical stakeholders to deliver a transformation project within Macquarie's Banking and Financial Services division. This is an excellent opportunity for an ambitious, problem solving and technical data professional to contribute and grow rapidly within the...
-
Data Engineer
vor 4 Wochen
Sydney, Österreich Rich Data Co. VollzeitHybrid and flexible working arrangementsAbout RDCRich Data Co (RDC) is delivering the future of credit today! We believe credit should be accessible, fair, inclusive, and sustainable. We are passionate about AI and developing new techniques that leverage traditional and non-traditional data to get the right decision in a clear and explainable way. Global...
-
Data Engineer
vor 4 Wochen
Sydney, Österreich Rich Data Co. VollzeitHybrid and flexible working arrangementsAbout RDC Rich Data Co (RDC) is delivering the future of credit today!We believe credit should be accessible, fair, inclusive, and sustainable.We are passionate about AI and developing new techniques that leverage traditional and non-traditional data to get the right decision in a clear and explainable way.Global...
-
Data Engineer
vor 4 Wochen
Sydney, Österreich Rich Data Co. VollzeitHybrid and flexible working arrangementsAbout RDC Rich Data Co (RDC) is delivering the future of credit today!We believe credit should be accessible, fair, inclusive, and sustainable.We are passionate about AI and developing new techniques that leverage traditional and non-traditional data to get the right decision in a clear and explainable way.Global...