Data Engineer
vor 2 Monaten
Data Engineers (Multiple)
RFQ closing date: Wednesday, 06 November 2024
Client: Department of Agriculture, Fisheries and Forestry
Requirements
The Department of Agriculture, Fisheries and Forestry (DAFF) is looking for Data Engineers to join its Enterprise Analytics section to work across several data and analytics platforms. We are seeking candidates with strong experience in developing Extract, Transform, Load (ETL) and Extract, Load, Transform (ELT) processes, and/or the development of data products and complex data visualisations.
The role will be responsible for design, development and unit testing activities across several data movement, data transformation, and data visualisation processes within DAFF. The data movement and transformation processes focus on the preparation of data for use in decision-making processes across the department, utilising modern cloud technology (Azure) to enable operational analytics use cases.
The successful candidate will require experience with the following techniques and technologies:
MS Azure Stack
Data Integration - Data Factory, SQL Server Integration Services and/or Databricks
Data Store - SQL Server and/or Data Lake Storage
Analytics - Azure Databricks, Azure Machine Learning, ArcGIS Enterprise
Development tools - DevOps, Visual Studio, VS Code
Data technology solutions sourcing (Oracle, Ingres, Azure, SQL Server), collecting, ingesting and storing
Data Preparation
Transformation of data into formats tailored to analytics use cases - Parquet and/or Delta
Data Visualisation
Analyse and interpret complex data sets, and to identify trends and patterns.
Design principles to create appropriate visualisations for target audience.
Visualisation tools - Power BI
Initial contract period is 12 months.
Candidates must hold a valid Baseline security clearance or be willing and eligible to obtain one. Please provide your CSID on your resumé/CV (if known).
Estimated start date: Wednesday, 20 November 2024
Initial contract duration: 12 Months
Extension term: 12 months
Number of extensions: 2
Location of work: ACT, Offsite
Working arrangements: Most of the section is located at Agriculture House in the Canberra CBD. Our standard expectation is for staff to attend the office three (3) working days each week. The section is supportive of flexible arrangements and consideration will be made for individual and collaboration needs, including attendance at important Agile ceremonies and other team/section events.
Security clearance: Must have Baseline
Criteria
Essential criteria
Demonstrated experience developing ETL/ELT processes for complex and/or large data movement, transformation and/or visualisations, particularly in a cloud environment. (50%)
Experience preparing data optimised for query performance in cloud computed engines (e.g., Distributed computing engines (Spark), Graph Databases, Azure SQL) (25%)
Experience working with Engineering, Storage and Analytics services in cloud infrastructure. (25%)
Desirable criteria
Experience working with Azure Data Factory and Databricks.
Experience/Knowledge of working with Data Lake and Lakehouses.
#J-18808-Ljbffr
-
Data Engineer
vor 2 Monaten
Canberra, Österreich ULTRA VollzeitRole: Data Engineer Client: Federal Government Contract: 12 Months Extension: 12 Months Clearance: Baseline Location: ACT Requirements: MS Azure Stack Data Integration - Data Factory, SQL Server Integration Services and/or Databricks, LogicApp and/or FunctionApp Data Store - SQL Server and/or Data Lake Storage, Unity Catalog (Medallion Architecture)...
-
Data Engineer
vor 2 Monaten
Canberra, Österreich ULTRA VollzeitRole: Data EngineerClient: Federal GovernmentContract: 12 MonthsExtension: 12 MonthsClearance: BaselineLocation: ACTRequirements: MS Azure Stack Data Integration - Data Factory, SQL Server Integration Services and/or Databricks, LogicApp and/or FunctionApp Data Store - SQL Server and/or Data Lake Storage, Unity Catalog (Medallion Architecture) Analytics -...
-
Data Engineer
vor 1 Monat
Canberra, Österreich Paxus VollzeitJob Title: Data and Analytics EngineerLocation: Canberra, Adelaide, Brisbane, Melbourne, Perth, SydneyAbout the Role We are looking for skilled Data and Analytics Engineers with expertise in data platforms, Artificial Intelligence (AI), Large Language Models (LLMs), Machine Learning (ML), and Robotic Process Automation (RPA).In this role, you will leverage...
-
Data Engineer
vor 4 Wochen
Canberra, Österreich Paxus - Technology + Digital Talent VollzeitOur client is a key regulatory body responsible for upholding quality, safety, and consumer independence in a nationally significant sector.With the sector experiencing significant growth and evolution since its inception, the organisation faces critical challenges that require transformative solutions.To address these, the Australian Federal Government has...
-
Graduate Data Engineer
vor 4 Wochen
Canberra, Österreich Gridsight VollzeitGridsight is a rapidly growing Grid/CleanTech startup that is accelerating global electrification and decarbonisation. Our AI-powered software generates insights that ensure electrical utilities maximise reliability, optimise operations, and integrate renewable energy sources seamlessly into the grid. Having recently raised our Series A round, we're excited...
-
Graduate Data Engineer
vor 4 Wochen
Canberra, Österreich Gridsight VollzeitGridsight is a rapidly growing Grid/CleanTech startup that is accelerating global electrification and decarbonisation.Our AI-powered software generates insights that ensure electrical utilities maximise reliability, optimise operations, and integrate renewable energy sources seamlessly into the grid.Having recently raised our Series A round, we're excited to...
-
Data Engineer
vor 2 Monaten
Canberra, Österreich Ultradynamix VollzeitRole: Data EngineerClient: Federal GovernmentContract: 12 MonthsExtension: 12 MonthsClearance: BaselineLocation: ACTRequirements:MS Azure StackData Integration - Data Factory, SQL Server Integration Services and/or Databricks, LogicApp and/or FunctionAppData Store - SQL Server and/or Data Lake Storage, Unity Catalog (Medallion Architecture)Analytics - Azure...
-
Aps6 Etl Data Pipeline Engineer
vor 4 Wochen
Canberra, Österreich Comcare VollzeitThe Technology and Information Management team maintain Comcare's Information, Communication and Technology (ICT) infrastructure and provide strategic leadership, governance, solutions and advice for the effective management of information.Overview of the RoleThis position will play a pivotal role in the creation and maintenance of our advanced Azure...
-
Aps6 Etl Data Pipeline Engineer
vor 4 Wochen
Canberra, Österreich Comcare VollzeitThe Technology and Information Management team maintain Comcare's Information, Communication and Technology (ICT) infrastructure and provide strategic leadership, governance, solutions and advice for the effective management of information.Overview of the Role This position will play a pivotal role in the creation and maintenance of our advanced Azure...
-
Broadcom Data Centre Security Engineer
vor 2 Monaten
Canberra, Österreich Tideri Jobbörse VollzeitMust have Negative Vetting Level 1 Security clearance.Location of work: ACT, NSW, QLD, SA, VIC Primary Technologies: Windows Server Windows Desktop Applications Packager Rapid 7 Broadcom Data Centre Security Engineer Key Tasks/Duties/Requirements: Perform BAU operations, maintenance and management.Planning, scheduling, and implementing periodical patch, bug...
-
Data Engineering
vor 1 Monat
Canberra, Österreich Infinite Consulting VollzeitJob Description: Data Engineer Contract Duration: Up to 30 June 2025 Location: ACT – Flexible work arrangement can be discussed Eligibility: Australian Citizens with Baseline Clearance Infinite Consulting is seeking an experienced Data Engineer for our esteemed Federal Government Client.The contract duration is up to 30 June 2025 with an October start....
-
Data Engineering
vor 3 Wochen
Canberra, Österreich Infinite Consulting VollzeitJob DescriptionPosition: Data Engineer ContractDuration: up to 30 June 2025Location: ACT – Flexible work arrangement can be discussedEligibility: Australian Citizens with Baseline ClearanceInfinite Consulting is seeking an experienced Data Engineer for our esteemed Federal Government Client.The contract duration is up to 30 June 2025 with an October...
-
Senior Data Engineering Expert
vor 1 Monat
Canberra, Österreich Kirra Services VollzeitCanberra – Candidates must work from the companies Canberra office a minimum of 3 days per week.Mandatory Criteria:• A minimum of five to eight years of practical experience as a data analyst engineer or in a comparable position is required. The candidate must have experience leading teams of data professionals within the public sector, as this...
-
Systems Engineer
vor 1 Monat
Canberra, Österreich Nurseaid VollzeitJob Profile Name: Senior Systems EngineerPosition Overview:The Senior Systems Engineer is a member of the Systems COE and a technical expert responsible for supporting systems engineering activities for various applications newly developed or enhanced by the Mobile & Cloud Software Engineering group.The position will directly involve hands-on development of...
-
Azure Data Factory Engineer
vor 1 Monat
Canberra, Österreich Calleo Australia VollzeitJob OverviewCollaborating with team members and stakeholders to design data integration solutions that meet business requirements, utilising Microsoft Azure tools such as Azure Data Factory and SQL.Develop, implement, and maintain ETL pipelines to ensure efficient and secure data transfer between various systems, adhering to best practices for data...
-
Data Analyst
vor 2 Wochen
Canberra, Österreich Kinexus VollzeitWe are seeking experienced Data Engineers and Analysts to support Australia's strategic defence capabilities over the next decade. Your contributions will play a crucial role in maintaining our nation's competitive edge by providing vital insights that protect Australia's interests, both domestically and abroad.This newly created position will be central to...
-
Aps Data Scientists/Engineers
vor 4 Wochen
Canberra, Österreich Randstad VollzeitModelling & Simulation (Science & Technology)Analyze complex data sets to derive actionable insights and inform decision-making.Develop and maintain data pipelines and ETL processes for efficient data flow.Implement machine learning models to solve business problems and improve services.Collaborate with stakeholders to identify data requirements and...
-
Cloud Engineer
vor 1 Monat
Canberra, Österreich Clearcompany VollzeitCanberra City with some WFH 7 month contract + possible extensions NV1 security clearance preferred Our client, a mid-sized and well-funded Federal Government Department, is seeking a Cloud Engineer to join their team ASAP.Work on infrastructure tasks: Office 365 Mail, File collaboration, Teams Azure AD Identity and automation Security compliance...
-
Aps Data Scientists/Engineers
vor 4 Wochen
Canberra, Österreich Randstad VollzeitModelling & Simulation (Science & Technology) Analyze complex data sets to derive actionable insights and inform decision-making.Develop and maintain data pipelines and ETL processes for efficient data flow.Implement machine learning models to solve business problems and improve services.Collaborate with stakeholders to identify data requirements and...
-
Advanced Services Engineer
vor 1 Monat
Canberra, Österreich Arista Networks VollzeitCompany DescriptionArista Networks is an industry leader in data-driven, client-to-cloud networking for large data center, campus and routing environments.What sets us apart is our relentless pursuit of innovation.We leverage the latest advancements in cloud computing, artificial intelligence, and software-defined networking to provide our clients with a...