Data Engineer
vor 7 Stunden
Data Engineers (Multiple)
RFQ closing date: Wednesday, 06 November 2024
Client: Department of Agriculture, Fisheries and Forestry
Requirements
The Department of Agriculture, Fisheries and Forestry (DAFF) is looking for Data Engineers to join its Enterprise Analytics section to work across several data and analytics platforms. We are seeking candidates with strong experience in developing Extract, Transform, Load (ETL) and Extract, Load, Transform (ELT) processes, and/or the development of data products and complex data visualisations.
The role will be responsible for design, development and unit testing activities across several data movement, data transformation, and data visualisation processes within DAFF. The data movement and transformation processes focus on the preparation of data for use in decision-making processes across the department, utilising modern cloud technology (Azure) to enable operational analytics use cases.
The successful candidate will require experience with the following techniques and technologies:
MS Azure Stack
Data Integration - Data Factory, SQL Server Integration Services and/or Databricks
Data Store - SQL Server and/or Data Lake Storage
Analytics - Azure Databricks, Azure Machine Learning, ArcGIS Enterprise
Development tools - DevOps, Visual Studio, VS Code
Data technology solutions sourcing (Oracle, Ingres, Azure, SQL Server), collecting, ingesting and storing
Data Preparation
Transformation of data into formats tailored to analytics use cases - Parquet and/or Delta
Data Visualisation
Analyse and interpret complex data sets, and to identify trends and patterns.
Design principles to create appropriate visualisations for target audience.
Visualisation tools - Power BI
Initial contract period is 12 months.
Candidates must hold a valid Baseline security clearance or be willing and eligible to obtain one. Please provide your CSID on your resumé/CV (if known).
Estimated start date: Wednesday, 20 November 2024
Initial contract duration: 12 Months
Extension term: 12 months
Number of extensions: 2
Location of work: ACT, Offsite
Working arrangements: Most of the section is located at Agriculture House in the Canberra CBD. Our standard expectation is for staff to attend the office three (3) working days each week. The section is supportive of flexible arrangements and consideration will be made for individual and collaboration needs, including attendance at important Agile ceremonies and other team/section events.
Security clearance: Must have Baseline
Criteria
Essential criteria
Demonstrated experience developing ETL/ELT processes for complex and/or large data movement, transformation and/or visualisations, particularly in a cloud environment. (50%)
Experience preparing data optimised for query performance in cloud computed engines (e.g., Distributed computing engines (Spark), Graph Databases, Azure SQL) (25%)
Experience working with Engineering, Storage and Analytics services in cloud infrastructure. (25%)
Desirable criteria
Experience working with Azure Data Factory and Databricks.
Experience/Knowledge of working with Data Lake and Lakehouses.
#J-18808-Ljbffr
-
Systems Engineer/Administrator
vor 3 Wochen
Canberra, Österreich Trellis Data VollzeitNetworks & Systems Administration (Information & Communication Technology)Trellis Data is an award-winning AI SaaS and Deployed AI company.As one of the leading providers of secure AI products, and builders of large language models and other cutting-edge AI technology, we provide a highly innovative and vibrant culture.We are looking for a highly skilled and...
-
Data Engineer
vor 2 Wochen
Canberra, Österreich ULTRA VollzeitRole: Data Engineer Client: Federal Government Contract: 12 Months Extension: 12 Months Clearance: Baseline Location: ACT Requirements: MS Azure Stack Data Integration - Data Factory, SQL Server Integration Services and/or Databricks, LogicApp and/or FunctionApp Data Store - SQL Server and/or Data Lake Storage, Unity Catalog (Medallion Architecture)...
-
Data Engineer
vor 3 Wochen
Canberra, Österreich Cyos Solutions VollzeitApplication closing date: Thursday, 10 October 2024 • 11:59pm, Canberra time (in Canberra)Estimated start date: Tuesday, 29 October 2024Location of work: ACTWorking arrangements: It is the AEC's preference that this role be performed from the Office. Hybrid working arrangements will be considered at the discretion of the Hiring Manager.Length of contract:...
-
Data Engineer
vor 3 Wochen
Canberra, Österreich Cyos Solutions VollzeitApplication closing date: Thursday, 10 October 2024 • 11:59pm, Canberra time (in Canberra)Estimated start date: Tuesday, 29 October 2024Location of work: ACTWorking arrangements: It is the AEC's preference that this role be performed from the Office. Hybrid working arrangements will be considered at the discretion of the Hiring Manager.Length of contract:...
-
Data Engineer
vor 2 Wochen
Canberra, Österreich ULTRA VollzeitRole: Data EngineerClient: Federal GovernmentContract: 12 MonthsExtension: 12 MonthsClearance: BaselineLocation: ACTRequirements: MS Azure Stack Data Integration - Data Factory, SQL Server Integration Services and/or Databricks, LogicApp and/or FunctionApp Data Store - SQL Server and/or Data Lake Storage, Unity Catalog (Medallion Architecture) Analytics -...
-
Data Engineer
vor 1 Woche
Canberra, Österreich Clearcompany VollzeitAllara Street, Canberra - 2 days WFHActive NV1 Security Clearance required 12+12+12 month Federal Government contractOur client, a Federal Government agency who promotes and protects Australia's international interests to support our security and prosperity, is seeking an experienced Data Engineer to join their team. Duties/skills: Assist with performance...
-
Data Engineer
Vor 2 Tagen
Canberra, Österreich Calleo Australia VollzeitSeeking a Data Engineer to work with a large Government Agency commencing early 2025.Responsibilities Designing and optimising the database to ensure efficient data storage, retrieval, and management.Schema Design: design the database schema to support application requirements, including creating tables, relationships, indexes, and optimising the database...
-
Data Engineer
Vor 4 Tagen
Canberra, Österreich AUCA VollzeitSeeking a Data Engineer to work with a large Government Agency commencing early 2025.ResponsibilitiesDesigning and optimising the database to ensure efficient data storage, retrieval, and management.Schema Design: design the database schema to support application requirements, including creating tables, relationships, indexes, and optimising the database...
-
Data Engineer
Vor 7 Tagen
Canberra, Österreich Clearcompany VollzeitAllara Street, Canberra - 2 days WFH Active NV1 Security Clearance required 12+12+12 month Federal Government contract Our client, a Federal Government agency who promotes and protects Australia's international interests to support our security and prosperity, is seeking an experienced Data Engineer to join their team. Duties/skills: Assist with performance...
-
Data Engineer
Vor 3 Tagen
Canberra, Österreich Calleo VollzeitSeeking a Data Engineer to work with a large Government Agency commencing early 2025.Responsibilities Designing and optimising the database to ensure efficient data storage, retrieval, and management.Schema Design: design the database schema to support application requirements, including creating tables, relationships, indexes, and optimising the database...
-
Data Engineer
Vor 7 Tagen
Canberra, Österreich Services Australia VollzeitFull timeServices Australia (the agency) Data Engineer and Technical Information & Knowledge Officers design and implement complex data flows to connect operational systems and data for analytics and business intelligence systems, whilst ensuring data security and governance. They play an important role in resolving and managing issues that impact...
-
Data Engineer
Vor 7 Tagen
Canberra, Österreich Services Australia VollzeitFull time Services Australia (the agency) Data Engineer and Technical Information & Knowledge Officers design and implement complex data flows to connect operational systems and data for analytics and business intelligence systems, whilst ensuring data security and governance.They play an important role in resolving and managing issues that impact...
-
Data Engineer
Vor 7 Tagen
Canberra, Österreich Services Australia VollzeitFull timeServices Australia (the agency) Data Engineer and Technical Information & Knowledge Officers design and implement complex data flows to connect operational systems and data for analytics and business intelligence systems, whilst ensuring data security and governance.They play an important role in resolving and managing issues that impact performance...
-
Data Centre Engineer
vor 3 Wochen
Canberra, Österreich Leidos VollzeitLeidos is a Fortune 500 Technology, Engineering, and Science Solutions and Services leader. Leidos' 47,000 global employees support vital missions for government and commercial customers. Headquartered in Reston, Va., Leidos reported annual revenues of approximately $15.4 billion for the fiscal year ended December 29, 2023.Leidos Australia has been a trusted...
-
Data Centre Engineer
vor 2 Wochen
Canberra, Österreich Leidos VollzeitLeidos is a Fortune 500 Technology, Engineering, and Science Solutions and Services leader.Leidos' 47,000 global employees support vital missions for government and commercial customers.Headquartered in Reston, Va., Leidos reported annual revenues of approximately $15.4 billion for the fiscal year ended December 29, 2023.Leidos Australia has been a trusted...
-
Data Centre Engineer
vor 1 Woche
Canberra, Österreich Tideri Jobbörse VollzeitLeidos is a Fortune 500 Technology, Engineering, and Science Solutions and Services leader.Leidos' 47,000 global employees support vital missions for government and commercial customers.Headquartered in Reston, Va., Leidos reported annual revenues of approximately $15.4 billion for the fiscal year ended December 29, 2023.Leidos Australia has been a trusted...
-
Data Centre Engineer
vor 2 Wochen
Canberra, Österreich Tideri Jobbörse VollzeitLeidos is a Fortune 500 Technology, Engineering, and Science Solutions and Services leader.Leidos' 47,000 global employees support vital missions for government and commercial customers.Headquartered in Reston, Va., Leidos reported annual revenues of approximately $15.4 billion for the fiscal year ended December 29, 2023.Leidos Australia has been a trusted...
-
Data Engineer
vor 2 Wochen
Canberra, Österreich Allura Partners VollzeitGovernment organization looking for a Data Engineer on a long-term contract basis.16th September, 2024 Position: Cloud Engineer / Platform Engineer Contract Duration: 12 Months (with high chance of extension) Skills Required: Neo4j, NV1 security clearance I am working with a Government department who are looking for a Platform Engineer with skills in Neo4j,...
-
Data Engineer
vor 2 Wochen
Canberra, Österreich Allura Partners VollzeitGovernment organization looking for a Data Engineer on a long-term contract basis.16th September, 2024Position: Cloud Engineer / Platform EngineerContract Duration: 12 Months (with high chance of extension)Skills Required: Neo4j, NV1 security clearanceI am working with a Government department who are looking for a Platform Engineer with skills in Neo4j, who...
-
Data Engineer
vor 3 Wochen
Canberra, Österreich Robert Walters Australia VollzeitI am looking for Data Engineers with strong experience in developing Extract, Transform, Load (ETL) and Extract, Load, Transform (ELT) processes, as well as expertise in developing data products and complex visualizations.Clearance: Australian Citizenship with Baseline Security Clearance required$110-$140 P/HourKey Responsibilities:Design, development, and...
