Data Engineer

vor 7 Stunden


Canberra, Österreich Virtuoso Consulting Pty Ltd Vollzeit

Data Engineers (Multiple)
RFQ closing date: Wednesday, 06 November 2024
Client: Department of Agriculture, Fisheries and Forestry
Requirements
The Department of Agriculture, Fisheries and Forestry (DAFF) is looking for Data Engineers to join its Enterprise Analytics section to work across several data and analytics platforms. We are seeking candidates with strong experience in developing Extract, Transform, Load (ETL) and Extract, Load, Transform (ELT) processes, and/or the development of data products and complex data visualisations.
The role will be responsible for design, development and unit testing activities across several data movement, data transformation, and data visualisation processes within DAFF. The data movement and transformation processes focus on the preparation of data for use in decision-making processes across the department, utilising modern cloud technology (Azure) to enable operational analytics use cases.
The successful candidate will require experience with the following techniques and technologies:

MS Azure Stack

Data Integration - Data Factory, SQL Server Integration Services and/or Databricks
Data Store - SQL Server and/or Data Lake Storage
Analytics - Azure Databricks, Azure Machine Learning, ArcGIS Enterprise

Development tools - DevOps, Visual Studio, VS Code
Data technology solutions sourcing (Oracle, Ingres, Azure, SQL Server), collecting, ingesting and storing
Data Preparation

Transformation of data into formats tailored to analytics use cases - Parquet and/or Delta

Data Visualisation

Analyse and interpret complex data sets, and to identify trends and patterns.
Design principles to create appropriate visualisations for target audience.
Visualisation tools - Power BI

Initial contract period is 12 months.
Candidates must hold a valid Baseline security clearance or be willing and eligible to obtain one. Please provide your CSID on your resumé/CV (if known).
Estimated start date: Wednesday, 20 November 2024
Initial contract duration: 12 Months
Extension term: 12 months
Number of extensions: 2
Location of work: ACT, Offsite
Working arrangements: Most of the section is located at Agriculture House in the Canberra CBD. Our standard expectation is for staff to attend the office three (3) working days each week. The section is supportive of flexible arrangements and consideration will be made for individual and collaboration needs, including attendance at important Agile ceremonies and other team/section events.
Security clearance: Must have Baseline
Criteria
Essential criteria

Demonstrated experience developing ETL/ELT processes for complex and/or large data movement, transformation and/or visualisations, particularly in a cloud environment. (50%)
Experience preparing data optimised for query performance in cloud computed engines (e.g., Distributed computing engines (Spark), Graph Databases, Azure SQL) (25%)
Experience working with Engineering, Storage and Analytics services in cloud infrastructure. (25%)

Desirable criteria

Experience working with Azure Data Factory and Databricks.
Experience/Knowledge of working with Data Lake and Lakehouses.

#J-18808-Ljbffr



  • Canberra, Österreich Trellis Data Vollzeit

    Networks & Systems Administration (Information & Communication Technology)Trellis Data is an award-winning AI SaaS and Deployed AI company.As one of the leading providers of secure AI products, and builders of large language models and other cutting-edge AI technology, we provide a highly innovative and vibrant culture.We are looking for a highly skilled and...

  • Data Engineer

    vor 2 Wochen


    Canberra, Österreich ULTRA Vollzeit

    Role: Data Engineer Client: Federal Government Contract: 12 Months Extension: 12 Months Clearance: Baseline Location: ACT Requirements: MS Azure Stack Data Integration - Data Factory, SQL Server Integration Services and/or Databricks, LogicApp and/or FunctionApp Data Store - SQL Server and/or Data Lake Storage, Unity Catalog (Medallion Architecture)...

  • Data Engineer

    vor 3 Wochen


    Canberra, Österreich Cyos Solutions Vollzeit

    Application closing date: Thursday, 10 October 2024 • 11:59pm, Canberra time (in Canberra)Estimated start date: Tuesday, 29 October 2024Location of work: ACTWorking arrangements: It is the AEC's preference that this role be performed from the Office. Hybrid working arrangements will be considered at the discretion of the Hiring Manager.Length of contract:...

  • Data Engineer

    vor 3 Wochen


    Canberra, Österreich Cyos Solutions Vollzeit

    Application closing date: Thursday, 10 October 2024 • 11:59pm, Canberra time (in Canberra)Estimated start date: Tuesday, 29 October 2024Location of work: ACTWorking arrangements: It is the AEC's preference that this role be performed from the Office. Hybrid working arrangements will be considered at the discretion of the Hiring Manager.Length of contract:...

  • Data Engineer

    vor 2 Wochen


    Canberra, Österreich ULTRA Vollzeit

    Role: Data EngineerClient: Federal GovernmentContract: 12 MonthsExtension: 12 MonthsClearance: BaselineLocation: ACTRequirements: MS Azure Stack Data Integration - Data Factory, SQL Server Integration Services and/or Databricks, LogicApp and/or FunctionApp Data Store - SQL Server and/or Data Lake Storage, Unity Catalog (Medallion Architecture) Analytics -...

  • Data Engineer

    vor 1 Woche


    Canberra, Österreich Clearcompany Vollzeit

    Allara Street, Canberra - 2 days WFHActive NV1 Security Clearance required 12+12+12 month Federal Government contractOur client, a Federal Government agency who promotes and protects Australia's international interests to support our security and prosperity, is seeking an experienced Data Engineer to join their team. Duties/skills: Assist with performance...

  • Data Engineer

    Vor 2 Tagen


    Canberra, Österreich Calleo Australia Vollzeit

    Seeking a Data Engineer to work with a large Government Agency commencing early 2025.Responsibilities Designing and optimising the database to ensure efficient data storage, retrieval, and management.Schema Design: design the database schema to support application requirements, including creating tables, relationships, indexes, and optimising the database...

  • Data Engineer

    Vor 4 Tagen


    Canberra, Österreich AUCA Vollzeit

    Seeking a Data Engineer to work with a large Government Agency commencing early 2025.ResponsibilitiesDesigning and optimising the database to ensure efficient data storage, retrieval, and management.Schema Design: design the database schema to support application requirements, including creating tables, relationships, indexes, and optimising the database...

  • Data Engineer

    Vor 7 Tagen


    Canberra, Österreich Clearcompany Vollzeit

    Allara Street, Canberra - 2 days WFH Active NV1 Security Clearance required 12+12+12 month Federal Government contract Our client, a Federal Government agency who promotes and protects Australia's international interests to support our security and prosperity, is seeking an experienced Data Engineer to join their team. Duties/skills: Assist with performance...

  • Data Engineer

    Vor 3 Tagen


    Canberra, Österreich Calleo Vollzeit

    Seeking a Data Engineer to work with a large Government Agency commencing early 2025.Responsibilities Designing and optimising the database to ensure efficient data storage, retrieval, and management.Schema Design: design the database schema to support application requirements, including creating tables, relationships, indexes, and optimising the database...

  • Data Engineer

    Vor 7 Tagen


    Canberra, Österreich Services Australia Vollzeit

    Full timeServices Australia (the agency) Data Engineer and Technical Information & Knowledge Officers design and implement complex data flows to connect operational systems and data for analytics and business intelligence systems, whilst ensuring data security and governance. They play an important role in resolving and managing issues that impact...

  • Data Engineer

    Vor 7 Tagen


    Canberra, Österreich Services Australia Vollzeit

    Full time Services Australia (the agency) Data Engineer and Technical Information & Knowledge Officers design and implement complex data flows to connect operational systems and data for analytics and business intelligence systems, whilst ensuring data security and governance.They play an important role in resolving and managing issues that impact...

  • Data Engineer

    Vor 7 Tagen


    Canberra, Österreich Services Australia Vollzeit

    Full timeServices Australia (the agency) Data Engineer and Technical Information & Knowledge Officers design and implement complex data flows to connect operational systems and data for analytics and business intelligence systems, whilst ensuring data security and governance.They play an important role in resolving and managing issues that impact performance...

  • Data Centre Engineer

    vor 3 Wochen


    Canberra, Österreich Leidos Vollzeit

    Leidos is a Fortune 500 Technology, Engineering, and Science Solutions and Services leader. Leidos' 47,000 global employees support vital missions for government and commercial customers. Headquartered in Reston, Va., Leidos reported annual revenues of approximately $15.4 billion for the fiscal year ended December 29, 2023.Leidos Australia has been a trusted...

  • Data Centre Engineer

    vor 2 Wochen


    Canberra, Österreich Leidos Vollzeit

    Leidos is a Fortune 500 Technology, Engineering, and Science Solutions and Services leader.Leidos' 47,000 global employees support vital missions for government and commercial customers.Headquartered in Reston, Va., Leidos reported annual revenues of approximately $15.4 billion for the fiscal year ended December 29, 2023.Leidos Australia has been a trusted...

  • Data Centre Engineer

    vor 1 Woche


    Canberra, Österreich Tideri Jobbörse Vollzeit

    Leidos is a Fortune 500 Technology, Engineering, and Science Solutions and Services leader.Leidos' 47,000 global employees support vital missions for government and commercial customers.Headquartered in Reston, Va., Leidos reported annual revenues of approximately $15.4 billion for the fiscal year ended December 29, 2023.Leidos Australia has been a trusted...

  • Data Centre Engineer

    vor 2 Wochen


    Canberra, Österreich Tideri Jobbörse Vollzeit

    Leidos is a Fortune 500 Technology, Engineering, and Science Solutions and Services leader.Leidos' 47,000 global employees support vital missions for government and commercial customers.Headquartered in Reston, Va., Leidos reported annual revenues of approximately $15.4 billion for the fiscal year ended December 29, 2023.Leidos Australia has been a trusted...

  • Data Engineer

    vor 2 Wochen


    Canberra, Österreich Allura Partners Vollzeit

    Government organization looking for a Data Engineer on a long-term contract basis.16th September, 2024 Position: Cloud Engineer / Platform Engineer Contract Duration: 12 Months (with high chance of extension) Skills Required: Neo4j, NV1 security clearance I am working with a Government department who are looking for a Platform Engineer with skills in Neo4j,...

  • Data Engineer

    vor 2 Wochen


    Canberra, Österreich Allura Partners Vollzeit

    Government organization looking for a Data Engineer on a long-term contract basis.16th September, 2024Position: Cloud Engineer / Platform EngineerContract Duration: 12 Months (with high chance of extension)Skills Required: Neo4j, NV1 security clearanceI am working with a Government department who are looking for a Platform Engineer with skills in Neo4j, who...

  • Data Engineer

    vor 3 Wochen


    Canberra, Österreich Robert Walters Australia Vollzeit

    I am looking for Data Engineers with strong experience in developing Extract, Transform, Load (ETL) and Extract, Load, Transform (ELT) processes, as well as expertise in developing data products and complex visualizations.Clearance: Australian Citizenship with Baseline Security Clearance required$110-$140 P/HourKey Responsibilities:Design, development, and...