Data Engineer

vor 2 Monaten


Canberra, Österreich Virtuoso Consulting Pty Ltd Vollzeit

Data Engineers (Multiple)
RFQ closing date: Wednesday, 06 November 2024
Client: Department of Agriculture, Fisheries and Forestry
Requirements
The Department of Agriculture, Fisheries and Forestry (DAFF) is looking for Data Engineers to join its Enterprise Analytics section to work across several data and analytics platforms. We are seeking candidates with strong experience in developing Extract, Transform, Load (ETL) and Extract, Load, Transform (ELT) processes, and/or the development of data products and complex data visualisations.
The role will be responsible for design, development and unit testing activities across several data movement, data transformation, and data visualisation processes within DAFF. The data movement and transformation processes focus on the preparation of data for use in decision-making processes across the department, utilising modern cloud technology (Azure) to enable operational analytics use cases.
The successful candidate will require experience with the following techniques and technologies:

MS Azure Stack

Data Integration - Data Factory, SQL Server Integration Services and/or Databricks
Data Store - SQL Server and/or Data Lake Storage
Analytics - Azure Databricks, Azure Machine Learning, ArcGIS Enterprise

Development tools - DevOps, Visual Studio, VS Code
Data technology solutions sourcing (Oracle, Ingres, Azure, SQL Server), collecting, ingesting and storing
Data Preparation

Transformation of data into formats tailored to analytics use cases - Parquet and/or Delta

Data Visualisation

Analyse and interpret complex data sets, and to identify trends and patterns.
Design principles to create appropriate visualisations for target audience.
Visualisation tools - Power BI

Initial contract period is 12 months.
Candidates must hold a valid Baseline security clearance or be willing and eligible to obtain one. Please provide your CSID on your resumé/CV (if known).
Estimated start date: Wednesday, 20 November 2024
Initial contract duration: 12 Months
Extension term: 12 months
Number of extensions: 2
Location of work: ACT, Offsite
Working arrangements: Most of the section is located at Agriculture House in the Canberra CBD. Our standard expectation is for staff to attend the office three (3) working days each week. The section is supportive of flexible arrangements and consideration will be made for individual and collaboration needs, including attendance at important Agile ceremonies and other team/section events.
Security clearance: Must have Baseline
Criteria
Essential criteria

Demonstrated experience developing ETL/ELT processes for complex and/or large data movement, transformation and/or visualisations, particularly in a cloud environment. (50%)
Experience preparing data optimised for query performance in cloud computed engines (e.g., Distributed computing engines (Spark), Graph Databases, Azure SQL) (25%)
Experience working with Engineering, Storage and Analytics services in cloud infrastructure. (25%)

Desirable criteria

Experience working with Azure Data Factory and Databricks.
Experience/Knowledge of working with Data Lake and Lakehouses.

#J-18808-Ljbffr


  • Data Engineer

    vor 2 Monaten


    Canberra, Österreich ULTRA Vollzeit

    Role: Data Engineer Client: Federal Government Contract: 12 Months Extension: 12 Months Clearance: Baseline Location: ACT Requirements: MS Azure Stack Data Integration - Data Factory, SQL Server Integration Services and/or Databricks, LogicApp and/or FunctionApp Data Store - SQL Server and/or Data Lake Storage, Unity Catalog (Medallion Architecture)...

  • Data Engineer

    vor 2 Monaten


    Canberra, Österreich ULTRA Vollzeit

    Role: Data EngineerClient: Federal GovernmentContract: 12 MonthsExtension: 12 MonthsClearance: BaselineLocation: ACTRequirements: MS Azure Stack Data Integration - Data Factory, SQL Server Integration Services and/or Databricks, LogicApp and/or FunctionApp Data Store - SQL Server and/or Data Lake Storage, Unity Catalog (Medallion Architecture) Analytics -...

  • Data Engineer

    vor 1 Monat


    Canberra, Österreich Paxus Vollzeit

    Job Title: Data and Analytics EngineerLocation: Canberra, Adelaide, Brisbane, Melbourne, Perth, SydneyAbout the Role We are looking for skilled Data and Analytics Engineers with expertise in data platforms, Artificial Intelligence (AI), Large Language Models (LLMs), Machine Learning (ML), and Robotic Process Automation (RPA).In this role, you will leverage...

  • Data Engineer

    vor 4 Wochen


    Canberra, Österreich Paxus - Technology + Digital Talent Vollzeit

    Our client is a key regulatory body responsible for upholding quality, safety, and consumer independence in a nationally significant sector.With the sector experiencing significant growth and evolution since its inception, the organisation faces critical challenges that require transformative solutions.To address these, the Australian Federal Government has...

  • Graduate Data Engineer

    vor 4 Wochen


    Canberra, Österreich Gridsight Vollzeit

    Gridsight is a rapidly growing Grid/CleanTech startup that is accelerating global electrification and decarbonisation. Our AI-powered software generates insights that ensure electrical utilities maximise reliability, optimise operations, and integrate renewable energy sources seamlessly into the grid. Having recently raised our Series A round, we're excited...

  • Graduate Data Engineer

    vor 4 Wochen


    Canberra, Österreich Gridsight Vollzeit

    Gridsight is a rapidly growing Grid/CleanTech startup that is accelerating global electrification and decarbonisation.Our AI-powered software generates insights that ensure electrical utilities maximise reliability, optimise operations, and integrate renewable energy sources seamlessly into the grid.Having recently raised our Series A round, we're excited to...

  • Data Engineer

    vor 2 Monaten


    Canberra, Österreich Ultradynamix Vollzeit

    Role: Data EngineerClient: Federal GovernmentContract: 12 MonthsExtension: 12 MonthsClearance: BaselineLocation: ACTRequirements:MS Azure StackData Integration - Data Factory, SQL Server Integration Services and/or Databricks, LogicApp and/or FunctionAppData Store - SQL Server and/or Data Lake Storage, Unity Catalog (Medallion Architecture)Analytics - Azure...


  • Canberra, Österreich Comcare Vollzeit

    The Technology and Information Management team maintain Comcare's Information, Communication and Technology (ICT) infrastructure and provide strategic leadership, governance, solutions and advice for the effective management of information.Overview of the RoleThis position will play a pivotal role in the creation and maintenance of our advanced Azure...


  • Canberra, Österreich Comcare Vollzeit

    The Technology and Information Management team maintain Comcare's Information, Communication and Technology (ICT) infrastructure and provide strategic leadership, governance, solutions and advice for the effective management of information.Overview of the Role This position will play a pivotal role in the creation and maintenance of our advanced Azure...


  • Canberra, Österreich Tideri Jobbörse Vollzeit

    Must have Negative Vetting Level 1 Security clearance.Location of work: ACT, NSW, QLD, SA, VIC Primary Technologies: Windows Server Windows Desktop Applications Packager Rapid 7 Broadcom Data Centre Security Engineer Key Tasks/Duties/Requirements: Perform BAU operations, maintenance and management.Planning, scheduling, and implementing periodical patch, bug...

  • Data Engineering

    vor 1 Monat


    Canberra, Österreich Infinite Consulting Vollzeit

    Job Description: Data Engineer Contract Duration: Up to 30 June 2025 Location: ACT – Flexible work arrangement can be discussed Eligibility: Australian Citizens with Baseline Clearance Infinite Consulting is seeking an experienced Data Engineer for our esteemed Federal Government Client.The contract duration is up to 30 June 2025 with an October start....

  • Data Engineering

    vor 3 Wochen


    Canberra, Österreich Infinite Consulting Vollzeit

    Job DescriptionPosition: Data Engineer ContractDuration: up to 30 June 2025Location: ACT – Flexible work arrangement can be discussedEligibility: Australian Citizens with Baseline ClearanceInfinite Consulting is seeking an experienced Data Engineer for our esteemed Federal Government Client.The contract duration is up to 30 June 2025 with an October...


  • Canberra, Österreich Kirra Services Vollzeit

    Canberra – Candidates must work from the companies Canberra office a minimum of 3 days per week.Mandatory Criteria:• A minimum of five to eight years of practical experience as a data analyst engineer or in a comparable position is required. The candidate must have experience leading teams of data professionals within the public sector, as this...

  • Systems Engineer

    vor 1 Monat


    Canberra, Österreich Nurseaid Vollzeit

    Job Profile Name: Senior Systems EngineerPosition Overview:The Senior Systems Engineer is a member of the Systems COE and a technical expert responsible for supporting systems engineering activities for various applications newly developed or enhanced by the Mobile & Cloud Software Engineering group.The position will directly involve hands-on development of...


  • Canberra, Österreich Calleo Australia Vollzeit

    Job OverviewCollaborating with team members and stakeholders to design data integration solutions that meet business requirements, utilising Microsoft Azure tools such as Azure Data Factory and SQL.Develop, implement, and maintain ETL pipelines to ensure efficient and secure data transfer between various systems, adhering to best practices for data...

  • Data Analyst

    vor 2 Wochen


    Canberra, Österreich Kinexus Vollzeit

    We are seeking experienced Data Engineers and Analysts to support Australia's strategic defence capabilities over the next decade. Your contributions will play a crucial role in maintaining our nation's competitive edge by providing vital insights that protect Australia's interests, both domestically and abroad.This newly created position will be central to...


  • Canberra, Österreich Randstad Vollzeit

    Modelling & Simulation (Science & Technology)Analyze complex data sets to derive actionable insights and inform decision-making.Develop and maintain data pipelines and ETL processes for efficient data flow.Implement machine learning models to solve business problems and improve services.Collaborate with stakeholders to identify data requirements and...

  • Cloud Engineer

    vor 1 Monat


    Canberra, Österreich Clearcompany Vollzeit

    Canberra City with some WFH 7 month contract + possible extensions NV1 security clearance preferred Our client, a mid-sized and well-funded Federal Government Department, is seeking a Cloud Engineer to join their team ASAP.Work on infrastructure tasks: Office 365 Mail, File collaboration, Teams Azure AD Identity and automation Security compliance...


  • Canberra, Österreich Randstad Vollzeit

    Modelling & Simulation (Science & Technology) Analyze complex data sets to derive actionable insights and inform decision-making.Develop and maintain data pipelines and ETL processes for efficient data flow.Implement machine learning models to solve business problems and improve services.Collaborate with stakeholders to identify data requirements and...


  • Canberra, Österreich Arista Networks Vollzeit

    Company DescriptionArista Networks is an industry leader in data-driven, client-to-cloud networking for large data center, campus and routing environments.What sets us apart is our relentless pursuit of innovation.We leverage the latest advancements in cloud computing, artificial intelligence, and software-defined networking to provide our clients with a...