Data Engineer

vor 2 Wochen

Canberra, Österreich Nuvento Vollzeit
Who we are and how are we different?

Nuvento is a Canberra-based specialist technical data consultancy that provides consultancy services to both private and public organizations throughout Australia. Our team consists of passionate and highly skilled professionals who are dedicated to delivering the right solutions with the right tech in the right way, on time, every time.

We're a business run by techs, for techs, that challenge the mould and strives to be different.

Our driving principles include:

  • being generous in our knowledge, spirit, and time
  • accountable and transparent
  • dedicated to growth, knowledge sharing and development
  • valuing work-life balance
  • and rewarding our staff for the value they provide
Who we are looking for:

We are looking for a Data Engineer with experience in Spark and Kafka to operate with one of our large Federal Government Clients. As a Data Engineer, you will have the opportunity to work with cutting-edge technologies and collaborate with cross-functional teams to ensure successful data integration.

Your Responsibilities:

  • Maintain and develop Spark pipelines to process large-scale data sets.
  • Ingest tables into our data lake from Kafka using batch processing, micro-batching, or real-time processing techniques.
  • Run Spark jobs for ingestion, curation, and extraction of data.
  • Alter schemas and configs to meet business requirements and ensure data quality.
  • Attend meetings regarding data ingestion and collaborate with cross-functional teams to ensure successful data integration.
  • Troubleshoot and resolve bugs in the data processing pipelines.
  • Monitor performance and troubleshoot issues using logging and monitoring tools.
  • Document best practices and develop standards for data processing pipelines.
  • Stay up-to-date with emerging technologies and industry trends in big data processing and analytics.

Requirements:

  • Bachelor's or Master's degree in Computer Science, Software Engineering, or a related field.
  • 3+ years of experience in data engineering, software development, or a related field.
  • Strong programming skills in Scala, Python, or Java.
  • Expertise in Spark, Kafka, and big data processing concepts.
  • Experience with data storage solutions, such as Hadoop HDFS or Amazon S3, and data serialization formats
  • Knowledge of database concepts, data modelling, schema design, and normalisation.
  • Familiarity with monitoring and logging tools, and workflow management tools, such as Apache Airflow.
  • Experience with version control systems, such as Git

Your attributes and aptitude:

  • Strong communication, problem-solving, and collaboration abilities.
  • Ability to work independently and in a team-oriented, collaborative environment.

Security Clearance Required - All applicants must have a Baseline (NV1 preferred)

Why work with Nuvento?

We offer competitive compensation packages and benefits, along with opportunities for growth and advancement within the company. As a member of our team, you will have the chance to work on challenging projects, develop your skills, and make a real impact on our business.

If you are a self-motivated and results-oriented data engineer with a passion for big data processing, we encourage you to apply for this exciting opportunity.

How to apply:

This role is available to candidates based in Melbourne, Canberra & Brisbane.

To apply for this position, please complete your profile and apply via our LiveHire application portal located with this ad.

New positions regularly come available with the flexibility provided around commencement dates.

All new opportunities will be posted via our talent community, as this is our preferred space to source exceptional top talent.

Don't have the required experience?

Don't have experience but want to start your career with a progressive and professional consultancy ran by techs for techs? Then head over to our Data Academy to learn more about undertaking training with some of the best leaders in the industry.

Reach out to us atTalent@nuvento.com.auto learn more about the Data Academy.

#J-18808-Ljbffr

  • Data Engineer

    vor 4 Wochen

    Canberra, Österreich ClearCompany Vollzeit

    Job Title: Data EngineerLocation: ACT or NSW Contract: 12 Months (+ 12 Month Extension)Daily Rate: $1000 per day + Super Talenza have partnered with a Federal Government Agency who an innovator in the utilties industry, committed to delivering high-quality solutions and services to its customers. Our client is seeking to bring on multiple Data Engineers to...

  • Data Engineer

    vor 2 Wochen

    Canberra, Österreich ITLEA Vollzeit

    Engineering - Software (Information & Communication Technology) ITLEA is seeking for an experienced Data Engineerto work with a large Federal department on a long-term contract.Qualifications/ExperienceBachelor’s degree in computer science, Engineering, or a related field.Certifications in Azure Data Services, such as the Microsoft Certified: Azure Data...

  • Microsoft Azure Engineer

    vor 1 Monat

    Canberra, Österreich Data#3 Vollzeit

    Developers/Programmers (Information & Communication Technology) Full time Add expected salary to your profile for insights Work for HRD's Employer of Choice winner for 9 years in a row!Join a company with HEARTJoin Australia’s largest Microsoft Partner and cloud partner of choiceAs a Microsoft Azure Engineer at Data#3, you'll play a pivotal role...

  • Microsoft Azure Engineer

    vor 4 Wochen

    Canberra, Österreich Data#3 Vollzeit

    Developers/Programmers (Information & Communication Technology) Full time Add expected salary to your profile for insights Work for HRD's Employer of Choice winner for 9 years in a row!Join a company with HEARTJoin Australia’s largest Microsoft Partner and cloud partner of choiceAs a Microsoft Azure Engineer at Data#3, you'll play a pivotal role...

  • Cloudera Data Platform Engineer

    vor 2 Monaten

    Canberra, Österreich Allura Partners Vollzeit

    Cloudera Data Platform Engineer - Contract, $1,200 to $1,300 a day / NV1 - NV2I am working with a Government department who are looking for an engineer with Cloudera experience for a new project 14th May, 2024 Cloudera Data Platform Engineer - Contract, $1,200 to $1,300 a day / NV1 - NV2 I am working with a Government department who are looking for an...

  • Cloudera Data Platform Engineer

    vor 4 Wochen

    Canberra, Österreich Allura Partners Vollzeit

    Cloudera Data Platform Engineer - Contract, $1,200 to $1,300 a day / NV1 - NV2I am working with a Government department who are looking for an engineer with Cloudera experience for a new project 14th May, 2024 Cloudera Data Platform Engineer - Contract, $1,200 to $1,300 a day / NV1 - NV2 I am working with a Government department who are looking for an...

  • Data Engineers

    vor 4 Wochen

    Canberra, Österreich Experis ManpowerGroup Sp. z o.o. Vollzeit

    Data EngineerLocation: ACT Contract: until 30th June 2025Extension: 12 months Our client is seeking multiple Data Engineers to join their expanded team. Responsibilities:Design, build, and enhance data lakes, CI/CD, and Synapse pipelines on the Azure platform.Create scalable architectural solutions for pipeline designs.Oversee data migration and integration...

  • Erwin - Senior Data Engineer - 3 months Contract / $1,200 to $1,400 a day / NV2

    vor 4 Wochen

    Canberra, Österreich ClearCompany Vollzeit

    I am working with a government department who are looking for a senior engineer with hands on experience in Erwin.Erwin - Senior Data Engineer - 3 months Contract / $1,200 to $1,400 a day / NV2 Security ClearanceI am working with a government department who are looking for a senior engineer with hands on experience in Erwin design and development.Skill Set...

  • Earth Data Analytics Software Engineer

    vor 2 Wochen

    Canberra, Österreich Commonwealth Scientific and Industrial Research Organisation Vollzeit

    Press Tab to Move to Skip to Content Link Select how often (in days) to receive an alert: Location: Canberra, ACT, AU Adelaide, SA, AU Company: CSIRO Acknowledgement of Country CSIRO acknowledges the Traditional Owners of the land, sea and waters, of the area that we live and work on across Australia. We acknowledge their continuing connection to...

  • Azure Data Engineers

    vor 3 Wochen

    Canberra, Österreich SSM Technologies Vollzeit

    Database Development & Administration (Information & Communication Technology) Full time Add expected salary to your profile for insights The Data and Innovation Section of the Clean Energy Regulator (CER) is seeking up to three (3) Data Engineers. Role Responsibilities and DutiesDesign, construct, and optimize data lakes, CI/CD, and Synapse...

  • Broadcom Data Centre Security Engineer

    Vor 3 Tagen

    Canberra, Österreich Kirra Services Vollzeit

    Must have Negative Vetting Level 1 Security clearance. Location of work–  ACT, NSW, QLD, SA, VIC Primary Technologies• Windows Server, Windows Desktop, Applications Packager, Rapid 7, Broadcom Data Centre Security Engineer. Key Tasks/Duties/Requirements • Perform BAU operations, maintenance and management. • Planning,...

  • Senior Data Analyst

    vor 2 Wochen

    Canberra, Österreich Indicore ICT Vollzeit

    The requirement is for Senior Data Analyst to join one of our prestigious federal clients. The Senior Data Analyst will provide credentialed data expertise and technical analysis support to build, maintain and innovated well-managed data solutions and capabilities to solve business problems.Their work will empower the project team and guide business...

  • Data Engineers

    vor 4 Wochen

    Canberra, Österreich CYOS Solutions Vollzeit

    Application closing date: Friday, 14 June 2024 • 11:59pm, Canberra timeEstimated start date: Monday, 01 July 2024Location of work: ACTWorking arrangements: The team is based in Canberra however, working from home arrangements are considered subject to home-based work application and suitability. Interstate candidates will also be considered. However, there...

  • Data Engineers

    vor 3 Wochen

    Canberra, Österreich CYOS Solutions Vollzeit

    Application closing date: Friday, 14 June 2024 • 11:59pm, Canberra timeEstimated start date: Monday, 01 July 2024Location of work: ACTWorking arrangements: The team is based in Canberra however, working from home arrangements are considered subject to home-based work application and suitability. Interstate candidates will also be considered. However, there...

  • Data Engineers

    vor 3 Wochen

    Canberra, Österreich CYOS Solutions Vollzeit

    Application closing date: Friday, 14 June 2024 • 11:59pm, Canberra time Estimated start date: Monday, 01 July 2024 Location of work: ACTWorking arrangements: The team is based in Canberra however, working from home arrangements are considered subject to home-based work application and suitability. Interstate candidates will also be considered. However,...

  • Mutiple Data Analytics/ Business Intelligence Roles

    vor 3 Wochen

    Canberra, Österreich Opus Recruitment Solutions Ltd Vollzeit

    Mutiple Data Analytics/ Business Intelligence RolesCanberra, Australia Apply Mutiple Data Analytics/ Business Intelligence RolesCanberra, AustraliaContract$500 - $1000 per weekMUST HAVE NV1 CLEARANCE FOR ALL ROLESData Migration Analyst: Experience with SQL, Ingress and AdabasPower BI Developer: Proficieny in SQL server DB query dedign, M/Power Query,...

  • DevOps Engineer

    vor 2 Monaten

    Canberra, Österreich Allura Partners Vollzeit

    I am working with a Government department who are looking for an engineer with DevOps/ cloud skills in Azure, for a new project. 02nd May, 2024 DevOps Engineer / Platform Engineer / 6 months Contract / $1,100 to $1,300 a day / AzureI am working with a Government department who are looking for an engineer with DevOps/ cloud skills in Azure, for a new...

  • DevOps Engineer

    vor 4 Wochen

    Canberra, Österreich Allura Partners Vollzeit

    I am working with a Government department who are looking for an engineer with DevOps/ cloud skills in Azure, for a new project. 02nd May, 2024 DevOps Engineer / Platform Engineer / 6 months Contract / $1,100 to $1,300 a day / AzureI am working with a Government department who are looking for an engineer with DevOps/ cloud skills in Azure, for a new...

  • Azure Platform Engineer

    vor 2 Monaten

    Canberra, Österreich Kirra Services Vollzeit

    19th July, 2023 Must be able to obtain a Baseline clearance.Experience designing, building and maintaining cloud hosted platforms and services (Infrastructure, Platform and Software as a Service)Experience developing, implementing, and supporting cloud infrastructure using an infrastructure as code (IaC) approachUnderstanding of cloud security features for...

  • Azure Platform Engineer

    vor 4 Wochen

    Canberra, Österreich Kirra Services Vollzeit

    19th July, 2023 Must be able to obtain a Baseline clearance.Experience designing, building and maintaining cloud hosted platforms and services (Infrastructure, Platform and Software as a Service)Experience developing, implementing, and supporting cloud infrastructure using an infrastructure as code (IaC) approachUnderstanding of cloud security features for...