Senior Data Engineer

vor 4 Wochen

Melbourne, Österreich Victoria's Big Build Vollzeit

About North East Link

The Spark Consortium has been selected for the Central Package of the North East Link Project - Victoria's biggest road project.


The Spark Consortium’s Design and Construction Contractor - which comprises Webuild, CPB Contractors, GS Engineering and Construction and China Construction Oceania - will deliver the twin three-lane tunnels and key interchanges for the project.

The Central Package will be delivered as a Public Private Partnership and provides three-lane twin tunnels that will close the missing link in Melbourne’s freeway network from the M80 Ring Road to an upgraded Eastern Freeway, reducing journey times and diverting heavy vehicles away from local roads. Up to 135,000 vehicles will use North East Link every day, reducing congestion in the north-east while maintaining local roads.

About the Role

If these opportunities are of interest to you, please click on the ‘Apply now’ button to register your interest and please also subscribe to ‘Job Alerts’ to be notified of upcoming opportunities with SPARK.

As a Senior Data Engineer, you will play a crucial role in designing, building, and optimizing data solutions on the Microsoft Azure cloud platform. Your expertise will drive efficient data processing, storage, and analysis, enabling data-driven decision-making within the organization. Let’s break down your key responsibilities and qualifications:

Key Responsibilities:

  • Design and Optimize Data Pipelines:
    • Create robust data pipelines and workflows using Azure services such as Azure Data Lake and Databricks.
    • Ensure scalability, performance, and cost-effectiveness of data storage systems.
  • DevOps Implementation:
    • Apply DevOps best practices for continuous integration and continuous deployment (CI/CD) of data pipelines and applications.
    • Utilize tools like Azure DevOps, GitHub Actions, or similar platforms.
  • Collaboration and Solution Translation:
    • Work closely with data scientists, analysts, and developers to understand data requirements.
    • Translate these requirements into scalable and efficient data engineering solutions.
  • Reliability and Security:
    • Architect and implement automated testing, monitoring, and alerting mechanisms.
    • Ensure the reliability, performance, and security of data pipelines and systems.
  • Azure Service Integration:
    • Integrate with various Azure services, including Microsoft Fabric, KeyVault, and Azure Functions.
    • Enhance data processing capabilities while maintaining data security and compliance.
    • Infrastructure as Code (IaC):
    • Develop IaC using tools like Terraform to automate provisioning and configuration of Azure resources.
  • Data Transformation and Enrichment:
    • Utilize programming languages such as Python, Scala, and SQL to implement data transformations, cleansing, and enrichment.
  • Mentoring and Knowledge Sharing:
    • Mentor junior team members, provide technical guidance, and contribute to knowledge sharing initiatives.

Qualifications:

  • Proven Experience:
    • Demonstrated experience as a data engineer or in a similar role.
    • Strong focus on Azure cloud platform and DevOps practices.
  • Proficiency in Azure services, including Databricks, Azure Data Lake, Azure Data Factory, and Azure Synapse Analytics.
  • DevOps Skills:
    • Hands-on experience with DevOps tools such as Azure DevOps, Git, and setting up CI/CD pipelines.
    • Familiarity with automated testing.
  • Knowledge of Microsoft Fabric, Azure KeyVault, and Azure Cloud Functions.
  • Programming Languages:
    • Proficiency in Python, Scala, and SQL for data manipulation and transformation.
  • Strong problem-solving skills and attention to detail.
  • Ability to thrive in a fast-paced, collaborative environment.
  • Excellent communication and interpersonal skills.
  • Ability to convey technical concepts to non-technical stakeholders effectively.

Whilst we are keen to hear from candidates with proven infrastructure project experience or experience working for a Tier 1 or Tier 2 Contractor to be a part of an iconic construction project in Melbourne, Victoria, we also will consider applicants who are seeking to enter or re-enter the industry.

SPARK is committed to equal employment opportunity (EEO) and actively seeks to remove barriers people may face in gaining a successful position on the North East Link Central Package. We value diversity, inclusion and equity through providing a working environment where all employees feel included, valued, and free to bring their different skills, experiences and perspectives.

#J-18808-Ljbffr

  • Senior Azure Data Engineer

    vor 4 Wochen

    Melbourne, Österreich NTT DATA Business Solutions Vollzeit

    Press Tab to Move to Skip to Content Link Select how often (in days) to receive an alert: NTT DATA is heavily investing globally in providing state of the art analytical solutions to its clients. Our capability has been focused locally, regionally in APAC and globally by forming strategic partnerships including Microsoft Azure, SAP Analytics,...

  • Senior Azure Data Engineer

    vor 4 Wochen

    Melbourne, Österreich NTT DATA Business Solutions Vollzeit

    Press Tab to Move to Skip to Content Link Select how often (in days) to receive an alert: NTT DATA is heavily investing globally in providing state of the art analytical solutions to its clients. Our capability has been focused locally, regionally in APAC and globally by forming strategic partnerships including Microsoft Azure, SAP Analytics,...

  • Genai Data Solution Engineer

    vor 2 Wochen

    Melbourne, Österreich DATA MART Consulting GmbH Vollzeit

    3-month initial daily rate GenAI Solution Engineer contract role for a global Consulting client. Genuine chance of extension and future work. 3-month initial daily rate GenAI Solution Engineer contract role for a global Consulting client. Genuine chance of extension and future work.About the Company The client is a global Consultancy working on banking GenAI...

  • Senior Data Engineer

    vor 2 Monaten

    Melbourne, Österreich Allura Partners Vollzeit

    Large ASX Listed Group are looking for a Senior Data Engineer to join on a long term 12 months rolling contract. 10th May, 2024 Senior Data Engineer / Databricks / Azure / Python / 6 - 12 Months contract / Remote / $1000 a day Large ASX Listed Group are looking for a Senior Data Engineer to join on a long term 6- 12 months rolling contract.You will be...

  • Senior Data Engineer

    vor 4 Wochen

    Melbourne, Österreich Allura Partners Vollzeit

    Large ASX Listed Group are looking for a Senior Data Engineer to join on a long term 12 months rolling contract. 10th May, 2024 Senior Data Engineer / Databricks / Azure / Python / 6 - 12 Months contract / Remote / $1000 a day Large ASX Listed Group are looking for a Senior Data Engineer to join on a long term 6- 12 months rolling contract.You will be...

  • Senior Data Engineer

    vor 2 Monaten

    Melbourne, Österreich ClearCompany Vollzeit

    Large ASX Listed Group are looking for a Senior Data Engineer to join on a long term 12 months rolling contract.Senior Data Engineer / Databricks / Azure / Python / 6 - 12 Months contract / Remote / $1000 a day Large ASX Listed Group are looking for a Senior Data Engineer to join on a long term 6- 12 months rolling contract. You will be joining the Data team...

  • Senior Data Engineer

    vor 4 Wochen

    Melbourne, Österreich ClearCompany Vollzeit

    Large ASX Listed Group are looking for a Senior Data Engineer to join on a long term 12 months rolling contract.Senior Data Engineer / Databricks / Azure / Python / 6 - 12 Months contract / Remote / $1000 a day Large ASX Listed Group are looking for a Senior Data Engineer to join on a long term 6- 12 months rolling contract. You will be joining the Data team...

  • Senior Data Analyst

    vor 2 Wochen

    Melbourne, Österreich DATA MART Consulting GmbH Vollzeit

    Press Tab to Move to Skip to Content Link Select how often (in days) to receive an alert: Established in 1840, we’re Australia’s first member-owned wellbeing company, delivering health, wealth and care services to more than 700,000 Australians. Today, while we’ve grown to a company of more than 7000 employees, our focus remains the same...

  • Microsoft Azure Data Engineer

    vor 2 Monaten

    Melbourne, Österreich One51 | Data & Analytics Consultancy Vollzeit

    We are looking for a Microsoft Azure Data Engineer who will be responsible for developing and maintaining the data architecture, data models and standards for various Data Integration & Data Warehouse projects in Azure. Ensure new features and subject areas are modelled to integrate with existing structures and provide a consistent view. In addition,...

  • Microsoft Azure Data Engineer

    vor 4 Wochen

    Melbourne, Österreich One51 | Data & Analytics Consultancy Vollzeit

    We are looking for a Microsoft Azure Data Engineer who will be responsible for developing and maintaining the data architecture, data models and standards for various Data Integration & Data Warehouse projects in Azure. Ensure new features and subject areas are modelled to integrate with existing structures and provide a consistent view. In addition,...

  • Senior Software Engineer

    Vor 2 Tagen

    Melbourne, Österreich Goodhue Senior Living Vollzeit

    Senior Software Engineer - Network Metadata ModellingMicrosoft Corporation- Melbourne, VICITSource:uWorkinJOB DESCRIPTIONDo you love to work on the latest technologies? Do you want to work at the forefront of Cloud Computing to design, grow and evolve the Azure Network stack, supporting customers from the smallest server-less app to the largest AI...

  • Senior Data Engineer

    vor 1 Monat

    Melbourne, Österreich Marmalade Australia Pty Vollzeit

    Over the past three years, Marmalade has been hard at work changing business for the better. We’ve grown from an idea to processing hundreds of millions of dollars of payments for a wide network of partners. We’re not stopping there.We’ve got big plans to change what invoice payments are and can be. A movement bringing trust back to the financial...

  • Senior Data Engineer

    vor 4 Wochen

    Melbourne, Österreich Marmalade Australia Pty Vollzeit

    Over the past three years, Marmalade has been hard at work changing business for the better. We’ve grown from an idea to processing hundreds of millions of dollars of payments for a wide network of partners. We’re not stopping there.We’ve got big plans to change what invoice payments are and can be. A movement bringing trust back to the financial...

  • Senior Software Engineer

    vor 1 Woche

    Melbourne, Österreich Goodhue Senior Living Vollzeit

    Senior Software Engineer - Network Metadata Modelling Microsoft Corporation - Melbourne, VICIT Source: uWorkin JOB DESCRIPTION Do you love to work on the latest technologies? Do you want to work at the forefront of Cloud Computing to design, grow and evolve the Azure Network stack, supporting customers from the smallest server-less app to the largest AI...

  • Senior Data Engineer

    vor 1 Monat

    Melbourne, Österreich Roman Health Pharmacy LLC Vollzeit

    Xero is a beautiful, easy-to-use platform that helps small businesses and their accounting and bookkeeping advisors grow and thrive.At Xero, our purpose is to make life better for people in small business, their advisors, and communities around the world. This purpose sits at the centre of everything we do. We support our people to do the best work of their...

  • Senior Data Engineer

    vor 4 Wochen

    Melbourne, Österreich Roman Health Pharmacy LLC Vollzeit

    Xero is a beautiful, easy-to-use platform that helps small businesses and their accounting and bookkeeping advisors grow and thrive.At Xero, our purpose is to make life better for people in small business, their advisors, and communities around the world. This purpose sits at the centre of everything we do. We support our people to do the best work of their...

  • Senior Azure Data Engineer

    vor 4 Stunden

    Melbourne, Österreich ISTITUTO MARANGONI Vollzeit

    NTT DATA is heavily investing globally in providing state of the art analytical solutions to its clients. Our capability has been focused locally, regionally in APAC and globally by forming strategic partnerships including Microsoft Azure, SAP Analytics, Snowflake, Matillion and many more, leveraging the strength of our cloud and network assets via the NTT...

  • Senior Data Marketing Strategist

    vor 2 Wochen

    Melbourne, Österreich DATA MART Consulting GmbH Vollzeit

    Strategists at AKQA make our clients' business their business. Driven by an innate curiosity and a passion for problem solving and learning, they harness their cutting-edge knowledge of brands, technology, culture and societal trends to provide unique outlooks and solutions for our clients.As a Senior Experience Strategist, you're responsible for leading a...

  • Senior Software Engineer

    vor 2 Monaten

    Melbourne, Österreich Demyst Data Limited Vollzeit

    Our SolutionDemyst is a data management company specialising in external data orchestration, helping leading global financial institutions support their business users with data access at scale within their centralized data platforms. In response to growing demand, we’re seeking new team members to help us scale. By joining our team, you will play a...

  • Senior Data Center Engineer

    vor 20 Stunden

    Melbourne, Österreich Apothekeplus Vollzeit

    THE LESTER PARTNERSHIP PTY LIMITED - Melbourne, VICIT Source: uWorkin JOB DESCRIPTION Location: Melbourne, VICJob Type: Full-TimeSalary: Competitive Salary Based on Market StandardsReports to: Data Center ManagerOur client is seeking a highly experienced Senior Data Center Engineer to join our dynamic team.The ideal candidate will possess a deep knowledge...