Azure Data Engineer

vor 4 Wochen

Melbourne, Österreich Experis ManpowerGroup Sp. z o.o. Vollzeit

Experis have the pleasure to announce a partnership with a global consultancy in their search for an experienced Data Engineer. This consultancy focuses on accelerating their customers migration to cloud and aims to digitalize and automate their operations. You will have the opportunity to work within a dynamic team focused on developing large-scale data warehouse solutions in Azure platforms. On offer is a contract role with a competitive daily rate, located in Eastern Melbourne.

As a Data Engineer you will be responsible for designing and developing scalable data pipelines using Azure Services such as Azure Data Factory, Azure Synapse Analytics and Databricks. Additionally, you will have the opportunity to collaborate with data scientists and analysts to deploy machine learning models and enable advanced analytics capabilities using DataBricks.

Your other responsibilities will also include;

  • Implement data ingestion processes from various sources including structured and unstructured data, APIs, and streaming data sources.
  • Optimize data processing and transformation workflows for performance and efficiency.
  • Ensure data quality and integrity through data validation, cleansing, and enrichment processes.
  • Implement and enforce data governance policies and security controls to protect sensitive data assets.
  • Monitor and troubleshoot data pipelines to identify and resolve issues in a timely manner.

To be successful in this position you will require the below skills;

  • Proficiency in programming languages such as Python (Pyspark) and Spark SQL for data processing and manipulation.
  • Experience with data modelling, schema design, Databricks Delta Lake and Delta Live Tables, and optimization techniques.
  • Familiarity with DevOps practices and tools for CI/CD pipeline automation is a plus.
  • Excellent problem-solving skills and ability to work effectively in a dynamic environment with tight deadlines.
  • Strong experience with Azure Data Factory, Azure Synapse Analytics (formerly SQL Data Warehouse), and Databricks.

If you're interested in applying for this role or would like to find out more information please contact Marcin Seder at or click the apply button below.

Marcin Seder
Senior Consultant
marcin.seder@au.experis.com

ManpowerGroup is committed to being a Diversity Confident Recruiter and encourages applications from people from a diverse range of backgrounds, including people with a disability. Please indicate your preferred method of communication in your resume and please let us know if you require any reasonable adjustments should you be contacted for an interview.

Aboriginal and Torres Strait Islander people are encouraged to apply.

By submitting your resume and other personal information with this application you are consenting to this information being collected in line with our privacy policy. Follow the link to learn more - www.manpowergroup.com.au/privacy-policy

Experis Pty Ltd is a wholly owned subsidiary of ManpowerGroup

State: QLD, licensee/s Manpower Services (Australia) Pty Ltd, LHL-02026-D5L4Q. State: QLD, licensee/s Experis Pty Ltd, LHL-02014-Y5F6D. State: SA, licensee/s Manpower Services (Australia) Pty Ltd, LHS 288856

#J-18808-Ljbffr

  • Microsoft Azure Data Engineer

    vor 2 Monaten

    Melbourne, Österreich One51 | Data & Analytics Consultancy Vollzeit

    We are looking for a Microsoft Azure Data Engineer who will be responsible for developing and maintaining the data architecture, data models and standards for various Data Integration & Data Warehouse projects in Azure. Ensure new features and subject areas are modelled to integrate with existing structures and provide a consistent view. In addition,...

  • Microsoft Azure Data Engineer

    vor 4 Wochen

    Melbourne, Österreich One51 | Data & Analytics Consultancy Vollzeit

    We are looking for a Microsoft Azure Data Engineer who will be responsible for developing and maintaining the data architecture, data models and standards for various Data Integration & Data Warehouse projects in Azure. Ensure new features and subject areas are modelled to integrate with existing structures and provide a consistent view. In addition,...

  • Senior Azure Data Engineer

    vor 4 Wochen

    Melbourne, Österreich NTT DATA Business Solutions Vollzeit

    Press Tab to Move to Skip to Content Link Select how often (in days) to receive an alert: NTT DATA is heavily investing globally in providing state of the art analytical solutions to its clients. Our capability has been focused locally, regionally in APAC and globally by forming strategic partnerships including Microsoft Azure, SAP Analytics,...

  • Senior Azure Data Engineer

    vor 4 Wochen

    Melbourne, Österreich NTT DATA Business Solutions Vollzeit

    Press Tab to Move to Skip to Content Link Select how often (in days) to receive an alert: NTT DATA is heavily investing globally in providing state of the art analytical solutions to its clients. Our capability has been focused locally, regionally in APAC and globally by forming strategic partnerships including Microsoft Azure, SAP Analytics,...

  • Senior Azure Data Engineer

    vor 3 Stunden

    Melbourne, Österreich ISTITUTO MARANGONI Vollzeit

    NTT DATA is heavily investing globally in providing state of the art analytical solutions to its clients. Our capability has been focused locally, regionally in APAC and globally by forming strategic partnerships including Microsoft Azure, SAP Analytics, Snowflake, Matillion and many more, leveraging the strength of our cloud and network assets via the NTT...

  • Senior Data Engineer

    vor 2 Monaten

    Melbourne, Österreich Allura Partners Vollzeit

    Large ASX Listed Group are looking for a Senior Data Engineer to join on a long term 12 months rolling contract. 10th May, 2024 Senior Data Engineer / Databricks / Azure / Python / 6 - 12 Months contract / Remote / $1000 a day Large ASX Listed Group are looking for a Senior Data Engineer to join on a long term 6- 12 months rolling contract.You will be...

  • Senior Data Engineer

    vor 4 Wochen

    Melbourne, Österreich Allura Partners Vollzeit

    Large ASX Listed Group are looking for a Senior Data Engineer to join on a long term 12 months rolling contract. 10th May, 2024 Senior Data Engineer / Databricks / Azure / Python / 6 - 12 Months contract / Remote / $1000 a day Large ASX Listed Group are looking for a Senior Data Engineer to join on a long term 6- 12 months rolling contract.You will be...

  • Senior Data Engineer

    vor 2 Monaten

    Melbourne, Österreich ClearCompany Vollzeit

    Large ASX Listed Group are looking for a Senior Data Engineer to join on a long term 12 months rolling contract.Senior Data Engineer / Databricks / Azure / Python / 6 - 12 Months contract / Remote / $1000 a day Large ASX Listed Group are looking for a Senior Data Engineer to join on a long term 6- 12 months rolling contract. You will be joining the Data team...

  • Senior Data Engineer

    vor 4 Wochen

    Melbourne, Österreich ClearCompany Vollzeit

    Large ASX Listed Group are looking for a Senior Data Engineer to join on a long term 12 months rolling contract.Senior Data Engineer / Databricks / Azure / Python / 6 - 12 Months contract / Remote / $1000 a day Large ASX Listed Group are looking for a Senior Data Engineer to join on a long term 6- 12 months rolling contract. You will be joining the Data team...

  • Azure Cloud Engineer

    vor 3 Wochen

    Melbourne, Österreich InfoCentric Vollzeit

    InfoCentric is growing, and with this growth, many exciting programs are starting that require data architecture and data modelling expertise. In this role, you will work closely with our Head of Architecture in designing and implementing cloud platforms for high-profile Australian brands across various industries. Your involvement will help organisations...

  • Lead Data Engineer

    vor 2 Monaten

    Melbourne, Österreich Itbility Vollzeit

    Lead Data EngineerMelbourneContract - 6 + MonthsMandatory:• Strong hands-on experience in development API /Azure functions and python.• Hands-on experience in working with Jason as input and reading using python notebooks• Hands-on experience in development of pipelines using Azure data factory / Synapse on Microsoft Azure• Hands-on Experience SQL...

  • Lead Data Engineer

    vor 4 Wochen

    Melbourne, Österreich Itbility Vollzeit

    Lead Data EngineerMelbourneContract - 6 + MonthsMandatory:• Strong hands-on experience in development API /Azure functions and python.• Hands-on experience in working with Jason as input and reading using python notebooks• Hands-on experience in development of pipelines using Azure data factory / Synapse on Microsoft Azure• Hands-on Experience SQL...

  • Data Specialist

    vor 1 Monat

    City of Melbourne, Österreich Experis ManpowerGroup Sp. z o.o. Vollzeit

    We are working a new role for a Azure Data Specialist to join our client on an exciting contract opportunity in a well known global software consultancy. We are looking for a Data Specialist with experience on core Azure Data Analytic technologies such as Synapse, Spark Pools, Azure Data Factory (ADF), adlsGen2, What you can bring: Experience in...

  • Data Specialist

    vor 4 Wochen

    City of Melbourne, Österreich Experis ManpowerGroup Sp. z o.o. Vollzeit

    We are working a new role for a Azure Data Specialist to join our client on an exciting contract opportunity in a well known global software consultancy. We are looking for a Data Specialist with experience on core Azure Data Analytic technologies such as Synapse, Spark Pools, Azure Data Factory (ADF), adlsGen2, What you can bring: Experience in...

  • Senior Data Engineer

    vor 4 Wochen

    Melbourne, Österreich Victoria's Big Build Vollzeit

    About North East Link The Spark Consortium has been selected for the Central Package of the North East Link Project - Victoria's biggest road project. The Spark Consortium’s Design and Construction Contractor - which comprises Webuild, CPB Contractors, GS Engineering and Construction and China Construction Oceania - will deliver the twin three-lane...

  • Senior Data Engineer

    vor 4 Wochen

    Melbourne, Österreich Victoria's Big Build Vollzeit

    About North East Link The Spark Consortium has been selected for the Central Package of the North East Link Project - Victoria's biggest road project. The Spark Consortium’s Design and Construction Contractor - which comprises Webuild, CPB Contractors, GS Engineering and Construction and China Construction Oceania - will deliver the twin three-lane...

  • Data Engineer

    vor 2 Monaten

    Melbourne, Österreich Hostplus Pty Vollzeit

    How will you make an impact?Are you passionate about using data to making a positive impact to our members’ dignified retirement?Hostplus seeks a Data Engineer with strong experience on the Microsoft Azure tech stack to design and drive data integration solutions that will meet the growing data needs of our organisation. Join us in shaping superior...

  • Data Engineer

    vor 4 Wochen

    Melbourne, Österreich Hostplus Pty Vollzeit

    How will you make an impact?Are you passionate about using data to making a positive impact to our members’ dignified retirement?Hostplus seeks a Data Engineer with strong experience on the Microsoft Azure tech stack to design and drive data integration solutions that will meet the growing data needs of our organisation. Join us in shaping superior...

  • Azure Databricks Consultant

    vor 3 Wochen

    Melbourne, Österreich Nuage Technology Group Vollzeit

    Consultants (Information & Communication Technology)Full timeAdd expected salary to your profile for insightsNuage has partnered with a Global Consultancy for an exciting opportunity. As an Azure Databricks Consultant, you will play a critical role in designing, implementing, and optimising our data infrastructure and analytics solutions. You will work...

  • Genai Data Solution Engineer

    vor 2 Wochen

    Melbourne, Österreich DATA MART Consulting GmbH Vollzeit

    3-month initial daily rate GenAI Solution Engineer contract role for a global Consulting client. Genuine chance of extension and future work. 3-month initial daily rate GenAI Solution Engineer contract role for a global Consulting client. Genuine chance of extension and future work.About the Company The client is a global Consultancy working on banking GenAI...