Apache Spark Data Engineer

vor 1 Monat

Sydney, Österreich Itbility Vollzeit
  • Apache Spark Data Engineer
  • Sydney
  • Permanent

Job Description :

Should have created Azure solutions and enabled Azure capabilities

· Should have hands-on experience on Function Apps & Web Apps

· Should have hands-on experience on Synapse(Spark), ADLS2, Purview

· Should know one of the programming languages which is either Python or Scala

· Good to have linux scripting and powershell experience

· Should have source version control experience in bitbucket, git, Jenkins and DevSecOps

· Ability to identify existing gaps at customer location and provide apt extensible solutions across various Azure services, mainly Azure Purview, Function App and Web Services.

· Ability to interact with wider teams inclusive of Platform, Engineering, Framework and wider technical teams.

· Ability to convert given business requirements to technical specification in line to customer current architecture and initiatives.

· Designing the documents such as Software Technical Solution(STS), Detail Design Approach(DDA), Impact Analysis of the project, Detailed Technical Design( DTD), Mapping Specifications based on the Business requirements document(BRD), Interface Specifications.

· Estimating the project efforts and project planning

· Perform the Impact Analysis to the impacted and the downstream applications.

· Unit Testing of developed code, diagnosing, correcting errors and faults as per agreed guidelines and quality standards.

· Software development support for production implementation and warranty defect fixes.

· Reviewing the code to ensure the Coding and Quality standards established are achieved

· Participating in Daily scrum stand-up’s, Sprint Planning, PI Planning, Demos and retrospective Agile ceremonies.

· Technically support the team to deliver high quality deliverable to meet/exceed SLAs

· Resource on-boarding, training, Team Mentoring and Conflict resolution.

All candidates should have full working rights in Australia.

Only shortlisted candidates will be contacted for this role.

To apply, please submit your resume ASAP for immediate consideration or email supriya.thorat@itbility.com.au

#J-18808-Ljbffr

  • Data Engineer

    vor 2 Wochen

    Sydney, Österreich ClearCompany Vollzeit

    Data Engineer Sydney $175,000 Inc Super + Bonus As a Data Engineer within our dynamic Engineering team, you will play a crucial role in developing cutting-edge applications to support our Data Transformation initiatives. This is a permanent position offering the opportunity to work on innovative projects within a supportive team environment. Key...

  • Data Engineer

    vor 2 Monaten

    Sydney, Österreich Practiv Limited Vollzeit

    As a Practiv Data Engineer you will join a team of passionate data-cloud technologists who help deliver end to end data engineering solutions for our customers from building data pipelines, warehousing the data and visualisation/presentation. Practiv Data Engineers understand both data pipeline development, operations and management as well as delivery of...

  • Data Engineer

    vor 4 Wochen

    Sydney, Österreich Practiv Limited Vollzeit

    As a Practiv Data Engineer you will join a team of passionate data-cloud technologists who help deliver end to end data engineering solutions for our customers from building data pipelines, warehousing the data and visualisation/presentation. Practiv Data Engineers understand both data pipeline development, operations and management as well as delivery of...

  • Data Engineer

    vor 4 Wochen

    Sydney, Österreich Atlassian Vollzeit

    We are looking for a Data Engineer to join our UIP - Frontend Observability team.The Frontend Observability team is part of the UI Platform organisation.Our team's mission is to help teams build fast experiences and make sure they stay fast. We build tools for measuring, monitoring and catching regressions in frontend performance.UI Platform delivers...

  • Data Engineer

    vor 2 Monaten

    Sydney, Österreich Lendaly Pty Vollzeit

    Improve upon existing systems that collect, manage and convert data for our teams to interpret in a meaningful way. Experience with building AI/ML models and rule-based engines required.ResponsibilitiesDesign, build, and maintain scalable data pipelines to collect, process, and store large volumes of structured and unstructured data from various...

  • Data Engineer

    vor 4 Wochen

    Sydney, Österreich Lendaly Pty Vollzeit

    Improve upon existing systems that collect, manage and convert data for our teams to interpret in a meaningful way. Experience with building AI/ML models and rule-based engines required.ResponsibilitiesDesign, build, and maintain scalable data pipelines to collect, process, and store large volumes of structured and unstructured data from various...

  • Python Engineer

    vor 2 Wochen

    Sydney, Österreich ClearCompany Vollzeit

    Python Engineer Sydney $175,000 Inc Super + Bonus As a Data Engineer within our dynamic Engineering team, you will play a crucial role in developing cutting-edge applications to support our Data Transformation initiatives. This is a permanent position offering the opportunity to work on innovative projects within a supportive team environment. Key...

  • Senior Data Engineer

    vor 2 Monaten

    Sydney, Österreich https:www.bebee.comjoin Vollzeit

    Senior Data Engineer - CREQ183850 Description ETL Dev and Testing Teradata Scala Python SQL Selenium Test automation Datawarehousing / BI experience Spark Hadoop / Big Data / HDFS Cloud migration experience AWS Cloud experience Primary Location Sydney, New South Wales, Australia Job Type Experienced Primary Skills Snowflake Years of...

  • Senior Data Engineer

    vor 4 Wochen

    Sydney, Österreich https:www.bebee.comjoin Vollzeit

    Senior Data Engineer - CREQ183850 Description ETL Dev and Testing Teradata Scala Python SQL Selenium Test automation Datawarehousing / BI experience Spark Hadoop / Big Data / HDFS Cloud migration experience AWS Cloud experience Primary Location Sydney, New South Wales, Australia Job Type Experienced Primary Skills Snowflake Years of...

  • Data Engineer, Sydney

    vor 1 Monat

    Sydney, Österreich GrainCorp Vollzeit

    Press Tab to Move to Skip to Content Link Select how often (in days) to receive an alert: Create Alert Select how often (in days) to receive an alert: About GrainCorpWhat did you have for breakfast today? Whether it’s the flour in your toast or the grain in your cereal, it’s highly likely that GrainCorp helped get it onto your plate! As...

  • Data Engineer, Sydney

    vor 4 Wochen

    Sydney, Österreich GrainCorp Vollzeit

    Press Tab to Move to Skip to Content Link Select how often (in days) to receive an alert: Create Alert Select how often (in days) to receive an alert: About GrainCorpWhat did you have for breakfast today? Whether it’s the flour in your toast or the grain in your cereal, it’s highly likely that GrainCorp helped get it onto your plate! As...

  • Senior Data Engineer

    vor 2 Wochen

    Sydney, Österreich Talenza Pty Limited. Vollzeit

    Role overview: You will be joining one of Australia's largest financial institutions, within the fastest paced financial markets area of the business. Working as part of a new team of highly skilled engineers, you will be working on building a new regulatory audit response capability, building controls around validating rates in trading. As a Senior Data...

  • Principal, Data

    vor 2 Monaten

    Sydney, Österreich Practiv Limited Vollzeit

    As a Principal of our Data & Analytics practice, you will join a team of passionate data-cloud technologists who help deliver end to end data engineering solutions for our customers from building data pipelines, warehousing the data and visualisation/presentation.Practiv Data Engineers understand both data pipeline development, operations and management as...

  • Principal, Data

    vor 4 Wochen

    Sydney, Österreich Practiv Limited Vollzeit

    As a Principal of our Data & Analytics practice, you will join a team of passionate data-cloud technologists who help deliver end to end data engineering solutions for our customers from building data pipelines, warehousing the data and visualisation/presentation.Practiv Data Engineers understand both data pipeline development, operations and management as...

  • Principal Data Engineer

    Vor 5 Tagen

    Sydney, Österreich Culture Amp Vollzeit

    How you can help make a better world of workCulture Amp is on a mission to embed analytics and insights across our product suite. We have recently acquired the people analytics platform Orgnostic, and are looking to build out our data platform to further unlock the value of our data. To help us deliver on this mission, we are seeking a Principal Data...

  • Scala Architect

    vor 2 Wochen

    Sydney, Österreich Rackspace Vollzeit

    Scala Architect- Sydney Description:We are seeking an innovative Scala Architect with a strong background in designing and building robust data engineering frameworks using Apache Spark. The ideal candidate will lead our efforts in architecting a scalable data processing platform, driving the strategic direction of our data infrastructure to support the...

  • Scala Architect- Melbourne

    vor 2 Wochen

    Sydney, Österreich Rackspace Vollzeit

    Scala Architect- Melbourne Description:We are seeking an innovative Scala Architect with a strong background in designing and building robust data engineering frameworks using Apache Spark. The ideal candidate will lead our efforts in architecting a scalable data processing platform, driving the strategic direction of our data infrastructure to support the...

  • Data Engineer, Sydney

    vor 1 Woche

    Council of the City of Sydney, Österreich GrainCorp Vollzeit

    Press Tab to Move to Skip to Content Link Select how often (in days) to receive an alert: Create Alert About GrainCorpWhat did you have for breakfast today? Whether it’s the flour in your toast or the grain in your cereal, it’s highly likely that GrainCorp helped get it onto your plate! As we find new ways to connect rural communities with...

  • Data Operations Engineer

    vor 4 Wochen

    Sydney, Österreich Seven West Media Vollzeit

    Data Operations Engineer Apply now Job no: 979042 Work type: Full-time Location: Sydney Data Operations Engineer - Sydney - Fixed Term Contract The Opportunity We're searching for a Data Operations Engineer to join our mighty Data Operations Team. You'll be working on Seven's Advertising and Audience data, supporting, administrating and configuring the tech...

  • Data Operations Engineer

    vor 4 Wochen

    Sydney, Österreich Seven West Media Vollzeit

    Data Operations Engineer Apply now Job no: 979042 Work type: Full-time Location: Sydney Data Operations Engineer - Sydney - Fixed Term Contract The Opportunity We're searching for a Data Operations Engineer to join our mighty Data Operations Team. You'll be working on Seven's Advertising and Audience data, supporting, administrating and configuring the tech...