Cloudera Hadoop Administrator

vor 1 Monat

Sydney, Österreich Paxus - Technology + Digital Talent Vollzeit

About the Role
We are seeking a skilled Cloudera Hadoop Administrator to join our dynamic team and take ownership of maintaining and optimizing our big data infrastructure.
The ideal candidate will have hands-on experience with Hadoop administration, a strong understanding of AWS DevOps, and the ability to troubleshoot and debug logs in tools like Impala, Hive, and Spark.
Key ResponsibilitiesAdminister and manage Cloudera Hadoop clusters to ensure high availability, scalability, and performance.Monitor and troubleshoot Impala, Hive, and Spark processes by reviewing logs to identify and resolve issues, with a primary focus on Impala and secondary on Hive.Collaborate with cross-functional teams to implement AWS DevOps solutions, including monitoring, automation, and infrastructure optimization.Assist in transitioning and cross-skilling between Impala and Hive, enabling effective troubleshooting across platforms.Utilize basic shell scripting skills to read, debug, and understand scripts for automating repetitive tasks or resolving technical issues.Ensure compliance with security policies and procedures, implementing cluster security and access controls.Support data pipeline operations and provide expertise to development teams where necessary.Skills and QualificationsMandatory: Proven experience in Cloudera Hadoop administration with a focus on cluster setup, monitoring, and optimization.Proficiency in Impala (primary focus), with secondary experience in Hive and working knowledge of Spark (non-development, primarily log troubleshooting).Solid experience with AWS DevOps tools and services (e.g., CloudFormation, Lambda, EC2, S3, and IAM).
Candidates with Azure experience will be considered if part of a squad with complementary AWS expertise.Basic shell scripting skills, with the ability to read, understand, and debug scripts effectively.Exposure to Bitbucket.How to ApplyIf you're passionate about managing complex data environments and have the skills we're looking for, we'd love to hear from you.
Apply today with your CV outlining your suitability for the role.
To be considered for the role click the 'apply' button or for more information about this and other opportunities please contact David Ruiz on or email: and quote the above job reference number.
Paxus values diversity and welcomes applications from Indigenous Australians, people from diverse cultural and linguistic backgrounds and people living with a disability.
If you require an adjustment to the recruitment process, including the application form in an alternate format, please contact me on the above contact details.
#J-18808-Ljbffr

  • Cloudera Hadoop Administrator

    Vor 7 Tagen

    Sydney, Österreich Kirra Services Vollzeit

    Responsibilities:Audit & Compliance requirementDe-commissionBAU release managementSupport Hive Meta StorePlatform monitoringPlatform maintenanceInfrastructure managementPassword rotationsMandatory Requirements:Cloudera Hadoop administration or Hortonworks. Preference for Cloudera over Hortonworks.Impala, Hive and Spark – non-development, but would need to...

  • Kirra Services | Cloudera Hadoop Administrator

    Vor 5 Tagen

    Sydney, Österreich Tideri Jobbörse Vollzeit

    Responsibilities: Audit & Compliance requirement De-commission BAU release management Support Hive Meta Store Platform monitoring Platform maintenance Infrastructure management Password rotations Mandatory Requirements: Cloudera Hadoop administration or Hortonworks.Preference for Cloudera over Hortonworks.Impala, Hive and Spark – non-development, but would...

  • Hadoop Developer

    Vor 7 Tagen

    Sydney, Österreich Pyramid Global Technologies Vollzeit

    Job Description for Hadoop Developer in Sydney. Responsibilities: Implementation experience in Bigdata Platform; preferably in Cloudera Hadoop platform.Minimum 2 years of Development experience using Hadoop ecosystem tools & utilities: MapReduce, PySpark, Kafka, Sqoop, Impala, Hive etc.Minimum 2 years of development experience in traditional Enterprise Data...

  • Hadoop Engineer

    vor 3 Monaten

    Sydney, Österreich Zone It Solutions Vollzeit

    We are looking for a Hadoop Engineer for a role based in Sydney. You will be a part of a Global Consulting firm for one of their major projects.Technical: Implementation experience in BigData Platform; preferably in Cloudera Hadoop platform.Minimum 2 years of Development experience using Hadoop ecosystem tools & utilities: MapReduce, PySpark, Kafka, Sqoop,...

  • Senior Data Engineer

    vor 4 Wochen

    Sydney, Österreich Efinancialcareers Ltd. Vollzeit

    Senior Data Engineer (ETL tools)Commonwealth Bank of Australia, Sydney, AustraliaDo work that mattersAs an experienced ETL Engineer with proven expertise in Production support and a passion for providing data-driven platform solutions, you're ahead of trends and work at the forefront of Big Data platforms.Your experience means you're able to execute...

  • Senior Data Engineer

    vor 4 Wochen

    Sydney, Österreich Efinancialcareers Ltd. Vollzeit

    Senior Data Engineer (ETL tools)Commonwealth Bank of Australia, Sydney, AustraliaDo work that matters As an experienced ETL Engineer with proven expertise in Production support and a passion for providing data-driven platform solutions, you're ahead of trends and work at the forefront of Big Data platforms.Your experience means you're able to execute...

  • Efinancialcareers Ltd. | Senior Data Engineer

    vor 4 Wochen

    Sydney, Österreich Tideri Jobbörse Vollzeit

    Senior Data Engineer (ETL tools) Commonwealth Bank of Australia, Sydney, AustraliaDo work that matters As an experienced ETL Engineer with proven expertise in Production support and a passion for providing data-driven platform solutions, you're ahead of trends and work at the forefront of Big Data platforms.Your experience means you're able to execute...

  • Data Business Analyst

    vor 2 Monaten

    Sydney, Österreich Virtusa Corporation Vollzeit

    DescriptionGood communicator with passion for best practices and industry standards around SDLC, DDLC, Agile, and DevOps.Expertise in creating knowledge management artifacts like process flows, operating guides, playbooks, and other learning materials for a practice.Previous experience in data analyst, BA, or designer roles in large banks or...

  • Data Engineer

    vor 2 Wochen

    Sydney, Österreich Skybeam Technology Vollzeit

    About the company: Skybeam Technology is an Australia based professional services company that design and deliver tailored workforce solutions to enable businesses to experience the benefits of managing a workforce in the evolving world.Our workforce solutions specialised in recruitment, sourcing services, contract management services, outsourced payroll...

  • Infrastructure Architect

    Vor 7 Tagen

    Sydney, Österreich Iitjobs Vollzeit

    Job Title: Infrastructure Architect (GCP)Experience: 5-8 YearsRole and Responsibilities: Collaborate with lead Data Consultant on customer engagementsDefine solution architecture and detailed design for data platforms on GCPBuild solutions, i.e., perform hands-on coding for the designed solutionInteract with customer data engineering team to provide sound...

  • Infrastructure Architect

    Vor 7 Tagen

    Sydney, Österreich Iitjobs Vollzeit

    Job Title: Infrastructure Architect (GCP)Experience: 5-8 Years Role and Responsibilities: Collaborate with lead Data Consultant on customer engagementsDefine solution architecture and detailed design for data platforms on GCPBuild solutions, i.e., perform hands-on coding for the designed solutionInteract with customer data engineering team to provide sound...

  • Iitjobs | Infrastructure Architect

    Vor 5 Tagen

    Sydney, Österreich Tideri Jobbörse Vollzeit

    Job Title: Infrastructure Architect (GCP) Experience: 5-8 Years Role and Responsibilities: Collaborate with lead Data Consultant on customer engagements Define solution architecture and detailed design for data platforms on GCP Build solutions, i.e., perform hands-on coding for the designed solution Interact with customer data engineering team to provide...

  • Staff Platform Ab Initio Engineer | Sydney, Au

    vor 2 Wochen

    Sydney, Österreich Efinancialcareers Ltd. Vollzeit

    Staff Platform AB Initio EngineerCommonwealth Bank of Australia, Sydney, AustraliaDo work that matters:As Australia's leading technology bank, we process millions of transactions every day. Around 40% of all payments made by Australians go through our systems. Our scale means unparalleled opportunity to accelerate digital innovation and positively impact...

  • Efinancialcareers Ltd. | Staff Platform Ab Initio Engineer | Sydney, Au | Sydney

    vor 2 Wochen

    Sydney, Österreich Tideri Jobbörse Vollzeit

    Staff Platform AB Initio Engineer Commonwealth Bank of Australia, Sydney, Australia Do work that matters:As Australia's leading technology bank, we process millions of transactions every day.Around 40% of all payments made by Australians go through our systems.Our scale means unparalleled opportunity to accelerate digital innovation and positively impact...

  • Database Administrator | Sydney, Au

    vor 2 Monaten

    Sydney, Österreich Tideri Jobbörse Vollzeit

    Database Administrator Susquehanna International Group Sydney, AustraliaOverviewSusquehanna is seeking a Software Engineer to join our Post Trade technology team who are responsible for processing and storing all trading activity across the APAC region.This team builds applications used to reconcile Prime Broker data, produce valuations / P&L, provide...

  • Staff Data Engineer Design | Sydney, Au

    vor 4 Wochen

    Sydney, Österreich Efinancialcareers Ltd. Vollzeit

    Staff Data Engineer DesignCommonwealth Bank of Australia Sydney, AustraliaStaff Data Engineer DesignCommonwealth Bank of Australia Sydney, AustraliaYou are an experienced solution designer with strong experience in Data modelling, Big Data platforms.We are one of the critically performing Data Engineering teams in CBATogether we can lead strategic data...

  • Staff Data Engineer Design

    vor 4 Wochen

    Sydney, Österreich Commonwealth Bank Vollzeit

    Staff Engineer - Data Solution Design You are an experienced solution designer with strong experience in Data modelling and Big Data platforms.We are one of the critically performing Data Engineering teams in CBA.Together we can lead strategic data warehouse applications and largely complex operational data store!Do work that matters: As an experienced...

  • Staff Data Engineer

    vor 4 Wochen

    Sydney, Österreich Efinancialcareers Ltd. Vollzeit

    Staff Data Engineer - Accelerated Data DeliveryCommonwealth Bank of Australia Sydney, AustraliaStaff Data Engineer - Accelerated Data DeliveryYou are a passionate data engineer & keen learner with extensive multi-disciplinary background in end-to-end data & analytics delivery value chain activities and modern data engineering...

  • Staff Platform Ab Initio Engineer

    vor 2 Wochen

    Sydney, Österreich Commonwealth Bank Of Australia Vollzeit

    Engineering - Software (Information & Communication Technology)Do work that matters:As Australia's leading technology bank, we process millions of transactions every day. Around 40% of all payments made by Australians go through our systems. Our scale means unparalleled opportunity to accelerate digital innovation and positively impact customers. Supported...

  • Data Program Director

    Vor 7 Tagen

    Sydney, Österreich One Power Vollzeit

    Full timeLocation: SydneyPurpose of the role:The Principal Data Engineer will lead the Data Engineering strategy and delivery across global projects and products. You will ensure the Data Engineering function works as one team, promote excellence and technical development, and adheres to key principles and processes. You will guide and are responsible for...