Hadoop Developer

vor 2 Wochen

Council of the City of Sydney, Österreich Pyramid Global Technologies Vollzeit

Overview Job Description for Hadoop Developer in Sydney. Responsibilities Implementation experience in Bigdata Platform; preferably in Cloudera Hadoop platform Minimum 2 years of Development experience using Hadoop ecosystem tools & utilities: MapReduce, PySpark, Kafka, Sqoop, Impala, Hive etc Minimum 2 years of development experience in traditional Enterprise Data Warehouse (EDW), ETL design & development using Informatica or Talend Ability to work independently and contribute to overall architecture and design Experience in writing Shell scripts in Linux Platform Knowledge of API management concepts and design Experience in CI/CD deployment automation in Bigdata Platform (Preferred) Experience on Metadata management tools like Informatica Metadata Manager or Collibra (Preferred). #J-18808-Ljbffr

  • Senior Data Engineer — AWS, Spark

    Vor 7 Tagen

    Council of the City of Sydney, Österreich Persistent Systems Vollzeit

    A leading technology company in Sydney is looking for a skilled software developer with expertise in Python and big data technologies. You will develop and maintain robust data pipelines while managing AWS services. The ideal candidate has 12 to 15 years of experience and is proficient in Spark and Hadoop. Benefits include a competitive salary, hybrid work...

  • Software Developer

    Vor 3 Tagen

    Council of the City of Sydney, Österreich Tech Mahindra Vollzeit

    Tech Mahindra is hiring a Full time Software Developer role in Macquarie Park, NSW. Apply now to be part of our team. Requirements for this role: Flexible hours available More than 4 years of relevant work experience required for this role Expected salary: $74,000 - $90,000 per year Designation / Job title : -DeveloperProgrammer Primary or Mandatory skills :...

  • Data Engineer

    Vor 7 Tagen

    Council of the City of Sydney, Österreich Persistent Systems Vollzeit

    About Position Location: Sydney, Australia Experience: 12 to 15 years Job Type: Full Time Employment Mandatory Mention skills: Python, Spark, Hadoop, AWS What You'll Do Develop and maintain Python (and Scala for Spark) code for big‑data pipelines. Design and implement solutions using Spark, Hadoop, Hive, Kafka. Manage AWS services including S3, Glue,...

  • Data Engineer

    Vor 7 Tagen

    Council of the City of Sydney, Österreich N2S.Global Vollzeit

    We are seeking a highly skilled Senior Software Engineer (SSE) / Staff Data Engineer to design, build, and optimize large-scale data solutions. The ideal candidate will have strong expertise in Python , Spark , and AWS , with a proven track record in developing robust data pipelines, enabling advanced analytics, and ensuring data governance and security. Key...

  • Senior DevOps Engineer

    vor 1 Woche

    City of Melbourne, Österreich Mane Consulting Vollzeit

    Be part of a team that’s not just improving processes but redefining the future. This is more than a role; it’s a chance to be at the forefront of a transformative initiative that will reshape the technology landscape. This is a key role in a multi-disciplinary team driving the bank’s transition from a legacy Hadoop/Cloudera platform to a modern...

  • Data Engineer

    vor 3 Wochen

    Council of the City of Sydney, Österreich N2S.Global Vollzeit

    The Data Engineer is responsible for designing, building, and maintaining scalable data pipelines and architectures to support analytics, reporting, and business intelligence. This role ensures data integrity, accessibility, and performance across multiple systems. Key Responsibilities Design, develop, and optimize ETL/ELT processes for structured and...

  • Data Engineer

    Vor 7 Tagen

    City of Melbourne, Österreich N2S.Global Vollzeit

    Senior Software Engineer (SSE) / Staff Data Engineer Melbourne, Victoria, Australia A$150,000.00 - A$160,000.00 Seniority level Mid-Senior level Employment type Contract Job function Information Technology Industries Software Development Key Responsibilities Design and implement scalable ETL pipelines for data ingestion, transformation, and integration....

  • Sr. Applied Scientist, AGI Vertical Services

    vor 1 Woche

    Council of the City of Sydney, Österreich Amazon Vollzeit

    Sr. Applied Scientist, AGI Vertical Services Amazon is looking for a passionate, talented, and inventive Scientist with a strong machine learning background to help build industry-leading Speech and Language technology. Our mission is to push the envelope in Automatic Speech Recognition (ASR), Natural Language Understanding (NLU), and Audio Signal...

  • Lead Data Engineer

    Vor 3 Tagen

    Council of the City of Sydney, Österreich Peoplebank Vollzeit

    Seeking a skilled Lead Data Engineer to join our Federal Government Client. Initial 6 Months Contract with extension Sydney based Hybrid work flexibility 2-3 days on-site / 2 days WFH 1st week of February Start We are seeking a Senior/Lead Data Engineer with strong expertise in API development and management to enable seamless and secure data exchange across...

  • Senior Data Modeler

    vor 1 Tag

    Council of the City of Sydney, Österreich CareCone Group Vollzeit

    Location: Sydney Years of Experience: 15+ Years Job Summary: We are seeking a highly skilled and experienced Senior Data Modeller to join our dynamic Data Engineering team. The ideal candidate will have over 15 years of experience in data modelling and will play a crucial role in designing and implementing data models that support our business objectives....