AWS Data Engineer

vor 4 Wochen

Council of the City of Sydney, Österreich Recmatrix Consulting Vollzeit

Direct message the job poster from Recmatrix Consulting Director/Recruitment Specialist @ Recmatrix | IT & Non-IT Hiring | Ex-HCL Job Title: AWS Data Engineer Role: Contract Location: Sydney, Australia Experience: 6-10 years About the Position: The Data Engineer will play a crucial role in designing, developing, and executing data processing and migration strategies. This role involves utilizing various big data technologies and AWS services to support a smooth transition from on-premise Hadoop to a cloud-based environment. Responsibilities include managing data migration, optimization, and integration tasks to deliver robust and scalable data solutions. Key Tasks: Create and Execute Data Migration Strategies: Transition data from on-premise Hadoop to AWS. Develop and Optimize Spark Jobs: For data processing on AWS EMR. Manage S3 Storage Solutions: Oversee data lake architecture and maintenance. Configure and Oversee AWS Glue: For ETL processes and data cataloging. Ensure Data Quality and Integrity: Maintain high standards throughout the migration. Work with Stakeholders: Gather and document data requirements. Handle Data Mapping and Transformation: As part of the migration strategy. Implement AWS Lake Formation: Manage data governance and security. Resolve Data Migration Issues: Troubleshoot and address performance bottlenecks. Monitor and Enhance Data Workflows: Optimize for performance and cost efficiency. Document Data Processes and Architecture: Develop and maintain detailed documentation. Essential Skills and Experience: Bachelor’s or Master’s Degree: In Engineering, Computer Science, or a related discipline. Experience: 6-10 years working with technologies such as Spark, Oracle 11g, Hive, HDFS, Hadoop, and AWS services. 4-6 years of experience specifically with data migration and big data technologies. Proficient in Apache Spark and AWS EMR. Extensive experience with AWS services: Including S3, Glue, and Lake Formation. Skilled in HDFS, Hive, and data migration strategies. Strong grasp of data processing and optimization techniques. Familiarity with building reusable ETL frameworks/ETL development experience using Spark and Scala. Prior experience in migrating ETL jobs to AWS environments. Comprehensive understanding of the ETL lifecycle, including running, debugging, testing, reconciling, and deploying jobs in an AWS environment. Seniority level Associate Employment type Contract Job function Information Technology Industries IT Services and IT Consulting and Software Development #J-18808-Ljbffr

  • Data Engineer – AWS Data Center Analytics

    vor 2 Wochen

    Council of the City of Sydney, Österreich Amazon Web Services (AWS) Vollzeit

    A leading cloud computing provider is seeking a Data Engineer to facilitate data-driven decision-making within their Data Center Infrastructure Operations. You will build ETLs for data ingestion and reporting, as well as develop decision support metrics. The ideal candidate has 4+ years of data engineering experience and familiarity with AWS technologies....

  • AWS Data Engineer

    vor 2 Wochen

    Council of the City of Sydney, Österreich Kaizen Global Technologies Vollzeit

    Australia Talent Hunt | Talent Acquisition Lead - Cyber Security | NSE 1, NSE 2, NSE 3 Certified Employment: Permanent Role Experience: 7+ years Location: Sydney, Australia - Hybrid Eligibility: Candidates must have the right to work in Australia (Citizen, PR, Valid Visa holders). Contact: Required Skills & Experience Proven experience as a Data Engineer or...

  • Aws Data Engineer

    Vor 2 Tagen

    Council of the City of Sydney, Österreich Kaizen Global Technologies Vollzeit

    Australia Talent Hunt | Talent Acquisition Lead - Cyber Security | NSE 1, NSE 2, NSE 3 Certified Employment : Permanent Role Experience : 7+ years Location : Sydney, Australia - Hybrid Eligibility : Candidates must have the right to work in Australia (Citizen, PR, Valid Visa holders). Contact : Required Skills & Experience Proven experience as a Data...

  • Data Engineer

    vor 2 Wochen

    Council of the City of Sydney, Österreich Amazon Web Services (AWS) Vollzeit

    Data Engineer – AWS Data Center Infrastructure Operations As a Data Engineer, you will enable data‑driven decision making within the Amazon Web Services (AWS) Data Center Infrastructure Operations organization. The Infrastructure Operations Team is responsible for planning, implementing, monitoring and continuously improving the global Amazon Data Center...

  • Data Engineer

    vor 2 Wochen

    Council of the City of Sydney, Österreich Amazon Web Services (AWS) Vollzeit

    Join to apply for the Data Engineer role at Amazon Web Services (AWS) . Job Overview As a Data Engineer you will enable data-driven decision making within the Amazon Web Services (AWS) Data Center Infrastructure Operations organization. Infrastructure Operations The Infrastructure Operations Team is responsible for planning, implementing, monitoring and...

  • Senior AWS Data Engineer

    Vor 2 Tagen

    Council of the City of Sydney, Österreich M&T Resources Vollzeit

    Senior AWS Data Engineer – M&T Resources Are you ready to architect the future of data in a high-performance, mission‑critical environment? Come and join this established enterprise data team and lead the design and development of scalable, secure data solutions on AWS. In this hands‑on role you’ll architect and optimise data pipelines, mentor...

  • AWS Data Engineer

    Vor 6 Tagen

    Council of the City of Sydney, Österreich Paxus - Technology + Digital Talent Vollzeit

    We are seeking an experienced Senior Data Engineer to join our team and help drive data solutions on AWS Cloud. The ideal candidate will have strong experience in cloud-based data platforms, data engineering, and analytics, with a passion for building scalable, high-performance data systems. Key Responsibilities Design, develop, and maintain data pipelines,...

  • Data Engineer

    Vor 6 Tagen

    Council of the City of Sydney, Österreich Amazon Web Services (Aws) Vollzeit

    Join to apply for the Data Engineer role at Amazon Web Services (AWS). Job Overview As a Data Engineer you will enable data-driven decision making within the Amazon Web Services (AWS) Data Center Infrastructure Operations organization. Infrastructure Operations The Infrastructure Operations Team is responsible for planning, implementing, monitoring and...

  • AWS Data Engineer

    Vor 6 Tagen

    Council of the City of Sydney, Österreich Ambition Group Vollzeit

    Location: Sydney (Hybrid) Type: Contract (6 months with potential extension) We are seeking an experienced Senior Data Engineer to design, develop, and optimise data pipelines and cloud-based platform components within a modern data ecosystem. This position blends hands‑on technical delivery with leadership across data projects, enabling scalable and...

  • AWS Data Engineer

    Vor 4 Tagen

    Council of the City of Sydney, Österreich Paxus Vollzeit

    Recruitment Consultant at Paxus | Specializing in Financial & Professional Services We are seeking an experienced Senior Data Engineer to join our team and help drive data solutions on AWS Cloud. The ideal candidate will have strong experience in cloud-based data platforms, data engineering, and analytics, with a passion for building scalable,...