Hadoop Engineer

• Interact with business stakeholders and designers to understand business requirements.• Hadoop development and implementation.• Loading from disparate data sets.• Good to have Teradata knowledge.• Must have working experience in IntelliJ IDEA, AutoSys, WinSCP, Putty & GitHub.• Designing, building, installing, configuring, and supporting...

XPT Software Australia Pty Ltd | ContractSydney, Australia | Posted on 12/20/2024XPT Software Australia PTY Ltd, incorporated in 2016, is a Software Services company.XPT works with top clients across Australia in Banking, Insurance, Telecom, Retail, Energy, Mining and Manufacturing domains.We have 120+ technocrats in Australia working at our client...

Senior Data Engineer (ETL tools)Commonwealth Bank of Australia, Sydney, AustraliaDo work that matters As an experienced ETL Engineer with proven expertise in Production support and a passion for providing data-driven platform solutions, you're ahead of trends and work at the forefront of Big Data platforms.Your experience means you're able to execute...

We are looking for a Data Engineer for the Sydney location for a large-scale project.This is a permanent role with a global IT service leader.Key Responsibilities:Designing, building, and maintaining data architectures, including databases and processing systems.Acquiring and integrating new data sources.Optimising data pipelines, automating processes where...

About This OpportunityH2O.ai is at the forefront of the rapidly evolving MLOps landscape.We're leveraging MLOps to transform machine learning models from isolated, engineer-specific tools into robust, cloud-native services that are scalable and consistently available.Our approach is firmly rooted in Kubernetes, positioning our team at the cutting edge of...

About This OpportunityH2O.ai is at the forefront of the rapidly evolving MLOps landscape. We're leveraging MLOps to transform machine learning models from isolated, engineer-specific tools into robust, cloud-native services that are scalable and consistently available. Our approach is firmly rooted in Kubernetes, positioning our team at the cutting edge of...

Senior Data Engineer (Big Data Platforms)Commonwealth Bank of Australia, Sydney, AustraliaDo work that matters:As a Senior Data Engineer with proven expertise in software development and a passion for providing data-driven solutions, you're ahead of trends and work at the forefront of Big Data and Data warehouse technologies. Here, you'll be part of a team...

About the company: Skybeam Technology is an Australia based professional services company that design and deliver tailored workforce solutions to enable businesses to experience the benefits of managing a workforce in the evolving world.Our workforce solutions specialised in recruitment, sourcing services, contract management services, outsourced payroll...

We are seeking a Big Data Solution Engineer.This role involves designing and implementing scalable big data solutions to support our clients' analytical needs. Responsibilities and Qualifications Minimum of 5 years of experience in Big Data technologies and architectures. Proficient in Hadoop ecosystem components (HDFS, Hive, Pig, Spark, etc.)and relevant...

Trading Systems Engineer - Python, DevOps, Automation, Linux, and Low Latency SystemsWestbury Partners, Sydney, AustraliaPosted: 3 days ago | Type: Permanent | Salary: $200k - $300k+ pkg.Deploy, maintain and enhance high performance, low latency trading systems!Prototype & experiment with new tech, constant innovation/projects.High Frequency Trading (HFT)...

Staff Data Engineer DesignCommonwealth Bank of Australia Sydney, AustraliaStaff Data Engineer DesignCommonwealth Bank of Australia Sydney, AustraliaYou are an experienced solution designer with strong experience in Data modelling, Big Data platforms.We are one of the critically performing Data Engineering teams in CBATogether we can lead strategic data...

Trading Systems Engineer - Python, DevOps, Automation, Linux, and Low Latency Systems Westbury Partners, Sydney, Australia Posted: 3 days ago | Type: Permanent | Salary: $200k - $300k+ pkg.Deploy, maintain and enhance high performance, low latency trading systems!Prototype & experiment with new tech, constant innovation/projects.High Frequency Trading (HFT)...

Senior Data Engineer (Big Data Platforms) Commonwealth Bank of Australia, Sydney, AustraliaDo work that matters: As a Senior Data Engineer with proven expertise in software development and a passion for providing data-driven solutions, you're ahead of trends and work at the forefront of Big Data and Data warehouse technologies.Here, you'll be part of a team...

About This OpportunityH2O.ai is at the forefront of the rapidly evolving MLOps landscape.We're leveraging MLOps to transform machine learning models from isolated, engineer-specific tools into robust, cloud-native services that are scalable and consistently available.Our approach is firmly rooted in Kubernetes, positioning our team at the cutting edge of...

Join a leading Australian business & work within a very advanced & experienced Data & Analytics team with plenty of career & leadership growth!We have an opportunity for a Senior Data Engineer to work on a large, greenfield data project in a very well-known, stable enterprise company.You will be working closely with the business and other stakeholders as you...

Overview: One of our clients is building a new team and looking for 7 highly skilled and motivated AI Engineers globally to join their dynamic team.As an AI Engineer, you will be pivotal in designing, developing, and deploying state-of-the-art AI solutions that enhance the capabilities of our products and services, driving efficiency and innovation. Key...

The Data Engineer is responsible for building and supporting the big data platform. As a Data Engineer, your responsibilities include:Develop, test and support future-ready data solutions for customers across industry verticals.Develop, test and support end-to-end batch and near real-time data flows/pipelines.Demonstrate understanding in data architectures,...

About This OpportunityH2O.ai is at the forefront of the rapidly evolving MLOps landscape.We're leveraging MLOps to transform machine learning models from isolated, engineer-specific tools into robust, cloud-native services that are scalable and consistently available.Our approach is firmly rooted in Kubernetes, positioning our team at the cutting edge of...

The Data Engineer is responsible for building and supporting the big data platform.As a Data Engineer, your responsibilities include: Develop, test and support future-ready data solutions for customers across industry verticals.Develop, test and support end-to-end batch and near real-time data flows/pipelines.Demonstrate understanding in data architectures,...

Join our Cyber Platforms team within the Cybersecurity department and assist with providing services to the wider Technology division.At Macquarie, our advantage is bringing together diverse people and empowering them to shape all kinds of possibilities. We are a global financial services group operating in 34 markets and with 55 years of unbroken...