Data Engineer

vor 2 Wochen


Sydney, Österreich ClearCompany Vollzeit

Data Engineer

Sydney

$175,000 Inc Super + Bonus

As a Data Engineer within our dynamic Engineering team, you will play a crucial role in developing cutting-edge applications to support our Data Transformation initiatives. This is a permanent position offering the opportunity to work on innovative projects within a supportive team environment.

Key Responsibilities:

  • Utilize your expertise in data warehousing and information management to contribute to the development of our future-ready Data Platform.
  • Design and implement data models to support business requirements.
  • Leverage your Linux/Unix skills and prior experience with AWS to build robust and scalable data solutions.
  • Develop and optimize complex SQL queries and data manipulation processes.
  • Utilize Big Data querying tools such as Hive, Spark, and Presto to extract insights from large datasets.
  • Implement API-based integrations and orchestrate data pipelines using tools like Apache Oozie, Airflow, or Argo Workflows.
  • Apply your knowledge of technical solutions, design patterns, and code to develop medium/complex applications deployed in clustered computing environments.



Desired Skills and Experience:

  • Proficiency in programming languages such as Scala, Java, or Python, particularly in the context of Big Data technologies like Spark.
  • Redshift.
  • Experience working with Docker, Kubernetes, and familiarity with containerized environments.
  • Exposure to security concepts and best practices related to data engineering.
  • Knowledge of machine learning concepts and tools such as Spark ML or R.
  • Experience with major Hadoop distributions such as Cloudera, MapR, or Hortonworks HDP.
  • Familiarity with build tools like Maven, Gradle, and Ant.



If you feel you possess the relevant skills to the above, apply now with most updated CV

#J-18808-Ljbffr
  • Senior Data Engineer

    vor 4 Wochen


    Sydney, Österreich ClearCompany Vollzeit

    Senior Data Engineer Sydney, Australia 6 Months (Intially) $970pd Inc Super We are seeking a highly skilled and experienced Azure Senior Data Engineer to join a leading insurance business based in Sydney. As an Azure Senior Data Engineer, you will play a critical role in designing and building ETL processes for their data warehouse, utilizing your...

  • Senior Data Engineer

    vor 4 Wochen


    Sydney, Österreich ClearCompany Vollzeit

    Senior Data Engineer Sydney, Australia 6 Months (Intially) $970pd Inc Super We are seeking a highly skilled and experienced Azure Senior Data Engineer to join a leading insurance business based in Sydney. As an Azure Senior Data Engineer, you will play a critical role in designing and building ETL processes for their data warehouse, utilizing your...

  • Senior Data Engineer

    vor 6 Stunden


    Sydney, Österreich Preacta Recruitment Vollzeit

    Database Development & Administration (Information & Communication Technology) Full time Add expected salary to your profile for insights Senior Data Engineer Python, SQL, AWS, GCP, BigQuery$160k - $200k (package including Super) Sydney – Hybrid (3 days in office) How does joining a pillar of Australia’s economy sound? How about the...

  • Senior Data Engineer

    vor 4 Wochen


    Sydney, Österreich Talenza Vollzeit

    Other (Information & Communication Technology) We are seeking a highly skilled and experienced Azure Senior Data Engineer to join a leading insurance business based in Sydney. As an Azure Senior Data Engineer, you will play a critical role in designing and building ETL processes for their data warehouse, utilizing your expertise in Databricks and Python...

  • Senior Data Engineer

    vor 4 Wochen


    Sydney, Österreich Talenza Vollzeit

    Other (Information & Communication Technology) We are seeking a highly skilled and experienced Azure Senior Data Engineer to join a leading insurance business based in Sydney. As an Azure Senior Data Engineer, you will play a critical role in designing and building ETL processes for their data warehouse, utilizing your expertise in Databricks and Python...

  • Data Engineer

    vor 6 Stunden


    Sydney, Österreich Technology People Group Vollzeit

    Join this innovative business dedicated to empowering clients with advanced machine-learning tools to enhance their business. We're looking for a talented Data Engineer (ideally with a background in software engineering) to join the dynamic team and help scale their data systems to new heights.What You'll Do:Develop seamless integrations with various...

  • Data Engineer

    vor 1 Woche


    Sydney, Österreich Reo Group Vollzeit

    Developers/Programmers (Information & Communication Technology) Location: Sydney CBDSalary Package: $120,000 to $150,000 + Super + BonusRole Highlights: Become a pivotal member of a top-tier energy firm, driving critical data solutions that shape the future of energy trading and analytics. This role offers a unique blend of technical challenge and...

  • Junior Data Engineer.

    vor 1 Woche


    Sydney, Österreich Alloc8 Vollzeit

    Engineering - Software (Information & Communication Technology) Our client is a forward-thinking organization specializing in delivering cutting-edge data solutions in the ESG domain. They pride themselves on fostering an innovative and collaborative environment where every team member can thrive and grow. They are seeking a skilled Data Engineer with 2-4...

  • Python Data Engineer

    vor 6 Stunden


    Sydney, Österreich eFinancialCareers Ltd. Vollzeit

    We are currently partnering with a forward-thinking tech business seeking a highly skilled Data Engineer to join their data engineering team and play a pivotal role in shaping their data-driven future. This is an incredible opportunity to work alongside experienced data professionals and a highly-regarded senior data leader with a wealth of industry...

  • Data Engineer

    vor 4 Wochen


    Sydney, Österreich Atlassian Vollzeit

    We are looking for a Data Engineer to join our UIP - Frontend Observability team.The Frontend Observability team is part of the UI Platform organisation.Our team's mission is to help teams build fast experiences and make sure they stay fast. We build tools for measuring, monitoring and catching regressions in frontend performance.UI Platform delivers...

  • Data Engineer

    vor 2 Monaten


    Sydney, Österreich Practiv Limited Vollzeit

    As a Practiv Data Engineer you will join a team of passionate data-cloud technologists who help deliver end to end data engineering solutions for our customers from building data pipelines, warehousing the data and visualisation/presentation. Practiv Data Engineers understand both data pipeline development, operations and management as well as delivery of...

  • Data Engineer

    vor 4 Wochen


    Sydney, Österreich Practiv Limited Vollzeit

    As a Practiv Data Engineer you will join a team of passionate data-cloud technologists who help deliver end to end data engineering solutions for our customers from building data pipelines, warehousing the data and visualisation/presentation. Practiv Data Engineers understand both data pipeline development, operations and management as well as delivery of...

  • Data Engineer

    vor 3 Wochen


    Sydney, Österreich Kindred Group plc Vollzeit

    The role We are looking for a motivated Data Engineer to join our team and support the Data Engineering pipeline design and implementation experience within a commercial environment. As a listed and regulated company, Kindred Group pays great attention to player safety and sustainability. Our purpose is to transform gambling by being a trusted source of...

  • Azure DevOps Engineer

    vor 2 Wochen


    Sydney, Österreich Data#3 Vollzeit

    Engineering - Software (Information & Communication Technology) Full time Add expected salary to your profile for insights Join Microsoft’s largest Australian PartnerHRD Employer of Choice and Great Place to WorkBrisbane, Sydney or Melbourne Based - Hybrid WorkingAs an Azure DevOps Engineer you will work across multiple organisations, managing the...

  • Senior Data Engineer

    vor 3 Wochen


    Sydney, Österreich ClearCompany Vollzeit

    Business facing role for an accomplished Senior Data Engineer within the Financial Services industry About our client: Our client is an instantly recognisable household name within the Financial Services industry. In recent years they have led the way in the creation of wealth management products and services for their customers. Due to this expansion in...

  • Senior Data Engineer

    vor 2 Monaten


    Sydney, Österreich https:www.bebee.comjoin Vollzeit

    Senior Data Engineer - CREQ183850 Description ETL Dev and Testing Teradata Scala Python SQL Selenium Test automation Datawarehousing / BI experience Spark Hadoop / Big Data / HDFS Cloud migration experience AWS Cloud experience Primary Location Sydney, New South Wales, Australia Job Type Experienced Primary Skills Snowflake Years of...

  • Senior Data Engineer

    vor 4 Wochen


    Sydney, Österreich https:www.bebee.comjoin Vollzeit

    Senior Data Engineer - CREQ183850 Description ETL Dev and Testing Teradata Scala Python SQL Selenium Test automation Datawarehousing / BI experience Spark Hadoop / Big Data / HDFS Cloud migration experience AWS Cloud experience Primary Location Sydney, New South Wales, Australia Job Type Experienced Primary Skills Snowflake Years of...

  • Data Scientist Engineer

    vor 2 Monaten


    Sydney, Österreich Dataro Ops Pty Vollzeit

    Are you looking to use your data skills for social good? Are you a strong software or data engineer looking to get more hands on experience with data science? Then this role could be perfect for you. Dataro is an ethically-minded 'Data Science-as-a-Service' startup that uses machine learning to help not-for-profits run more successful fundraising...


  • Sydney, Österreich Dataro Ops Pty Vollzeit

    Are you looking to use your data skills for social good? Are you a strong software or data engineer looking to get more hands on experience with data science? Then this role could be perfect for you. Dataro is an ethically-minded 'Data Science-as-a-Service' startup that uses machine learning to help not-for-profits run more successful fundraising...

  • Senior Data Engineer

    vor 2 Monaten


    Sydney, Österreich Technology People Group Vollzeit

    We are seeking highly skilled and motivated Data Engineers to join our client who are in financial domain. As a Data Engineer, you will play a critical role in designing, implementing, and maintaining their data infrastructure. Your expertise in Snowflake, Redshift, AWS, CloudFormation, Python, and SQL will be instrumental in shaping their data...