Resource Corner It | Big Data Lead Engineer

vor 20 Stunden


Sydney, Österreich Tideri Jobbörse Vollzeit

Description
Required Skills: Scala, Pyspark, Data Pipelines & Databricks
Job Description:
Design, build, and maintain scalable data pipelines and workflows on the Databricks platform.
Collaborate with data engineers, data scientists, and analysts to optimize data architecture and performance.
Implement monitoring, alerting, and automation solutions to ensure the reliability and efficiency of Databricks clusters and jobs.
Provide technical expertise and support for troubleshooting issues and optimizing data processing and analysis tasks.
Proficiency in Databricks, Apache Spark, and related big data technologies.
Experience with designing and implementing ETL processes, data modeling, and data warehousing concepts.
Strong programming skills in languages such as Python, Scala, or SQL.
Familiarity with cloud platforms like AWS.
Excellent problem-solving skills and the ability to work effectively in a collaborative team environment.
Certifications in Databricks or related technologies are desirable.
Job Types: Full-time, Permanent
Pay: $135,000.00 – $140,000.00 per year
Experience:
Scala: 3 years (Required) Python: 3 years (Required) Work Authorisation:
Australia (Required) #J-18808-Ljbffr


  • Big Data Lead Engineer

    vor 20 Stunden


    Sydney, Österreich Resource Corner It Vollzeit

    DescriptionRequired Skills: Scala, Pyspark, Data Pipelines & DatabricksJob Description: Design, build, and maintain scalable data pipelines and workflows on the Databricks platform.Collaborate with data engineers, data scientists, and analysts to optimize data architecture and performance.Implement monitoring, alerting, and automation solutions to ensure the...


  • Sydney, Österreich Zone It Solutions Vollzeit

    We are seeking a Big Data Solution Engineer.This role involves designing and implementing scalable big data solutions to support our clients' analytical needs.ResponsibilitiesDesign and implement scalable big data solutions.Collaborate with cross-functional teams to meet analytical needs.Minimum RequirementsMinimum of 5 years of experience in Big Data...

  • Lead Engineer

    vor 3 Monaten


    Sydney, Österreich Experis Manpowergroup Sp. Z O.O. Vollzeit

    Experis are proud to be representing a prestigious financial services organisation who are recruiting for an experienced Lead Engineer - Big Data to join their team on a contract basis and lead the design, development, and delivery of future-ready data solutions.As a technical lead, you will work closely with cross-functional teams to provide cutting-edge...


  • Sydney, Österreich Pravallika B - Senior Recruitment Consultant - Zone IT Solutions Vollzeit

    We are seeking a Big Data Solution Engineer.This role involves designing and implementing scalable big data solutions to support our clients' analytical needs.Requirements Minimum of 5 years of experience in Big Data technologies and architectures.Proficient in Hadoop ecosystem components (HDFS, Hive, Pig, Spark, etc.)and relevant data storage...

  • Lead Engineer-Big Data

    vor 4 Wochen


    Sydney, Österreich Kirra Services Vollzeit

    Design, Develop, test and support future-ready data solutions for customers across industry verticalsProduce Detailed Solution Design and support data engineers and testers as a technical lead in a data projectDevelop, test and support end-to-end batch and near real-time data flows/pipelineDemonstrate understanding in data architectures, modern data...

  • Lead Engineer-Big Data

    vor 4 Wochen


    Sydney, Österreich Kirra Services Vollzeit

    Design, Develop, test and support future-ready data solutions for customers across industry verticalsProduce Detailed Solution Design and support data engineers and testers as a technical lead in a data projectDevelop, test and support end-to-end batch and near real-time data flows/pipelineDemonstrate understanding in data architectures, modern data...


  • Sydney, Österreich Tideri Jobbörse Vollzeit

    We are seeking a Big Data Solution Engineer.This role involves designing and implementing scalable big data solutions to support our clients' analytical needs.Responsibilities Design and implement scalable big data solutions.Collaborate with cross-functional teams to meet analytical needs. Minimum Requirements Minimum of 5 years of experience in Big Data...

  • Lead Data Engineer

    vor 3 Wochen


    Sydney, Österreich Pyramid Global Technologies Vollzeit

    Job Description for Lead Data Engineer in Sydney.Experience: 10+ years in Software Engineering, Cloud Computing, Databricks, and Big Data.Key Responsibilities:Data EngineeringData WarehousingSolution DesignData AnalysisVisualizationData ModelingProgramming Languages: Python, Scala, SQLCloud Technologies: Azure and DatabricksBig Data Technologies: Cloudera...


  • Sydney, Österreich Tideri Jobbörse Vollzeit

    Design, Develop, test and support future-ready data solutions for customers across industry verticals Produce Detailed Solution Design and support data engineers and testers as a technical lead in a data project Develop, test and support end-to-end batch and near real-time data flows/pipeline Demonstrate understanding in data architectures, modern data...


  • Sydney, Österreich Tech Mahindra Vollzeit

    Scam Alert: To all Tech Mahindra job aspirants and applications, beware of fraudulent job offers.Learn More..Job DescriptionA Bachelor's or Higher Degree is the minimum entry required for the position.Required Skills: ScalaPysparkData Pipelines & DatabricksMax Salary: 140k inc super all inclusiveJob Responsibilities: Design, build, and maintain scalable data...

  • Data Engineer

    vor 1 Woche


    Sydney, Österreich Zone It Solutions Vollzeit

    We are currently seeking a highly motivated and experienced Data Engineer for a full-time position.You will be responsible for designing and implementing data architectures, integrating data from various sources, and optimizing data pipelines to ensure efficient and accurate data processing.Key responsibilities: Design and implement data architectures,...

  • Senior Data Engineer

    vor 1 Monat


    Sydney, Österreich Efinancialcareers Ltd. Vollzeit

    Senior Data Engineer (Big Data Platforms)Commonwealth Bank of Australia, Sydney, AustraliaDo work that matters:As a Senior Data Engineer with proven expertise in software development and a passion for providing data-driven solutions, you're ahead of trends and work at the forefront of Big Data and Data warehouse technologies. Here, you'll be part of a team...

  • Lead Data Engineer

    vor 1 Monat


    Sydney, Österreich Clearcompany Vollzeit

    Lead Data Engineer Sydney, Australia $220,000 (including Super) + Bonus About the Role: Join a high-performing Data Team at a leading financial services institution to lead regulatory initiatives and drive innovation in data engineering, utilizing AI and automation to enhance platform efficiency.Key Responsibilities: Lead the development and transformation...


  • Sydney, Österreich Tideri Jobbörse Vollzeit

    Job Description for Lead Data Engineer in Sydney .Experience: 10+ years in Software Engineering, Cloud Computing, Databricks, and Big Data.Key Responsibilities: Data Engineering Data Warehousing Solution Design Data Analysis Visualization Data Modeling Programming Languages: Python, Scala, SQL Cloud Technologies: Azure and Databricks Big Data Technologies:...

  • Big Data Engineers

    vor 1 Monat


    Sydney, Österreich Igreendata Vollzeit

    Developers/Programmers (Information & Communication Technology)Full timeiGreenData - A Synechron company is a next-generation technology company focusing on Cloud, Data, and Digital first solutions that are changing how technology provides value to businesses, empowering organizations to take advantage of the scalability, reliability, and improved...

  • Big Data Engineers

    vor 4 Wochen


    Sydney, Österreich Igreendata Vollzeit

    Developers/Programmers (Information & Communication Technology) Full time iGreenData - A Synechron company is a next-generation technology company focusing on Cloud, Data, and Digital first solutions that are changing how technology provides value to businesses, empowering organizations to take advantage of the scalability, reliability, and improved...

  • Data Engineer

    vor 3 Monaten


    Sydney, Österreich Zone It Solutions Vollzeit

    We are looking for a Data Engineer for the Sydney location for a large-scale project.This is a permanent role with a global IT service leader.Key Responsibilities:Designing, building, and maintaining data architectures, including databases and processing systems.Acquiring and integrating new data sources.Optimising data pipelines, automating processes where...

  • Data Engineer

    vor 4 Stunden


    Sydney, Österreich Pravallika B - Senior Recruitment Consultant - Zone IT Solutions Vollzeit

    We are currently seeking a highly motivated and experienced Data Engineer for a full-time position.You will be responsible for designing and implementing data architectures, integrating data from various sources, and optimizing data pipelines to ensure efficient and accurate data processing.Key responsibilities: Design and implement data architectures,...

  • Cloud Support Engineer

    vor 2 Monaten


    Sydney, Österreich Amazon Web Services (AWS) Vollzeit

    This is a Cloud Support Engineer (Big Data / AIML) role with one of the leading companies in AU right now 🔥 -- Amazon Web Services (AWS) -- with an amazing team. They are continuing to grow rapidly. This is the chance to join right as the 🚀 takes off.More About the Role at Amazon Web Services (AWS) 🧐🧐## DESCRIPTION AWS Sales, Marketing, and...

  • Lead Data Engineer

    vor 3 Wochen


    Sydney, Österreich Macquarie Bank Limited Vollzeit

    Join our high performing Data Team focused on collaborating across a wide range of business and technical stakeholders to deliver a transformation project within Macquarie's Banking and Financial Services division.This is an excellent opportunity for an ambitious, problem-solving and technical data professional to contribute and grow rapidly within the...