Big Data Lead Engineer

Vor 5 Tagen


Sydney, Österreich Tech Mahindra Vollzeit

Scam Alert: To all Tech Mahindra job aspirants and applications, beware of fraudulent job offers.
Learn More..
Job DescriptionA Bachelor's or Higher Degree is the minimum entry required for the position.
Required Skills: ScalaPysparkData Pipelines & DatabricksMax Salary: 140k inc super all inclusive
Job Responsibilities: Design, build, and maintain scalable data pipelines and workflows on the Databricks platform.Collaborate with data engineers, data scientists, and analysts to optimize data architecture and performance.Implement monitoring, alerting, and automation solutions to ensure the reliability and efficiency of Databricks clusters and jobs.Provide technical expertise and support for troubleshooting issues and optimizing data processing and analysis tasks.Proficiency in Databricks, Apache Spark, and related big data technologies.Experience with designing and implementing ETL processes, data modeling, and data warehousing concepts.Strong programming skills in languages such as Python, Scala, or SQL.Familiarity with cloud platforms like AWS.Excellent problem-solving skills and the ability to work effectively in a collaborative team environment.Certifications in Databricks or related technologies are desirable.#J-18808-Ljbffr


  • Lead Engineer

    vor 3 Monaten


    Sydney, Österreich Experis Manpowergroup Sp. Z O.O. Vollzeit

    Experis are proud to be representing a prestigious financial services organisation who are recruiting for an experienced Lead Engineer - Big Data to join their team on a contract basis and lead the design, development, and delivery of future-ready data solutions.As a technical lead, you will work closely with cross-functional teams to provide cutting-edge...

  • Lead Engineer-Big Data

    vor 4 Wochen


    Sydney, Österreich Kirra Services Vollzeit

    Design, Develop, test and support future-ready data solutions for customers across industry verticalsProduce Detailed Solution Design and support data engineers and testers as a technical lead in a data projectDevelop, test and support end-to-end batch and near real-time data flows/pipelineDemonstrate understanding in data architectures, modern data...

  • Lead Engineer-Big Data

    vor 4 Wochen


    Sydney, Österreich Kirra Services Vollzeit

    Design, Develop, test and support future-ready data solutions for customers across industry verticalsProduce Detailed Solution Design and support data engineers and testers as a technical lead in a data projectDevelop, test and support end-to-end batch and near real-time data flows/pipelineDemonstrate understanding in data architectures, modern data...


  • Sydney, Österreich Zone It Solutions Vollzeit

    We are seeking a Big Data Solution Engineer.This role involves designing and implementing scalable big data solutions to support our clients' analytical needs.ResponsibilitiesDesign and implement scalable big data solutions.Collaborate with cross-functional teams to meet analytical needs.Minimum RequirementsMinimum of 5 years of experience in Big Data...


  • Sydney, Österreich Pravallika B - Senior Recruitment Consultant - Zone IT Solutions Vollzeit

    We are seeking a Big Data Solution Engineer.This role involves designing and implementing scalable big data solutions to support our clients' analytical needs.Requirements Minimum of 5 years of experience in Big Data technologies and architectures.Proficient in Hadoop ecosystem components (HDFS, Hive, Pig, Spark, etc.)and relevant data storage...

  • Lead Data Engineer

    vor 3 Wochen


    Sydney, Österreich Pyramid Global Technologies Vollzeit

    Job Description for Lead Data Engineer in Sydney.Experience: 10+ years in Software Engineering, Cloud Computing, Databricks, and Big Data.Key Responsibilities:Data EngineeringData WarehousingSolution DesignData AnalysisVisualizationData ModelingProgramming Languages: Python, Scala, SQLCloud Technologies: Azure and DatabricksBig Data Technologies: Cloudera...


  • Sydney, Österreich Tideri Jobbörse Vollzeit

    Design, Develop, test and support future-ready data solutions for customers across industry verticals Produce Detailed Solution Design and support data engineers and testers as a technical lead in a data project Develop, test and support end-to-end batch and near real-time data flows/pipeline Demonstrate understanding in data architectures, modern data...

  • Senior Data Engineer

    vor 1 Monat


    Sydney, Österreich Efinancialcareers Ltd. Vollzeit

    Senior Data Engineer (Big Data Platforms)Commonwealth Bank of Australia, Sydney, AustraliaDo work that matters:As a Senior Data Engineer with proven expertise in software development and a passion for providing data-driven solutions, you're ahead of trends and work at the forefront of Big Data and Data warehouse technologies. Here, you'll be part of a team...

  • Lead Data Engineer

    vor 1 Monat


    Sydney, Österreich Clearcompany Vollzeit

    Lead Data Engineer Sydney, Australia $220,000 (including Super) + Bonus About the Role: Join a high-performing Data Team at a leading financial services institution to lead regulatory initiatives and drive innovation in data engineering, utilizing AI and automation to enhance platform efficiency.Key Responsibilities: Lead the development and transformation...


  • Sydney, Österreich Tideri Jobbörse Vollzeit

    Job Description for Lead Data Engineer in Sydney .Experience: 10+ years in Software Engineering, Cloud Computing, Databricks, and Big Data.Key Responsibilities: Data Engineering Data Warehousing Solution Design Data Analysis Visualization Data Modeling Programming Languages: Python, Scala, SQL Cloud Technologies: Azure and Databricks Big Data Technologies:...


  • Sydney, Österreich Tideri Jobbörse Vollzeit

    We are seeking a Big Data Solution Engineer.This role involves designing and implementing scalable big data solutions to support our clients' analytical needs.Responsibilities Design and implement scalable big data solutions.Collaborate with cross-functional teams to meet analytical needs. Minimum Requirements Minimum of 5 years of experience in Big Data...

  • Big Data Engineers

    vor 4 Wochen


    Sydney, Österreich Igreendata Vollzeit

    Developers/Programmers (Information & Communication Technology)Full timeiGreenData - A Synechron company is a next-generation technology company focusing on Cloud, Data, and Digital first solutions that are changing how technology provides value to businesses, empowering organizations to take advantage of the scalability, reliability, and improved...

  • Big Data Engineers

    vor 4 Wochen


    Sydney, Österreich Igreendata Vollzeit

    Developers/Programmers (Information & Communication Technology) Full time iGreenData - A Synechron company is a next-generation technology company focusing on Cloud, Data, and Digital first solutions that are changing how technology provides value to businesses, empowering organizations to take advantage of the scalability, reliability, and improved...

  • Lead Data Engineer

    vor 3 Wochen


    Sydney, Österreich Macquarie Bank Limited Vollzeit

    Join our high performing Data Team focused on collaborating across a wide range of business and technical stakeholders to deliver a transformation project within Macquarie's Banking and Financial Services division.This is an excellent opportunity for an ambitious, problem-solving and technical data professional to contribute and grow rapidly within the...

  • Lead Data Engineer

    vor 3 Wochen


    Sydney, Österreich Macquarie Bank Limited Vollzeit

    Join our high performing Data Team focused on collaborating across a wide range of business and technical stakeholders to deliver a transformation project within Macquarie's Banking and Financial Services division. This is an excellent opportunity for an ambitious, problem-solving and technical data professional to contribute and grow rapidly within the...

  • Data Engineer Lead

    vor 1 Monat


    Sydney, Österreich West Recruitment Pty Ltd Vollzeit

    Email: Call: West Sector: TechnologyJob SummaryFlexible working arrangementsAward winning businessExcellent package and benefitsJob DescriptionOur client is seeking a highly experienced Data Engineer to join their technology team on a permanent basis.The role will play a pivotal part in the business's data transformation initiative.The ideal candidate will...


  • Sydney, Österreich Tideri Jobbörse Vollzeit

    Scam Alert: To all Tech Mahindra job aspirants and applications, beware of fraudulent job offers.Learn More.. Job Description A Bachelor's or Higher Degree is the minimum entry required for the position.Required Skills: Scala Pyspark Data Pipelines & Databricks Max Salary: 140k inc super all inclusive Job Responsibilities: Design, build, and maintain...

  • Lead Data Engineer

    vor 3 Wochen


    Sydney, Österreich Macquarie Bank Limited Vollzeit

    Join our high performing Data Team focused on collaborating across a wide range of business and technical stakeholders to deliver a transformation project within Macquarie's Banking and Financial Services division. This is an excellent opportunity for an ambitious, problem solving and technical data professional to contribute and grow rapidly within the...

  • Lead Data Engineer

    vor 3 Wochen


    Sydney, Österreich Clearcompany Vollzeit

    Sydney CBD with some WFH12 + 12 + 12 month contractNV1 Security Clearance preferredOur client, a large and well-funded Federal Government entity focused on agriculture, is seeking a Lead Data Engineer to join their team in March.Responsibilities: Design and develop scalable data pipelines for ingesting, transforming, and storing structured and unstructured...

  • Lead Data Engineer

    vor 3 Wochen


    Sydney, Österreich Clearcompany Vollzeit

    Hybrid work - Any state in Australia - Sydney, CBD, NSW12 + 12 + 12 months - Baseline clearance requiredData Engineering, ELT, Coding, Data Modelling, DevOpsIntegrated cargo clearance system for biosecurity risk managementOur client, a biosecurity focussed Federal Government department in Melbourne CBD, requires an experienced Lead Data Engineer for a 12 +...