Resource Corner It | Big Data Lead Engineer
vor 20 Stunden
Description
Required Skills: Scala, Pyspark, Data Pipelines & Databricks
Job Description:
Design, build, and maintain scalable data pipelines and workflows on the Databricks platform.
Collaborate with data engineers, data scientists, and analysts to optimize data architecture and performance.
Implement monitoring, alerting, and automation solutions to ensure the reliability and efficiency of Databricks clusters and jobs.
Provide technical expertise and support for troubleshooting issues and optimizing data processing and analysis tasks.
Proficiency in Databricks, Apache Spark, and related big data technologies.
Experience with designing and implementing ETL processes, data modeling, and data warehousing concepts.
Strong programming skills in languages such as Python, Scala, or SQL.
Familiarity with cloud platforms like AWS.
Excellent problem-solving skills and the ability to work effectively in a collaborative team environment.
Certifications in Databricks or related technologies are desirable.
Job Types: Full-time, Permanent
Pay: $135,000.00 – $140,000.00 per year
Experience:
Scala: 3 years (Required) Python: 3 years (Required) Work Authorisation:
Australia (Required) #J-18808-Ljbffr
-
Big Data Lead Engineer
vor 20 Stunden
Sydney, Österreich Resource Corner It VollzeitDescriptionRequired Skills: Scala, Pyspark, Data Pipelines & DatabricksJob Description: Design, build, and maintain scalable data pipelines and workflows on the Databricks platform.Collaborate with data engineers, data scientists, and analysts to optimize data architecture and performance.Implement monitoring, alerting, and automation solutions to ensure the...
-
Big Data Solution Engineer
vor 1 Woche
Sydney, Österreich Zone It Solutions VollzeitWe are seeking a Big Data Solution Engineer.This role involves designing and implementing scalable big data solutions to support our clients' analytical needs.ResponsibilitiesDesign and implement scalable big data solutions.Collaborate with cross-functional teams to meet analytical needs.Minimum RequirementsMinimum of 5 years of experience in Big Data...
-
Lead Engineer
vor 3 Monaten
Sydney, Österreich Experis Manpowergroup Sp. Z O.O. VollzeitExperis are proud to be representing a prestigious financial services organisation who are recruiting for an experienced Lead Engineer - Big Data to join their team on a contract basis and lead the design, development, and delivery of future-ready data solutions.As a technical lead, you will work closely with cross-functional teams to provide cutting-edge...
-
Big Data Solution Engineer
Vor 3 Tagen
Sydney, Österreich Pravallika B - Senior Recruitment Consultant - Zone IT Solutions VollzeitWe are seeking a Big Data Solution Engineer.This role involves designing and implementing scalable big data solutions to support our clients' analytical needs.Requirements Minimum of 5 years of experience in Big Data technologies and architectures.Proficient in Hadoop ecosystem components (HDFS, Hive, Pig, Spark, etc.)and relevant data storage...
-
Lead Engineer-Big Data
vor 4 Wochen
Sydney, Österreich Kirra Services VollzeitDesign, Develop, test and support future-ready data solutions for customers across industry verticalsProduce Detailed Solution Design and support data engineers and testers as a technical lead in a data projectDevelop, test and support end-to-end batch and near real-time data flows/pipelineDemonstrate understanding in data architectures, modern data...
-
Lead Engineer-Big Data
vor 4 Wochen
Sydney, Österreich Kirra Services VollzeitDesign, Develop, test and support future-ready data solutions for customers across industry verticalsProduce Detailed Solution Design and support data engineers and testers as a technical lead in a data projectDevelop, test and support end-to-end batch and near real-time data flows/pipelineDemonstrate understanding in data architectures, modern data...
-
Zone It Solutions | Big Data Solution Engineer
Vor 7 Tagen
Sydney, Österreich Tideri Jobbörse VollzeitWe are seeking a Big Data Solution Engineer.This role involves designing and implementing scalable big data solutions to support our clients' analytical needs.Responsibilities Design and implement scalable big data solutions.Collaborate with cross-functional teams to meet analytical needs. Minimum Requirements Minimum of 5 years of experience in Big Data...
-
Lead Data Engineer
vor 3 Wochen
Sydney, Österreich Pyramid Global Technologies VollzeitJob Description for Lead Data Engineer in Sydney.Experience: 10+ years in Software Engineering, Cloud Computing, Databricks, and Big Data.Key Responsibilities:Data EngineeringData WarehousingSolution DesignData AnalysisVisualizationData ModelingProgramming Languages: Python, Scala, SQLCloud Technologies: Azure and DatabricksBig Data Technologies: Cloudera...
-
Kirra Services | Lead Engineer-Big Data
vor 3 Wochen
Sydney, Österreich Tideri Jobbörse VollzeitDesign, Develop, test and support future-ready data solutions for customers across industry verticals Produce Detailed Solution Design and support data engineers and testers as a technical lead in a data project Develop, test and support end-to-end batch and near real-time data flows/pipeline Demonstrate understanding in data architectures, modern data...
-
Big Data Lead Engineer
Vor 6 Tagen
Sydney, Österreich Tech Mahindra VollzeitScam Alert: To all Tech Mahindra job aspirants and applications, beware of fraudulent job offers.Learn More..Job DescriptionA Bachelor's or Higher Degree is the minimum entry required for the position.Required Skills: ScalaPysparkData Pipelines & DatabricksMax Salary: 140k inc super all inclusiveJob Responsibilities: Design, build, and maintain scalable data...
-
Data Engineer
vor 1 Woche
Sydney, Österreich Zone It Solutions VollzeitWe are currently seeking a highly motivated and experienced Data Engineer for a full-time position.You will be responsible for designing and implementing data architectures, integrating data from various sources, and optimizing data pipelines to ensure efficient and accurate data processing.Key responsibilities: Design and implement data architectures,...
-
Senior Data Engineer
vor 1 Monat
Sydney, Österreich Efinancialcareers Ltd. VollzeitSenior Data Engineer (Big Data Platforms)Commonwealth Bank of Australia, Sydney, AustraliaDo work that matters:As a Senior Data Engineer with proven expertise in software development and a passion for providing data-driven solutions, you're ahead of trends and work at the forefront of Big Data and Data warehouse technologies. Here, you'll be part of a team...
-
Lead Data Engineer
vor 1 Monat
Sydney, Österreich Clearcompany VollzeitLead Data Engineer Sydney, Australia $220,000 (including Super) + Bonus About the Role: Join a high-performing Data Team at a leading financial services institution to lead regulatory initiatives and drive innovation in data engineering, utilizing AI and automation to enhance platform efficiency.Key Responsibilities: Lead the development and transformation...
-
Pyramid Global Technologies | Lead Data Engineer
vor 3 Wochen
Sydney, Österreich Tideri Jobbörse VollzeitJob Description for Lead Data Engineer in Sydney .Experience: 10+ years in Software Engineering, Cloud Computing, Databricks, and Big Data.Key Responsibilities: Data Engineering Data Warehousing Solution Design Data Analysis Visualization Data Modeling Programming Languages: Python, Scala, SQL Cloud Technologies: Azure and Databricks Big Data Technologies:...
-
Big Data Engineers
vor 1 Monat
Sydney, Österreich Igreendata VollzeitDevelopers/Programmers (Information & Communication Technology)Full timeiGreenData - A Synechron company is a next-generation technology company focusing on Cloud, Data, and Digital first solutions that are changing how technology provides value to businesses, empowering organizations to take advantage of the scalability, reliability, and improved...
-
Big Data Engineers
vor 4 Wochen
Sydney, Österreich Igreendata VollzeitDevelopers/Programmers (Information & Communication Technology) Full time iGreenData - A Synechron company is a next-generation technology company focusing on Cloud, Data, and Digital first solutions that are changing how technology provides value to businesses, empowering organizations to take advantage of the scalability, reliability, and improved...
-
Data Engineer
vor 3 Monaten
Sydney, Österreich Zone It Solutions VollzeitWe are looking for a Data Engineer for the Sydney location for a large-scale project.This is a permanent role with a global IT service leader.Key Responsibilities:Designing, building, and maintaining data architectures, including databases and processing systems.Acquiring and integrating new data sources.Optimising data pipelines, automating processes where...
-
Data Engineer
vor 4 Stunden
Sydney, Österreich Pravallika B - Senior Recruitment Consultant - Zone IT Solutions VollzeitWe are currently seeking a highly motivated and experienced Data Engineer for a full-time position.You will be responsible for designing and implementing data architectures, integrating data from various sources, and optimizing data pipelines to ensure efficient and accurate data processing.Key responsibilities: Design and implement data architectures,...
-
Cloud Support Engineer
vor 2 Monaten
Sydney, Österreich Amazon Web Services (AWS) VollzeitThis is a Cloud Support Engineer (Big Data / AIML) role with one of the leading companies in AU right now 🔥 -- Amazon Web Services (AWS) -- with an amazing team. They are continuing to grow rapidly. This is the chance to join right as the 🚀 takes off.More About the Role at Amazon Web Services (AWS) 🧐🧐## DESCRIPTION AWS Sales, Marketing, and...
-
Lead Data Engineer
vor 3 Wochen
Sydney, Österreich Macquarie Bank Limited VollzeitJoin our high performing Data Team focused on collaborating across a wide range of business and technical stakeholders to deliver a transformation project within Macquarie's Banking and Financial Services division.This is an excellent opportunity for an ambitious, problem-solving and technical data professional to contribute and grow rapidly within the...