Big Data Lead Engineer
vor 1 Monat
Responsibilities: Design, develop, test, and support future-ready data solutions for customers across industry verticals.Produce detailed solution design and support data engineers and testers as a technical lead in a data project.Develop, test, and support end-to-end batch and near real-time data flows/pipelines.Demonstrate understanding in data architectures, modern data platforms, big data, data modelling, ML/AI, analytics, cloud platforms, data governance, and information management and associated technologies.Develop and demonstrate proof of concepts and working demos.Skills Required: Must understand and navigate large organizations' governance and processes with ease.Must have exceptional interpersonal skills and be able to present solution design with confidence in large technical forums.Minimum of 5+ years of experience as a solution designer, tech lead, developer, tester, or support role in IT consulting or other technology business units across the industry, with a preference for Banking/FSS.Minimum of 3+ years of hands-on development, testing, and administration experience with Big Data/Data Lake services in cloud and on-premise.Experience in applying industry best practices, design patterns, and first-of-a-kind technical solutions as a developer or administrator on data and non-data specific platforms and applications.Experience in NoSQL databases such as HBase.Experience in implementing near real-time data flows/pipelines and distributed streaming applications using technology such as Apache Kafka.Understanding of various data modelling concepts and techniques such as Entity Relationship Modelling, Third Normal Form, Dimensional Modelling.Understanding of Data Mesh Architecture and Domain Data Products.Experience in implementing traditional ETL, data warehousing, and BI solutions.Hands-on implementation of services sensitive to performance SLAs with high availability, fault-tolerance, automatic fail-over, and geographical redundancy.Working knowledge and hands-on experience with cloud platforms such as Azure, AWS, GCP, and IBM, and other modern data platforms.Solid understanding of containerization, virtualization, infrastructure, and networking.Diverse experience in software development methodologies and project delivery frameworks such as Agile Sprints, Kanban, Waterfall, etc.Application Process: Outstanding opportunity to join an industry giant.
Apply now.
To be considered for the role, click the 'apply' button or for more information about this and other opportunities, please contact James McVey on or email: and quote the above job reference number.
Paxus values diversity and welcomes applications from Indigenous Australians, people from diverse cultural and linguistic backgrounds, and people living with a disability.
If you require an adjustment to the recruitment process, including the application form in an alternate format, please contact me on the above contact details.
#J-18808-Ljbffr
-
Lead Engineer
vor 2 Monaten
Sydney, Österreich Experis Manpowergroup Sp. Z O.O. VollzeitExperis are proud to be representing a prestigious financial services organisation who are recruiting for an experienced Lead Engineer - Big Data to join their team on a contract basis and lead the design, development, and delivery of future-ready data solutions.As a technical lead, you will work closely with cross-functional teams to provide cutting-edge...
-
Lead Engineer
vor 1 Monat
Sydney, Österreich Tideri Jobbörse VollzeitExperis are proud to be representing a prestigious financial services organisation who are recruiting for an experienced Lead Engineer - Big Data to join their team on a contract basis and lead the design, development, and delivery of future-ready data solutions.As a technical lead, you will work closely with cross-functional teams to provide cutting-edge...
-
Big Data Solution Engineer
vor 2 Monaten
Sydney, Österreich Zone It Solutions VollzeitWe are seeking a Big Data Solution Engineer.This role involves designing and implementing scalable big data solutions to support our clients' analytical needs. Responsibilities and Qualifications Minimum of 5 years of experience in Big Data technologies and architectures. Proficient in Hadoop ecosystem components (HDFS, Hive, Pig, Spark, etc.)and relevant...
-
Big Data Solution Engineer
vor 1 Monat
Sydney, Österreich Tideri Jobbörse VollzeitWe are seeking a Big Data Solution Engineer.This role involves designing and implementing scalable big data solutions to support our clients' analytical needs.Responsibilities and Qualifications Minimum of 5 years of experience in Big Data technologies and architectures.Proficient in Hadoop ecosystem components (HDFS, Hive, Pig, Spark, etc.)and relevant data...
-
Lead Data Engineer
vor 2 Wochen
Sydney, Österreich Cognizant VollzeitPosition Title: Lead Data Engineer Company OverviewCognizant (NASDAQ: CTSH) is a leading provider of information technology, consulting, and business process services, dedicated to helping the world's leading companies build stronger businesses. Headquartered in Teaneck, New Jersey (U.S.), Cognizant combines a passion for client satisfaction, technology...
-
Lead Gcp Data Engineer
vor 1 Monat
Sydney, Österreich Tideri Jobbörse VollzeitIf you have GCP experience and you're seeking a new job in Sydney, we want to hear from you.Cognizant is recruiting a Lead GCP Data Engineer, and the role comes with an attractive salary and benefits package.In this role, you will cultivate innovation within your team and partners and will demonstrate and encourage life-long learning.In your first few weeks...
-
Data Engineer
vor 2 Monaten
Sydney, Österreich Open Axcss VollzeitThe Data Engineer is responsible for building and supporting the big data platform.As a Data Engineer, your responsibilities include: Develop, test and support future-ready data solutions for customers across industry verticals.Develop, test and support end-to-end batch and near real-time data flows/pipelines.Demonstrate understanding in data architectures,...
-
Data Engineer
vor 4 Wochen
Sydney, Österreich Commonwealth Bank VollzeitThis is a Data Engineer - Big Data and Visualization role with one of the leading companies in AU right now 🔥 -- Commonwealth Bank -- with an amazing team. They are continuing to grow rapidly. This is the chance to join right as the 🚀 takes off.More About the Role at Commonwealth Bank 🧐🧐Do work that matters: As a Data engineer, you’ll be...
-
Data Engineer
vor 1 Monat
Sydney, Österreich Open Axcss VollzeitThe Data Engineer is responsible for building and supporting the big data platform. As a Data Engineer, your responsibilities include:Develop, test and support future-ready data solutions for customers across industry verticals.Develop, test and support end-to-end batch and near real-time data flows/pipelines.Demonstrate understanding in data architectures,...
-
Senior Data Engineer
vor 1 Monat
Sydney, Österreich M&T Resources VollzeitSydney IT & Telecomms DBA / Database Developer Big 4 banking experience highly beneficial Azure / Data Migration/ Pyspark / Data Warehousing Hybrid working environment / Day Rate contract Are you an experienced Data Engineer with a passion for driving large scale data migrations?Do you have a strong background in building data platforms and automated...
-
Azure Data Engineer
vor 3 Wochen
Sydney, Österreich M&T Resources VollzeitSydney IT & Telecomms DBA / Database Developer Big 4 banking experience highly beneficial Azure / Data Migration/ Pyspark / Data Warehousing Hybrid working environment / Day Rate contract Are you an experienced Data Engineer with a passion for driving large scale data migrations?Do you have a strong background in building data platforms and automated...
-
Principle Chapter Lead
vor 4 Wochen
Sydney, Österreich Big W X VollzeitPrinciple Chapter Lead - Engineering | BIG WXEngineering - Software (Information & Communication Technology)Full timeIt's the start of something bigger.There are over 15,000 of us, in the biggest cities and the tiniest towns.And each of us have an important role to play.If you have a passion for great customer service, a desire to make a real difference for...
-
Senior / Lead Data Engineer - Pyspark & Scala
vor 1 Monat
Sydney, Österreich Cognizant VollzeitCognizant has an exciting opportunity for a skilled and collaborative Senior /Lead Data Engineers with hands-on experience in Pyspark & Scala to join our thriving team. This full-time role is based in Sydney and offers an attractive salary and benefits. You'll be joining a collaborative and inclusive team seeking to be at the forefront of the business unit...
-
Senior / Lead Data Engineer - Pyspark & Scala
vor 1 Monat
Sydney, Österreich Tideri Jobbörse VollzeitCognizant has an exciting opportunity for a skilled and collaborative Senior /Lead Data Engineers with hands-on experience in Pyspark & Scala to join our thriving team.This full-time role is based in Sydney and offers an attractive salary and benefits.You'll be joining a collaborative and inclusive team seeking to be at the forefront of the business unit and...
-
Lead Data Engineer
vor 3 Wochen
Sydney, Österreich West Recruitment Pty Ltd VollzeitCall: West Sector: Technology Job Summary Join this certified 'Great Place to Work' business.Spearhead a Data Transformation initiative.Western Sydney Location - Defined WFH Policy.Job Description About Your New Employer:West Technology is proud to be partnering with an Australian owned group that has grown to become a genuine market leader across multiple...
-
Data Solutions Engineer
vor 1 Monat
Sydney, Österreich Experis Manpowergroup Sp. Z O.O. VollzeitOn behalf of our client, a leading financial services organization, we are seeking a Solution Engineer/Designer to join their innovative data solutions team on a contract basis.This is a high-impact role that operates at the intersection of data engineering, analytics, platforms, and project delivery, providing thought leadership and innovation in the design...
-
Lead Data Engineer
vor 1 Monat
Sydney, Österreich Baptistcare Nsw & Act VollzeitFulltime permanent position in Norwest | Hybrid office environmentNewly created role supporting the Data & Analytics StrategyDesign, implement & optimise data platform with an industry leading NFPAbout the role: Reporting to the Data and Analytics (D&A) Manager, the Lead Data Engineer will design and implement data warehouse and foundational data assets in...
-
Lead Data Engineer
vor 2 Monaten
Sydney, Österreich Baptistcare Nsw & Act VollzeitFulltime permanent position in Norwest | Hybrid office environment Newly created role supporting the Data & Analytics Strategy Design, implement & optimise data platform with an industry leading NFP About the role: Reporting to the Data and Analytics (D&A) Manager, the Lead Data Engineer will design and implement data warehouse and foundational data assets...
-
Data Engineer
vor 3 Wochen
Sydney, Österreich Attribute Group VollzeitData Engineer Permanent $130k-$140k + Super Our client is seeking a seasoned Data Engineer with expertise in the Cloudera Data Platform (CDP) and Spark-based ingestion pipelines.This role is ideal for a professional with a strong background in building and optimising data pipelines and a track record of working with large-scale data infrastructures.Key...
-
Data Engineer
vor 2 Wochen
Sydney, Österreich Finxl VollzeitData Engineer x 2 Term: 6-12mths ++ Location: Sydney preferred but maybe Melbourne Hybrid working: (3days) & WFH (2days) Key requirements: DBT with Redshift/Snowflake or likewiseGood understanding of Data Warehouse design and data modelsExpert level skill on writing and debugging SQL on big data platforms (Redshift,PRESTO SQL etc)Good understanding of CI/CD...