Big Data Lead Engineer

vor 2 Wochen

Sydney, Österreich Tata Consultancy Services Vollzeit

Overview Job Title: Big Data Lead Engineer About the job Join Tata Consultancy Services, Asia Pacific and be part of an organization committed to sustainable development for our future. TCS follows the Tata group philosophy of building sustainable businesses that are rooted in the community and demonstrate care for the environment. Our unique values position us to combine a purpose-driven worldview with digital innovation, collaborating with customers, communities and governments to lead and shape innovative solutions for a sustainable future. Corporate sustainability is embedded in our triple-bottom-line, focusing on people, the planet, and our purpose. Our offices are designed with eco-friendly features that significantly reduce our carbon footprint and enhance energy efficiency. When you become part of the TCS family, you will play an essential role dedicated to innovation, excellence, and crafting a brighter, greener future together. Responsibilities Provides technical direction and guidance to the engineering team. Ensures adherence to engineering standards and best practices. Participates in technical discussions and decision-making. Identifies and resolves technical challenges and issues. Conducts code reviews and provides feedback to other engineers. Maintain high development standards and practices. Facilitates team communication and collaboration. Mentoring and guiding junior engineers. Technical Skills Proficient with Java, Scala/Spark, API and Streaming – Primary Proficient with PySpark, Python and SQL Experience in Azure cloud platform Expertise in various connectors and pipelines for batch and real-time data collection/delivery Performance tuning - table partitioning and indexing, process threading Process Should have worked in Agile Experience of working in JIRA and Confluence Job details Seniority level: Mid-Senior level Employment type: Full-time Job function: Information Technology Industries: IT Services and IT Consulting #J-18808-Ljbffr

  • Lead Data Engineer: Architect Big Data Pipelines

    vor 3 Wochen

    Council of the City of Sydney, Österreich Ingrity Vollzeit

    A progressive data and analytics company in Sydney seeks a Lead Data Engineer to design and optimize data pipelines, mentor a team, and ensure robust data architecture. The ideal candidate will have expertise in Big Data technologies, strong stakeholder management skills, and proven experience in project leadership. This contract position offers the...

  • Staff / Lead Data Engineer (AWS, Big Data)

    vor 3 Wochen

    Council of the City of Sydney, Österreich Commonwealth Bank Vollzeit

    Join to apply for the Staff / Lead Data Engineer (AWS, Big Data) role at Commonwealth Bank . About the role As a Staff Data Engineer with expertise in software development and a passion for building data‑driven solutions, you’ll work at the forefront of Big Data and Data Warehouse technologies. Your work will help improve the standard of digital banking,...

  • Lead Data Engineer

    Vor 4 Tagen

    Council of the City of Sydney, Österreich Trades Workforce Solutions Vollzeit

    A financial services organization is seeking a Data Engineer to lead the development of a big data platform. This role requires strong hands-on experience in Python and PySpark to design and support data solutions. The candidate will collaborate with internal teams and mentor junior consultants. A minimum of 3 years experience in big data services is...

  • Staff / Lead Data Engineer (AWS, Big Data)

    vor 3 Wochen

    Council of the City of Sydney, Österreich Commonwealth Bank Vollzeit

    Staff Data Engineer (AWS, Big Data) You are determined to stay ahead of the latest Cloud, Big Data and Data warehouse technologies. We're one of the largest and most advanced Data Engineering teams in the country. Together we can build state‑of‑the‑art data solutions that power seamless experiences for millions of customers. Do work that matters As a...

  • Lead Data Engineer

    Vor 2 Tagen

    Council of the City of Sydney, Österreich Pyramid Global Technologies Vollzeit

    Overview Job Description for Lead Data Engineer in Sydney Responsibilities Leads data engineering initiatives with a focus on data warehousing, data analysis, visualization and data modeling. Designs and implements data solutions and pipelines using Python, Scala and SQL. Works with cloud platforms (Azure and Databricks) to build and maintain data...

  • Staff Data Engineer

    vor 3 Wochen

    Council of the City of Sydney, Österreich Commonwealth Bank Vollzeit

    A leading financial institution in New South Wales is seeking a Staff Data Engineer with expertise in AWS and Big Data technologies. The ideal candidate will drive innovative data solutions and mentor junior engineers while collaborating across teams to enhance digital banking capabilities. This role offers a flexible work environment and opportunities to...

  • Data Engineer

    vor 2 Wochen

    Sydney, Österreich Data#3 Vollzeit

    Overview: We are seeking an experienced Data Engineer to join a large-scale program for an initial 3-month contract. The role will focus on building and optimising data pipelines in an Azure environment, working closely with technical teams to deliver efficient, high-quality data solutions. Responsibilities: Design, build, and maintain ETL pipelines using...

  • Technical Lead

    Vor 6 Tagen

    Council of the City of Sydney, Österreich NTT DATA, Inc. Vollzeit

    Talent Acquisition Partner @ NTT DATA | Your success is my mission, and I’m here to support and champion you every step of the way! Tech Lead – Data Engineer (AI) | Contract | Sydney & Melbourne Flexi Location Exciting contract opportunities for AI-focused Data Engineers and Tech Leads! We’re seeking experienced engineers and hands‑on technical...

  • Data Engineer – BI, ETL

    vor 3 Wochen

    Council of the City of Sydney, Österreich Amazon Web Services (AWS) Vollzeit

    A leading cloud services provider in Australia is seeking a Data Engineer to support data-driven decision-making in their Data Center Infrastructure Operations. This role involves building ETLs, developing metrics, and delivering scalable analytics solutions. The ideal candidate has a Bachelor's degree in computer science, proficiency in data querying...

  • Data Engineer

    vor 2 Wochen

    Sydney, Österreich Whizdom Vollzeit

    Whizdom Sydney, New South Wales, Australia Whizdom Sydney, New South Wales, Australia This range is provided by Whizdom. Your actual pay will be based on your skills and experience — talk with your recruiter to learn more. Base pay range A$100.00/hr - A$120.00/hr Direct message the job poster from Whizdom APSCo Certified Recruitment Professional | 20 years...