Data Engineer

vor 2 Wochen


Council of the City of Sydney, Österreich LifeByte Systems Vollzeit

Senior Data Engineer LifeByte Systems At LifeByte, we are a dynamic and innovative collective of tech visionaries driven by the relentless pursuit of excellence. Founded in 2017, we enable businesses to thrive through cutting‑edge solutions. Job Responsibilities Work closely with business stakeholders to understand data requirements, translate business needs into scalable solutions, and ensure timely and reliable data delivery to support decision‑making. Collaborate with data analysts and data scientists to enable advanced analytics and business reporting through high‑quality, well‑modeled datasets. Maintain, update, and strengthen the existing Snowflake Data Lake, ensuring stability, performance, cost efficiency, and governance across the data ecosystem. Design, develop, and maintain data pipelines and ELT/ETL workflows for both batch and streaming data. Implement and optimize Spark UDFs/UDAFs in Java/Scala when built‑in functions are insufficient; ensure correctness, performance, and testability while minimizing serialization overhead. Contribute to Spark performance tuning (partitioning, broadcast joins, caching, AQE) and data modeling best practices. Troubleshoot and resolve production issues to maintain data integrity, timeliness, reliability, and service‑level objectives (SLOs). Ensure adherence to data governance, lineage, security, and compliance standards; contribute to metadata management. Participate in production support rotation and contribute to ongoing system improvements. Support automation, CI/CD, and DevOps best practices for data pipelines and infrastructure (Git/GitHub Actions or GitLab CI, Docker/Kubernetes). Skills & Qualifications Strong proficiency in SQL (query optimization, performance tuning, analytical use cases). Excellent Python programming skills for data transformation and automation. Familiar with Spark (PySpark and/or Scala) and distributed data processing; understanding of Dataset/DataFrame APIs and Spark SQL. Basic Java proficiency (collections, generics, exceptions) and the ability to write/maintain Spark UDFs/UDAFs in Java or Scala. Hands‑on experience with Snowflake (query optimization, resource management, ecosystem integration). Knowledge of ETL/ELT tools (e.g., dbt, Airflow or similar). Experience in data modeling (Star Schema, Data Vault, or similar). Exposure to real‑time streaming / CDC (Kafka, Debezium, Flink, or similar). Experience in cloud environments (AWS preferred); familiarity with containerization (Docker) and orchestration (Kubernetes) is a plus. Understanding of data governance and metadata management tools (e.g., Collibra, Alation) and lineage frameworks (e.g., OpenLineage). Familiar with Git, CI/CD pipelines, and modern development practices. Strong analytical thinking, problem‑solving, and communication skills. Preferred Experience 3+ years of experience as a Data Engineer or in a similar role. Experience with DataOps or data platform modernization projects. Familiarity with Snowflake advanced features (Streams, Tasks, Time Travel, Resource Monitors). Exposure to real‑time analytics and event‑driven architectures. Benefits Hybrid working arrangement – 2 days of remote work per week. Opportunities for career growth, including regional exposure. Complimentary snacks and beverages in the office pantry. Healthcare coverage (medical, dental, optical), gym benefits. Flexibility in smart casual dress code. Young, vibrant, and open work culture. #J-18808-Ljbffr



  • Council of the City of Sydney, Österreich NTT Data Vollzeit

    A leading global technology services provider is seeking an experienced Data Engineer (Consultant) to develop structured data sets and enable analytics. The role involves designing ETL packages and collaborating with IT and business teams to define data models. Candidates should have at least 5 years of experience in data engineering, strong skills in ETL...

  • Data Engineer

    vor 1 Tag


    Council of the City of Sydney, Österreich NTT Data Vollzeit

    Make an impact with NTT DATA Join a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it's a place where you can grow, belong and thrive. Your day at NTT DATA The Data...


  • Council of the City of Sydney, Österreich NTT DATA, Inc. Vollzeit

    A leading technology firm is seeking a Fabric Engineer to support a critical data transformation program. You will implement Microsoft Fabric and Azure services, establish secure environments for data workloads, and design data models using Medallion Architecture. The ideal candidate has experience with Microsoft Fabric and Azure, strong programming skills...

  • Data Engineer

    vor 1 Tag


    Council of the City of Sydney, Österreich NTT DATA, Inc. Vollzeit

    Get AI-powered advice on this job and more exclusive features. This range is provided by NTT DATA, Inc.. Your actual pay will be based on your skills and experience — talk with your recruiter to learn more. Base pay range A$115.00/hr - A$125.00/hr Location Location: Sydney preferred | Hybrid, 3 days onsite Duration Duration: January – April 2026 (with...

  • Technical Lead

    Vor 5 Tagen


    Council of the City of Sydney, Österreich NTT DATA, Inc. Vollzeit

    Talent Acquisition Partner @ NTT DATA | Your success is my mission, and I’m here to support and champion you every step of the way! Tech Lead – Data Engineer (AI) | Contract | Sydney & Melbourne Flexi Location Exciting contract opportunities for AI-focused Data Engineers and Tech Leads! We’re seeking experienced engineers and hands‑on technical...

  • Data Engineer

    vor 2 Wochen


    Sydney, Österreich Data#3 Vollzeit

    Overview: We are seeking an experienced Data Engineer to join a large-scale program for an initial 3-month contract. The role will focus on building and optimising data pipelines in an Azure environment, working closely with technical teams to deliver efficient, high-quality data solutions. Responsibilities: Design, build, and maintain ETL pipelines using...


  • Council of the City of Sydney, Österreich CDC Data Centres Pty Vollzeit

    A leading data centre operator in Australia is seeking a Mechanical Engineer to support design and documentation efforts. The successful candidate will work collaboratively across various teams to deliver optimized data centre solutions. Ideal applicants will have a tertiary qualification in mechanical engineering, over four years of consultancy experience,...

  • Junior Data Engineer

    vor 2 Wochen


    City of Melbourne, Österreich Gamma Data Vollzeit

    Gamma Data is a cloud platform and integration service provider based in Melbourne, VIC. We specialise in delivering engineering, architecture, leadership, and governance for transformation initiatives and large-scale cloud adoption programs. Our expertise spans across all cloud providers and we offer cloud platform, integration, and application design...

  • Data Engineer

    vor 4 Wochen


    Council of the City of Sydney, Österreich NexVenture Vollzeit

    This range is provided by NexVenture. Your actual pay will be based on your skills and experience — talk with your recruiter to learn more. Base pay range A$150,000.00/yr - A$170,000.00/yr Strategic data recruitment partner, empowering forward-thinking businesses with exceptional data professionals Data Engineer | Data Warehouse Engineer We’re working...

  • Data Engineer

    vor 1 Woche


    Council of the City of Sydney, Österreich Technology CII Vollzeit

    Overview Join to apply for the Data Engineer role at Technology CII . We're looking for a Data Engineer (Contract) to join our growing data team and help design, build, and optimize scalable data pipelines. You'll play a critical role in enabling advanced analytics and business intelligence by ensuring data is accessible, reliable, and well-structured....