Data Engineer

vor 2 Wochen

City of Melbourne, Österreich Maltem Australia Vollzeit

At Maltem , we are a global consulting firm with over 1,200 experts across 12 countries, specialising in data, digital transformation, and innovation. We partner with major clients across industries to deliver high-impact technology solutions. In Australia, we’re growing rapidly and looking for passionate professionals to join us in leading data-driven projects. We are currently seeking a Data Engineer – Databricks & ML to join a major client based in Melbourne. Data Engineer – Databricks & ML | Melbourne-Based | Hybrid An exciting opportunity for an experienced Data Engineer to work on large-scale, cloud-native data projects using Databricks and to contribute to the operationalisation of Machine Learning solutions. Key Responsibilities Databricks Platform Enablement: Set up and manage Databricks clusters, jobs, and workflows for data engineering and machine learning. Enable analytics and data science teams to leverage Databricks for ML model development and deployment. Pipeline Development & Orchestration: Design, develop, and maintain scalable data pipelines using Databricks and AWS services. Implement orchestration for ETL, feature engineering, and ML workflows. ML Workflow Integration: Use MLflow for experiment tracking, model versioning, and deployment. Support end-to-end ML lifecycle, including model training, deployment, and monitoring. Data Quality & Governance: Apply data validation, quality checks, and security best practices across all pipelines and ML workflows. Performance Optimization: Tune Spark jobs and Databricks clusters for efficiency and cost optimization. Monitoring & Troubleshooting: Proactively monitor Databricks jobs, ML models, and AWS pipelines, ensuring timely resolution of issues. Collaboration: Work closely with data scientists, analysts, and business stakeholders to deliver robust ML-ready data solutions. Continuous Improvement: Stay updated on Databricks, AWS, and ML engineering best practices to drive innovation and efficiency. Required Skills & Experience Experience: 5+ years in data engineering, with hands‑on experience in Databricks and AWS environments. Cloud Expertise: Strong proficiency in AWS services (S3, Glue, Lambda, Redshift, IAM). Exposure to Azure data services is a plus. Databricks Skills: Experience with cluster setup, job orchestration, and ML workflows on Databricks. Familiarity with Delta Lake for data reliability and performance. Programming: Proficiency in Python and/or Scala; strong Spark experience required. ML & Data Knowledge: Understanding of machine learning workflows, feature engineering, and model deployment pipelines. Experience with MLflow for model tracking and deployment. Database Skills: Strong SQL skills; experience with NoSQL databases is desirable. DevOps: Knowledge of CI/CD pipelines and automation for data workflows. Certifications: AWS Certified Data Analytics – Specialty or AWS Solutions Architect; Databricks Machine Learning Professional Certification (or equivalent) highly desirable. What We Offer Join a fast‑growing consulting team with real impact Work with modern, in‑demand technologies Attractive daily rate and long‑term project visibility Supportive environment with expert communities Work Arrangement Hybrid: 3 days onsite, 2 days remote Seniority Level Mid‑Senior level Employment Type Full‑time Job Function Information Technology Industries IT Services and IT Consulting #J-18808-Ljbffr

  • Junior Data Engineer

    vor 2 Wochen

    City of Melbourne, Österreich Gamma Data Vollzeit

    Gamma Data is a cloud platform and integration service provider based in Melbourne, VIC. We specialise in delivering engineering, architecture, leadership, and governance for transformation initiatives and large-scale cloud adoption programs. Our expertise spans across all cloud providers and we offer cloud platform, integration, and application design...

  • Hybrid Data Engineer

    vor 2 Wochen

    City of Melbourne, Österreich Gamma Data Vollzeit

    A technology services provider in Melbourne is seeking a Data Engineer to manage dbt + Lakehouse installations and develop cloud infrastructure solutions. This entry-level contract role involves collaboration with software development teams. Candidates should possess skills in software development, cloud computing, and strong problem-solving abilities. The...

  • Data Recovery Engineer

    Vor 5 Tagen

    City of Brisbane, Österreich Wildfire Data Recovery | Award-Winning Data Recovery and Digital Forensics Vollzeit

    Executive Director/Owner @ Wildfire Data Recovery & RubikInvestments Company Description Wildfire Data Recovery is a Brisbane‑based business that specializes in providing top‑tier data recovery services for both private and corporate clients. Our team consists of highly skilled engineers who use innovative and proven methods to recover critical data. We...

  • Microsoft Azure Data Engineer

    vor 3 Wochen

    City of Melbourne, Österreich One51 | Data & Analytics Consultancy Vollzeit

    Get AI-powered advice on this job and more exclusive features. Direct message the job poster from One51 | Data, Analytics & AI Consultancy Co-founder | Managing Director, Data, Analytics & AI at One51 Consulting We are looking for a Microsoft Azure Data Engineer responsible for developing and maintaining the data architecture, models and standards for...

  • AI Engineer—Enterprise GenAI

    vor 2 Wochen

    City of Melbourne, Österreich Expose Data Pty Vollzeit

    A leading data consultancy in Australia is seeking an AI Engineer to design and implement innovative AI solutions. You will work with generative AI, large language models, and cloud-native systems, while collaborating across teams to solve complex business challenges. Ideal candidates will have over 4 years of experience in AI/ML systems and strong skills in...

  • Technical Lead

    Vor 3 Tagen

    Council of the City of Sydney, Österreich NTT DATA, Inc. Vollzeit

    Talent Acquisition Partner @ NTT DATA | Your success is my mission, and I’m here to support and champion you every step of the way! Tech Lead – Data Engineer (AI) | Contract | Sydney & Melbourne Flexi Location Exciting contract opportunities for AI-focused Data Engineers and Tech Leads! We’re seeking experienced engineers and hands‑on technical...

  • Data Engineer

    vor 3 Wochen

    City of Melbourne, Österreich Medibank Vollzeit

    Data Engineer / Developer – Data Science Squad Medibank's Data Hub team has an immediate need for a Data Engineer contractor to support the Data Science Squad. This is a 6‑month contract engagement, with a strong possibility of extension. Daily Rate: $680 per day The goal is to manage Data Scientist data requirements. To achieve this, we need a skilled...

  • Mechanical Design Engineer – Data Centre Systems

    vor 2 Wochen

    Council of the City of Sydney, Österreich CDC Data Centres Pty Vollzeit

    A leading data centre operator in Australia is seeking a Mechanical Engineer to support design and documentation efforts. The successful candidate will work collaboratively across various teams to deliver optimized data centre solutions. Ideal applicants will have a tertiary qualification in mechanical engineering, over four years of consultancy experience,...

  • Control Systems It Engineer

    vor 1 Tag

    City of Melbourne, Österreich Data#3 Vollzeit

    Control Systems IT Engineer (IT / OT Engineer) Perth, WA | Hybrid 2-3 Days | 12-Month Contract + Extensions | Occasional Offshore Travel | Major Energy Infrastructure Project The Opportunity Data#3 Managed Services is seeking a talented Control Systems IT Engineer to join our high‑performing team supporting one of Australia’s most advanced energy...

  • Data Analyst/Data Engineer

    Vor 3 Tagen

    City of Melbourne, Österreich Airservices Australia Vollzeit

    Data Analyst/Data Engineer Join to apply for the Data Analyst/Data Engineer role at Airservices Australia 12-month fixed-term role based in Canberra, Brisbane or Melbourne. Work on impactful projects that shape the future of air traffic management. Collaborate with a team committed to innovation and continuous improvement. Enjoy a supportive and...