Senior Data Engineer – Delivery

Senior Data Engineer – Delivery & Team Lead (Consulting) Location: Sydney (hybrid – minimum 4 days in the office) Employment: Full-time Company: MIP – The Data Company About the role We're growing our data engineering practice and looking for a Senior Data Engineer who can also act as a Project Lead. You'll split your time between leading small delivery squads – planning work, managing timelines and risks, and keeping senior stakeholders informed. Being hands‑on technically – designing and building modern data solutions across Microsoft Fabric and either Snowflake or Databricks. You'll be comfortable running stand‑ups, managing RAID, shaping scope, and presenting to senior business and IT stakeholders, while still rolling up your sleeves to review code, optimise pipelines, and fix tricky data issues. What you’ll do Lead delivery & stakeholders Act as project lead for small‑to‑medium engagements: define scope, plan iterations, manage risks / issues / assumptions / dependencies (RAID), and keep timelines realistic. Run agile ceremonies (stand‑ups, sprint planning, showcases, retros) and maintain clear status reporting for internal and client stakeholders. Manage senior stakeholders in business and IT – set expectations, communicate trade‑offs, handle difficult conversations, and ensure "no surprises". Work with architects and other consultants on solution design, estimation, and SoWs, and demo increments to execs and business users. Provide day‑to‑day leadership for a small team (consultants / associates): work allocation, mentoring, code reviews, and quality control. Design & build Design and build scalable data models and pipelines on Microsoft Fabric (OneLake, Lakehouse, Pipelines, Dataflows Gen2, Semantic Models). Deliver solutions on at least one of Snowflake or Databricks as a core data platform. Implement notebook / bdt‑style transformations (tests, docs, exposures) and enforce good engineering practices (modularity, version control, lineage, CI checks). Optimise, secure & govern Optimise performance and cost, including Fabric capacities, pipeline runtimes; Snowflake warehouses, caching, clustering, query tuning. Orchestrate jobs via Fabric Pipelines / ADF / Airflow and manage secrets via Key Vault. Security & governance: RLS / column security, PII handling, and Purview / lineage where applicable. Promote engineering excellence Reusable patterns, templates, documentation, and knowledge sharing within the team. What you’ll bring 10+ years in data engineering with strong consulting or complex enterprise delivery experience. Proven experience as a project lead: leading project workstreams or small teams, running sprints / iterations, managing RAID, reporting status, managing senior stakeholders and navigating competing priorities. Hands‑on Microsoft Fabric (Lakehouse, Pipelines, Semantic Models) and solid experience in Snowflake or Databricks. Solid CI / CD for data projects (branching, environment promotion, automated tests). Strong SQL and Python, and comfort with modern file formats (Parquet / Delta / Iceberg). Attention to detail – spotting data edge cases, naming inconsistencies, and schema drift early. Excellent communication skills – able to explain trade‑offs and options to both engineers and business stakeholders. Sydney‑based, able to work 4 days in the office, with full working rights in Australia. Nice to have AWS data stack Terraform / Bicep Production dbt / Coalesce experience Data governance & lineage (Purview), security patterns (RLS / CLS, masking) Testing / observability tools (Great Expectations, Soda, Monte Carlo / Revefi) BI familiarity (Power BI / Tableau) and semantic modelling (DAX / Tabular) Experience in presales / estimation and contributing to SoWs Why MIP Work across marquee Australian clients on modern stacks (Fabric, Snowflake, Databricks). Real ownership: lead delivery end‑to‑end with support from senior architects and practice leads. Flexible hybrid work, a supportive culture, and interesting problems that actually get delivered. Seniority level Mid‑Senior level Employment type: Full‑time Job function: Information Technology Industries: IT Services and IT Consulting #J-18808-Ljbffr