Databricks Solutions Architect

vor 3 Wochen

City of Melbourne, Österreich CloudTech Innovations Vollzeit

We are looking for a highly experienced Solution Architect with a strong background in building and scaling cloud-native data platforms. This role is Databricks-heavy, focusing on Unity Catalog, Medallion Architecture, Delta Lake, governance, and modern data engineering patterns. You will collaborate with cross-functional teams to translate business needs into well-architected solutions and guide delivery across enterprise environments. Responsibilities Design and lead implementation of end-to-end Databricks Lakehouse Platforms using Delta Lake, Delta Live Tables, and MLflow. Architect Medallion Architecture (Bronze/Silver/Gold) for structured, semi-structured, and streaming workloads. Implement governed Lakehouse patterns using Unity Catalog for access control, lineage, data classification, and secure sharing. Build scalable ETL/ELT pipelines using Databricks Notebooks, Workflows, SQL Warehouses, and Spark-based transformations. Develop real-time streaming pipelines with Auto Loader, Structured Streaming, and event-driven platforms (Kafka, Kinesis, Pub/Sub). Integrate Databricks with cloud-native services such as AWS Glue, Azure Data Factory, and GCP Dataform . Define distributed integration patterns using REST APIs , microservices, and event-driven architectures. Enforce data governance, RBAC/ABAC, encryption, secret management , and compliance controls. Optimize Delta Lake tables, Spark workloads, and cluster configurations using Photon and autoscaling patterns. Drive cloud cost optimization across storage, compute, and workflow orchestration. Participate in architecture reviews, set standards, and support engineering teams throughout execution. Stay current on Databricks capabilities including Unity Catalog updates, Lakehouse Federation, serverless compute, and AI/ML features. Qualifications Bachelor’s or Master’s degree in Computer Science, Data Engineering, or related field. 8+ years of experience in enterprise software, cloud architecture, or data engineering roles. Strong hands‑on experience with Databricks, Apache Spark, Delta Lake , and Lakehouse platform design. Experience implementing and administering Unity Catalog for governance, lineage, and fine‑grained access control. Experience designing Medallion Architecture for analytics and engineering workloads. Hands‑on experience with cloud platforms such as AWS, Azure, or GCP , including storage, compute, and networking services. Experience with streaming technologies such as Kafka, Kinesis, or Pub/Sub . Strong understanding of data modeling, workflow orchestration (Airflow, Databricks Workflows, dbt) , and pipeline automation. Familiarity with Scala-based Spark workloads in addition to PySpark and SQL pipelines. Skilled in performance tuning, Spark optimization, cluster policies, and cloud cost management . Excellent communication skills for technical leadership and stakeholder collaboration. Certifications in Databricks, AWS/GCP/Azure Solution Architecture, or TOGAF are a plus. Seniority Level Mid‑Senior level Employment Type Contract Job Function Engineering and Information Technology Industries: IT Services and IT Consulting Referrals increase your chances of interviewing at CloudTech Innovations by 2x Location: Melbourne, Victoria, Australia Salary: A$125.00 – A$157.00 #J-18808-Ljbffr

  • Solutions Architect

    vor 3 Wochen

    City of Melbourne, Österreich Databricks Vollzeit

    Join to apply for the Solutions Architect role at Databricks At Databricks, our core principles guide us to create a unified platform that makes data science and analytics accessible to everyone. You will be an essential part of this mission, using your technical expertise to demonstrate how our Data Intelligence Platform can help customers solve their...

  • Sr. Solutions Architect

    vor 4 Wochen

    Council of the City of Sydney, Österreich Databricks Vollzeit

    Join to apply for the Sr. Solutions Architect role at Databricks At Databricks, our core principles are at the heart of everything we do; creating a culture of proactiveness and a customer-centric mindset guides us to create a unified platform that makes data science and analytics accessible to everyone. We aim to inspire our customers to make informed...

  • Databricks Solutions Architect

    vor 4 Wochen

    City of Melbourne, Österreich Cloudtech Innovations Vollzeit

    Solution Architect (with a touch of Business Analyst) Melbourne, Victoria, Australia We are seeking a seasoned Solution Architect with a strong background in designing and implementing scalable data and cloud architectures. The ideal candidate will have hands‑on experience with Databricks , modern data platforms, and enterprise‑grade cloud solutions....

  • Sr. Resident Solutions Architect, ML

    Vor 6 Tagen

    Melbourne, Österreich Databricks Vollzeit

    Sr. Resident Solutions Architect, ML & GenAI As a Machine Learning / GenAI Resident Solutions Architect (RSA) in our Professional Services team you will work with clients on short to medium term customer engagements on their ML & AI challenges using the Databricks Data Intelligent platform. You will provide data science, and cloud technology projects which...

  • Senior AWS Databricks Architect | Data Solutions Lead

    vor 6 Stunden

    City of Melbourne, Österreich Zone IT Solutions Vollzeit

    A recruitment company in Australia is seeking an experienced AWS Databricks Architect to lead the design and implementation of data solutions on the AWS platform. The ideal candidate will have a minimum of 5 years in data architecture and engineering, with strong expertise in various AWS services such as Glue and Redshift, and hands-on experience with...

  • Databricks Architect

    vor 3 Wochen

    City of Melbourne, Österreich UCentric Vollzeit

    Technical Recruiter at UCentric | Connecting top talent, culture, and opportunity Databricks Architect Location : Melbourne, Australia Work Set-Up: Hybrid/Flexible Our client Our client is a rapidly growing global technology consultancy specialising in cloud, data, and digital transformation. They partner with leading enterprises to deliver high-impact,...

  • Sr. Solutions Architect

    vor 3 Wochen

    Council of the City of Sydney, Österreich Databricks Inc. Vollzeit

    At Databricks, our core principles are at the heart of everything we do; creating a culture of proactiveness and a customer‑centric mindset guides us to create a unified platform that makes data science and analytics accessible to everyone. We aim to inspire our customers to make informed decisions that push their business forward. We provide a...

  • Sr. Resident Solutions Architect, ML

    vor 4 Wochen

    Council of the City of Sydney, Österreich Databricks Inc. Vollzeit

    Overview Culture Benefits Diversity Engineering Research Students & new grads Back to search results Sr. Resident Solutions Architect, ML & GenAI Sydney, Australia While candidates in Sydney are encouraged for this role, candidates in Melbourne, Brisbane and Perth will be considered. As a Machine Learning / GenAI Resident Solutions Architect (RSA) in our...

  • Solutions Architect

    vor 6 Stunden

    City of Brisbane, Österreich Databricks Vollzeit

    FEQ426R577 At Databricks our core principles are at the heart of everything we do; creating a culture of proactiveness and a customer-centric mindset guides us to create a unified platform that makes data science and analytics accessible to everyone. We aim to inspire our customers to make informed decisions that push their business forward. We provide a...

  • Sr. Solutions Engineer

    Vor 2 Tagen

    Melbourne, Österreich Databricks Vollzeit

    Overview Join to apply for the Sr. Solutions Engineer role at Databricks . Get AI-powered advice on this job and more exclusive features. At Databricks, our core principles are at the heart of everything we do; creating a culture of proactiveness and a customer-centric mindset guides us to create a unified platform that makes data science and analytics...