Staff Data Engineer
Vor 6 Tagen
About Karbon Karbon is the global leader in practice‑management software for growth‑minded accounting firms. Our award‑winning cloud platform streamlines work and communication, enabling the average firm using Karbon to save 18.5 hours per week per employee. About this role and the work At the start of its Data & AI journey, Karbon offers an opportunity to revolutionize our data platform. This position supports both the AI and Insights teams, critically delivering features for the Karbon platform. The successful candidate will be a hands‑on builder and a strategic thinker, designing scalable, robust, and forward‑looking data solutions centered around Databricks. Responsibilities Architect and own a unified data platform on Databricks, establishing the Medallion Architecture (Bronze‑Silver‑Gold layers) and using dbt for data modeling and transformations. Create and manage resilient data pipelines for batch and real‑time processing from the Azure data ecosystem, including a hot path for streaming data and orchestrating dependencies with Databricks Workflows. Implement and manage data replication from Databricks to Snowflake and develop a low‑latency query endpoint for the production Karbon application. Establish best practices for data quality, integrity, and observability, building automated tests and monitoring for all data assets and pipelines. Partner with the AI team to design and implement MLOps frameworks, building pipelines for feature engineering, model training, evaluation, and deployment. Design and enforce a comprehensive security model for the data platform, managing PII and implementing a fine‑grained RBAC model through IaC. Collaborate with and mentor a cross‑functional team of AI engineers, analysts, and developers, leading technical projects and defining standards. Qualifications 7+ years of relevant data‑engineering experience, building and scaling data platforms. Extensive experience with Databricks and dbt. Expertise in architecting ETL/ELT data migration patterns. Experience scaling pipelines in a multi‑cloud environment. Strong proficiency in Python, SQL, and relational DBMS. Experience with batch and streaming data technologies. DevOps experience, including CI/CD and infrastructure‑as‑code (e.g., Terraform). Experience building and maintaining APIs or query endpoints for application data access. Proven ability to lead technical projects and mentor teammates. Desirable Previous experience with Azure cloud services. Hands‑on MLOps experience with MLflow, feature stores, and automated model deployment pipelines. Why work at Karbon Global experience across the USA, Australia, New Zealand, UK, Canada, and the Philippines. 4 weeks annual leave plus 5 extra Karbon Days off per year. Flexible working environment. Collaborative, high‑performing team culture that embraces diversity and invests in development. Generous parental leave. EEO Statement Karbon embraces diversity and inclusion, aligning with our values. We do not discriminate based on race, gender, sexual orientation, gender identity or expression, age, educational background, national origin, religion, physical or cognitive ability, or any other dimension that may hinder inclusion. If your background does not perfectly align with every listed requirement, we encourage you to still apply; you may be the right person for this role. Accommodations If you require any adjustments or accommodations during the recruitment process or your journey at Karbon, please contact us for a confidential discussion. #J-18808-Ljbffr
-
Staff Data Engineer, Data Services — AWS
Vor 2 Tagen
City of Melbourne, Österreich SEEK VollzeitA leading tech firm in Melbourne seeks a Staff Data Engineer to manage and enhance data services. This pivotal role involves designing data frameworks, mentoring junior engineers, and ensuring the reliability and security of data systems. Candidates should have advanced skills in Python and experience with AWS. This position offers a mix of office and remote...
-
Junior Data Engineer
vor 2 Wochen
City of Melbourne, Österreich Gamma Data VollzeitGamma Data is a cloud platform and integration service provider based in Melbourne, VIC. We specialise in delivering engineering, architecture, leadership, and governance for transformation initiatives and large-scale cloud adoption programs. Our expertise spans across all cloud providers and we offer cloud platform, integration, and application design...
-
Staff Data Engineer
vor 1 Woche
Melbourne, Österreich Easygo VollzeitJoin to apply for the Staff Data Engineer role at Easygo Join to apply for the Staff Data Engineer role at Easygo Get AI-powered advice on this job and more exclusive features. You’ll be joining the Data Engineering team on an exciting mission to build a top-tier data platform that powers everything we do. We manage data from our in-house products like...
-
City of Melbourne, Österreich SEEK VollzeitA dynamic technology firm located in Melbourne is seeking a Staff Data Engineer to lead the design and implementation of data engineering solutions. The candidate will work on core platform components, mentor junior engineers, and ensure the reliability of cloud services. Ideal applicants will have significant experience in data warehousing, strong...
-
Staff Data Engineer
vor 10 Stunden
City of Melbourne, Österreich Ferocia Pty Ltd VollzeitAbout Ferocia We're the team behind Up, but under the hood, we're Ferocia - a passionate tech company driven by financial inclusion. Since 2011, we've been crafting innovative financial tools, starting with the digital platform for Bendigo Bank. We believe technology can empower everyone, from the advantaged to the disadvantaged, which is why Up was born....
-
Staff Data Engineer
vor 3 Wochen
Council of the City of Sydney, Österreich Commonwealth Bank VollzeitA leading financial institution in New South Wales is seeking a Staff Data Engineer with expertise in AWS and Big Data technologies. The ideal candidate will drive innovative data solutions and mentor junior engineers while collaborating across teams to enhance digital banking capabilities. This role offers a flexible work environment and opportunities to...
-
Staff Data Engineer
vor 2 Wochen
Council of the City of Sydney, Österreich Optus VollzeitGet AI-powered advice on this job and more exclusive features. Optus is an Australian telecommunications company, delivering more than 11 million services to our customers every day across mobile, broadband and digital solutions. We’re looking for a Staff Data Engineer to join our Data Engineering Centre of Excellence (CoE). This is a senior technical role...
-
Staff / Lead Data Engineer (AWS, Big Data)
vor 2 Wochen
Council of the City of Sydney, Österreich Commonwealth Bank VollzeitJoin to apply for the Staff / Lead Data Engineer (AWS, Big Data) role at Commonwealth Bank . About the role As a Staff Data Engineer with expertise in software development and a passion for building data‑driven solutions, you’ll work at the forefront of Big Data and Data Warehouse technologies. Your work will help improve the standard of digital banking,...
-
Staff Data Engineer
Vor 4 Tagen
City of Melbourne, Österreich Ferocia VollzeitWe're the team behind Up , but under the hood, we're Ferocia - a passionate tech company driven by financial inclusion. Since 2011, we've been crafting innovative financial tools, starting with the digital platform for Bendigo Bank. We believe technology can empower everyone, from the advantaged to the disadvantaged, which is why Up was born. Now, as part of...
-
Staff Data Engineer
Vor 2 Tagen
City of Melbourne, Österreich Up VollzeitWe're the team behind Up , but under the hood, we're Ferocia - a passionate tech company driven by financial inclusion. Since 2011, we've been crafting innovative financial tools, starting with the digital platform for Bendigo Bank. We believe technology can empower everyone, from the advantaged to the disadvantaged, which is why Up was born. Now, as part of...
