Data Engineer
vor 3 Wochen
Clarity Partners is working with an industry leading Fintech business with offices across Perth, Melbourne, Brisbane and Sydney.
They are in search of an experienced Data Engineer to join the team. They are looking for someone who is truly passionate about tech and data.
The ideal candidate; demonstrates their capabilities through personal projects (not just university projects), has commercial quality coding standards, is a team player and strong interpersonal skills.
Responsibilities: Design, Build, and Maintain Data Pipelinesusing AWS services, dbt, and Python.
Integrate diverse data sources into centralized data warehouses or data lakes.
Utilize dbt to develop and manage data models, ensuring data is organized, clean, and ready for analysis.
Implement and manage data storage solutions using Delta Lake to ensure data integrity, reliability, and efficient access.
Design and implement real-time data streaming and processing solutions using Elasticsearch for high-performance data retrieval and analysis.
Write efficient, reusable Python scripts to automate data processing tasks, improving workflow efficiency and reducing manual intervention.
Collaborate with data scientists, analysts, and other stakeholders to ensure data availability and usability, enabling data-driven decision-making across the organization.
Background & Qualifications: Educational Background: Degree in Mathematics, Statistics, Computer Science, Data Science, Engineering, IT, or a related field.
Technical Skills: Advanced knowledge of dbt: Proficient in using dbt for data modeling, transformation, and pipeline management.
Cloud Platforms: Extensive experience with AWS (or other cloud platforms) for building and maintaining scalable data infrastructures.
Programming: Strong proficiency in Python for scripting and automation in data engineering tasks.
Data Storage & Processing: Expertise in working with Delta Lake for efficient data storage solutions.
Search and Analytics: Experience with Elasticsearch for real-time data processing and analytics.
Desirable Skills: Programming: Knowledge of Java for backend development.
Databases: Familiarity with Oracle and SQL Server for database management.
Frontend Development: Experience with React.js for building user interfaces and dashboards.
Soft Skills: Interpersonal Skills: Strong interpersonal skills with the ability to communicate complex technical concepts to both technical and non-technical stakeholders.
Communication: Ability to effectively collaborate across various teams and departments to align on project goals and data needs.
Industry Knowledge: A good understanding of the finance and fintech space, with the ability to apply data engineering solutions within this domain.
Passion: A demonstrated passion for data science, machine learning, AI, and data engineering, with a commitment to continuous learning and professional development.
**Note - Must be based in Perth, Western Australia, with the ability to work onsite as required. To apply, please follow the link or reach out to Phoebe Weston-Selby on or orin/phoebeweston-selby/
#J-18808-Ljbffr
-
Technical Data Engineer On-Site
vor 3 Wochen
Melbourne, Österreich Data Privacy VollzeitSecurity Clearance Required for this role: Must have a Current NV2 security clearance.Must be an Australian CitizenThis will be an Office based role in Canberra, Melbourne & Sydney locations.The Technical Data Engineer will be responsible for designing, developing, and implementing data engineering solutions to support the organization's data needs.This role...
-
Gis Specialist Data Engineer
vor 3 Wochen
Melbourne, Österreich Ecf Data, Llc VollzeitCapgemini is a global strategic and technological expert collective, operating in over 50 countries with more than 350,000 professionals.They partner with renowned clients to transform businesses using cloud, data, AI, and digital engineering.The company has significantly expanded in Australia and New Zealand, with over 3,500 team members.Join their rapidly...
-
Senior Azure Data Engineer
Vor 3 Tagen
Melbourne, Österreich Ntt Data Business Solutions VollzeitNTT DATA is heavily investing globally in providing state of the art analytical solutions to its clients. Our capability has been focused locally, regionally in APAC and globally by forming strategic partnerships including Microsoft Azure, SAP Analytics, Snowflake, Matillion and many more, leveraging the strength of our cloud and network assets via the NTT...
-
Senior Azure Data Engineer
vor 3 Wochen
Melbourne, Österreich Ntt Data Business Solutions VollzeitNTT DATA is heavily investing globally in providing state of the art analytical solutions to its clients.Our capability has been focused locally, regionally in APAC and globally by forming strategic partnerships including Microsoft Azure, SAP Analytics, Snowflake, Matillion and many more, leveraging the strength of our cloud and network assets via the NTT...
-
Data Engineer
vor 2 Wochen
Melbourne, Österreich Tqsolutions VollzeitEngineering - Software (Information & Communication Technology)Full timeFor 30 years, ISPT has invested in property, developing and creating vibrant, meaningful places for people to work, shop and enjoy. Our purpose is to develop and grow together to create a better future for all.We now have an exciting opportunity for a Data Engineer to join our Strategic...
-
Data Engineer
vor 3 Wochen
Melbourne, Österreich Ultradynamix VollzeitRole: Data Engineer Client: Federal Government Contract: 12 Months Extension: 12 Months(2) Clearance: baseline Location: ACT or Offsite Requirements The CIO Division provides a range of enabling services and operations delivery to the department and to Australian businesses and is seeking an experienced and motivated data engineer to assist with the delivery...
-
Data Engineer
vor 2 Wochen
Melbourne, Österreich Tqsolutions VollzeitEngineering - Software (Information & Communication Technology) Full time For 30 years, ISPT has invested in property, developing and creating vibrant, meaningful places for people to work, shop and enjoy.Our purpose is to develop and grow together to create a better future for all. We now have an exciting opportunity for a Data Engineer to join our...
-
Data Engineer
vor 1 Monat
Melbourne, Österreich Energy Australia VollzeitThis is a Data Engineer role with one of the leading companies in AU right now 🔥 -- Energy Australia -- with an amazing team. They are continuing to grow rapidly. This is the chance to join right as the 🚀 takes off.More About the Role at Energy Australia 🧐🧐**About the role…** ‘Powering EnergyAustralia to make better data driven decisions...
-
Data Engineer
vor 3 Wochen
Melbourne, Österreich It M S VollzeitThis is a Data Engineer role with one of the leading companies in AU right now -- Energy Australia -- with an amazing team.They are continuing to grow rapidly.This is the chance to join right as the takes off.More About the Role at Energy Australia**About the role…** 'Powering EnergyAustralia to make better data driven decisions towards a greener energy...
-
Data Engineer
vor 1 Woche
Melbourne, Österreich Baptcare VollzeitData Engineer Full-time Camberwell, VIC About Us At Baptcare, we care.Our Mission and Vision are lived through our WE CARE Values: for our residents, customers, clients, partners, and supporters; with the very young through to the very old, the vulnerable, with families through all of life's stages and challenges.Baptcare is a purpose driven organisation...
-
Data Engineer
vor 1 Woche
Melbourne, Österreich Baptcare Careers VollzeitData Engineer Full-time Camberwell, VIC About Us At Baptcare, we care.Our Mission and Vision are lived through our WE CARE Values: for our residents, customers, clients, partners, and supporters; with the very young through to the very old, the vulnerable, with families through all of life's stages and challenges. Baptcare is a purpose driven organisation...
-
Data Engineer
vor 3 Wochen
Melbourne, Österreich Paxus - Technology + Digital Talent VollzeitMelbourne based (Hybrid working model) - Initial 2 months contract with extensions likely! Work as a Data Engineer with a leading Consulting firm on one of their Melbourne based projects.Responsibilities and Skills required: Experience working in data engineering.Retail Sector experience (i.e.Supermarket)Data ModellingT-SQLAzure Synapse / Fabric knowledge is...
-
Azure Data Engineer
vor 1 Woche
Melbourne, Österreich Tideri Jobbörse VollzeitAzure Data Engineer Melbourne, VICFull-time Role Summary: A fast-growing investment management firm is seeking an Azure Data Engineer to lead a technology transformation.This hands-on role will involve architecting and scaling Azure infrastructure, documenting data flows, and ensuring alignment with enterprise architecture.The ideal candidate has experience...
-
Data Engineer
vor 3 Wochen
Melbourne, Österreich Cyos Solutions VollzeitApplication closing date: Thursday, 10 October 2024 • 11:59pm, Canberra time (in Canberra) Estimated start date: Tuesday, 29 October 2024 Location of work: VIC Working arrangements: Remote work home will be granted if successful.Travel to Canberra for operational reasons will be required 1-2 times per quarter.Any required travel will be discussed in...
-
Data Engineer
vor 2 Wochen
Melbourne, Österreich Cyos Solutions VollzeitApplication closing date: Thursday, 10 October 2024 • 11:59pm, Canberra time (in Canberra)Estimated start date: Tuesday, 29 October 2024Location of work: VICWorking arrangements: Remote work home will be granted if successful. Travel to Canberra for operational reasons will be required 1-2 times per quarter. Any required travel will be discussed in advance...
-
Data Engineer
vor 3 Wochen
Melbourne, Österreich Cyos Solutions VollzeitApplication closing date: Thursday, 10 October 2024 • 11:59pm, Canberra time (in Canberra)Estimated start date: Tuesday, 29 October 2024Location of work: VICWorking arrangements: Remote work home will be granted if successful.Travel to Canberra for operational reasons will be required 1-2 times per quarter.Any required travel will be discussed in advance...
-
Data Engineer
vor 3 Wochen
Melbourne, Österreich Cyos Solutions VollzeitApplication closing date: Thursday, 10 October 2024 • 11:59pm, Canberra time (in Canberra)Estimated start date: Tuesday, 29 October 2024Location of work: VICWorking arrangements: Remote work home will be granted if successful. Travel to Canberra for operational reasons will be required 1-2 times per quarter. Any required travel will be discussed in advance...
-
Data Engineer
vor 2 Stunden
Melbourne, Österreich Aatom Recruitment VollzeitWorking on behalf of a Local Authority, Aatom Recruitment has a new opportunity for a Data Engineer.This is a permanent vacancy – a cover letter must be submitted along with candidate CV.The Council is on a journey to implement a modern enterprise data and analytics cloud platform and are seeking data engineers to contribute to this project.Essential...
-
Data Engineer
vor 4 Wochen
Melbourne, Österreich Infosys VollzeitThis is a Data Engineer role with one of the leading companies in AU right now 🔥 -- Infosys -- with an amazing team. They are continuing to grow rapidly. This is the chance to join right as the 🚀 takes off.More About the Role at Infosys 🧐🧐Looking for Data Engineer (elastic data lake) with 4 + years of total IT experience level and with at least 3...
-
Azure Data Engineer
vor 3 Wochen
Melbourne, Österreich Infocentric VollzeitWe are seeking an experienced Azure Data Engineer with expertise in machine learning (ML) and Snowflake.The ideal candidate will have a strong background in designing, developing, and maintaining scalable data solutions on the Azure cloud platform, integrating machine learning models, and working with Snowflake data warehousing solutions.Key...
