Lead Data Engineer
Vor 2 Tagen
Overview:
Randstad Digital are partnering with a firm in the search for a Technical Lead (Lead Data Engineer) to join their team on a 2 year fixed term basis. Our client is building a new modern data and analytics platform using the Azure Cloud stacks (Azure Data Factory, Azure Databrick and ADLS).
In this transformation, you will play a critical role as the Lead SME in the design, development and implementation of data solutions on Azure Cloud and Azure Databricks in a greenfield environment.
What we are seeking:
We are seeking an experienced candidate with a proven track record in delivering robust, scalable and high quality data solutions on Azure Cloud and Databricks in large, enterprise environments.
With a passion for driving best practices and efficient data systems, you will have technical leadership skills across mentoring a skilled team, driving continuous improvement and aligning a data roadmap into effective project delivery.
Responsbilities:
Design and Development:
Lead the design and implementation of data pipelines, ETL processes and data models on Azure Databricks.
Ensure the adoption of best practices in data engineering, including data quality, optimisation and security
Translate high-level architecture into actionable implementation plans
Implementation & Best Practices:
Ensuring solutions are scalable, reliable and secure along with mentoring team members
Conduct code reviews, design reviews and ensure the team follows best practices in version control, CI/CD and DevOps for data engineering
Collaboration & Communication:
Collaborate with cross-functional teams, including data architects, data modellers, analysts, and IT operations, to ensure seamless integration of data solutions.
Communicate technical concepts to non-technical stakeholders, providing insights and recommendations to drive data-driven decision-making.
Governance Quality:
Ensure data governance, security and quality standards are maintained throughout the data lifecycle
Monitor and support data management initiatives, including within specific environments like Microsoft Azure/Databricks
Key Knowledge and Experience
6+ years of experience in data engineering, with a strong focus on Azure Cloud and Azure Databricks.
Strong understanding of data architecture, data warehousing, data modelling, ETL processes and cloud based technologies.
Demonstrated experience in mentoring technical teams
Proficiency across Python, SQL and Scala
Excellent problem-solving skills and the ability to work under pressure in a fast-paced environment
Strong communication skills, with the ability to interact effectively with technical and non-technical stakeholders
Our client is looking to commence interviews ASAP with the successful candidate to be onboarded this year. For more information and a confidential chat, please reach out immediately to ****** with your updated cv.At Randstad Digital, we are passionate about providing equal employment opportunities and embracing diversity to the benefit of all. We actively encourage applications from any background.
skills
Data Engineering | Azure Cloud | Databricks | Data Platform | Data Warehousing | Data Model
qualifications
Bachelor's or Master's degree in Computer Science
Information Technology
or a related field.
Databricks Certified Data Engineer Associate certification
education
Bachelor Degree
-
Senior Data Engineer
vor 2 Wochen
Brisbane, Österreich Ampersand Ltd VollzeitDatabase Development & Administration (Information & Communication Technology)Salary: $144k + Super + BonusLocation: BrisbaneFlexibility: One day from home per weekPosition Overview:Ampersand are seeking a Data Engineer with strong experience in ETL/ELT pipelines, Azure Databricks, Python, and SQL.As a Senior Data Engineer, you will be deeply involved in...
-
Data Engineer
vor 2 Wochen
Brisbane, Österreich Services Australia VollzeitFull timeServices Australia (the agency) Data Engineer and Technical Information & Knowledge Officers design and implement complex data flows to connect operational systems and data for analytics and business intelligence systems, whilst ensuring data security and governance. They play an important role in resolving and managing issues that impact...
-
Senior Data Engineer
vor 3 Wochen
Brisbane, Österreich Tideri Jobbörse VollzeitDatabase Development & Administration (Information & Communication Technology) We are excited to be partnered with a well-known global brand as they undergo a major data transformation.They are seeking multiple Senior Data Engineers to help evolve their data platform.You'll lead in setting engineering standards and driving key initiatives across business...
-
Data Engineer
vor 2 Wochen
Brisbane, Österreich Services Australia VollzeitFull time Services Australia (the agency) Data Engineer and Technical Information & Knowledge Officers design and implement complex data flows to connect operational systems and data for analytics and business intelligence systems, whilst ensuring data security and governance.They play an important role in resolving and managing issues that impact...
-
Prinicipal Data Engineer
vor 3 Wochen
Brisbane, Österreich Edison Talent VollzeitDatabase Development & Administration (Information & Communication Technology)About the company:Join a leading organisation in the energy sector that powers some of the largest industries and employers. This innovative company is focused on running a successful thermal generation business while evolving into a diversified energy enterprise, exploring new...
-
Desktop Support Engineer
vor 4 Wochen
Brisbane, Österreich Ntt Data, Inc. VollzeitNTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Desktop Support Engineer to join our team in Brisbane, Queensland (AU-QLD), Australia (AU).Role Responsibilities: Acts as a...
-
Desktop Support Engineer
vor 4 Wochen
Brisbane, Österreich Ntt Data, Inc. VollzeitNTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Desktop Support Engineer to join our team in Brisbane, Queensland (AU-QLD), Australia (AU).Role Responsibilities:Acts as a...
-
Desktop Support Engineer
vor 4 Wochen
Brisbane, Österreich Ntt Data, Inc. VollzeitNTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us.If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Desktop Support Engineer to join our team in Brisbane, Queensland (AU-QLD), Australia (AU).Role Responsibilities: Acts as a...
-
Data Engineer
vor 4 Wochen
Brisbane, Österreich Signet VollzeitEngineering - Software (Information & Communication Technology) Drive growth and profitability for a leading B2B manufacturer and distributor of industrial consumablesWork for a market leader & accredited "Great Place to Work"Hybrid work environment and great employee benefitsSignet is a leading Australian-owned B2B manufacturer and distributor of a broad...
-
Data Engineer
vor 4 Wochen
Brisbane, Österreich Cyos Solutions VollzeitApplication closing date: Thursday, 10 October 2024 • 11:59pm, Canberra time (in Canberra)Estimated start date: Tuesday, 29 October 2024Location of work: QLDWorking arrangements: It is the AEC's preference that this role be performed from the Office. Hybrid working arrangements will be considered at the discretion of the Hiring Manager.Length of contract:...
-
Data Engineer
vor 4 Wochen
Brisbane, Österreich Cyos Solutions VollzeitApplication closing date: Thursday, 10 October 2024 • 11:59pm, Canberra time (in Canberra) Estimated start date: Tuesday, 29 October 2024 Location of work: QLD Working arrangements: It is the AEC's preference that this role be performed from the Office.Hybrid working arrangements will be considered at the discretion of the Hiring Manager. Length of...
-
Data Engineer
vor 4 Wochen
Brisbane, Österreich Cyos Solutions VollzeitApplication closing date: Thursday, 10 October 2024 • 11:59pm, Canberra time (in Canberra)Estimated start date: Tuesday, 29 October 2024Location of work: QLDWorking arrangements: It is the AEC's preference that this role be performed from the Office.Hybrid working arrangements will be considered at the discretion of the Hiring Manager.Length of contract:...
-
Data Engineer
vor 4 Wochen
Brisbane, Österreich Cyos Solutions VollzeitApplication closing date: Thursday, 10 October 2024 • 11:59pm, Canberra time (in Canberra)Estimated start date: Tuesday, 29 October 2024Location of work: QLDWorking arrangements: It is the AEC's preference that this role be performed from the Office.Hybrid working arrangements will be considered at the discretion of the Hiring Manager.Length of contract:...
-
Data & Analytics Engineer
vor 4 Wochen
Brisbane, Österreich Clearcompany VollzeitLocation: 8 + 12 months, Canberra or Brisbane Security Clearance: Must have Baseline Security Clearance Technologies: Data Marts, ETL, ELT, Data warehouse Our client, a Federal Government Department focused on democracy, is seeking an experienced Data & Analytics Engineer to join their team ASAP.Responsibilities: Provide quality data warehouse and data mart...
-
Data & Analytics Engineer
vor 4 Wochen
Brisbane, Österreich Clearcompany VollzeitLocation: 8 + 12 months, Canberra or BrisbaneSecurity Clearance: Must have Baseline Security ClearanceTechnologies: Data Marts, ETL, ELT, Data warehouseOur client, a Federal Government Department focused on democracy, is seeking an experienced Data & Analytics Engineer to join their team ASAP.Responsibilities: Provide quality data warehouse and data mart...
-
Data Test Engineer
vor 2 Wochen
Brisbane, Österreich Ampersand International VollzeitTesting & Quality Assurance (Information & Communication Technology)Position: ETL Data Test Engineer – Permanent PositionLocation: Brisbane CBD (4 days in office, 1 day WFH)Salary: $150,675 incl. superannuation + discretionary bonusWe are looking for a highly skilled ETL Data Test Engineer to support data platform and business delivery initiatives. In this...
-
Data Test Engineer
vor 2 Wochen
Brisbane, Österreich Ampersand Ltd VollzeitTesting & Quality Assurance (Information & Communication Technology) Position: ETL Data Test Engineer – Permanent PositionLocation: Brisbane CBD (4 days in office, 1 day WFH)Salary: $150,675 incl.superannuation + discretionary bonusWe are looking for a highly skilled ETL Data Test Engineer to support data platform and business delivery initiatives.In this...
-
Data Test Engineer
vor 2 Wochen
Brisbane, Österreich Compare The Market VollzeitTesting & Quality Assurance (Information & Communication Technology) Full time Compare the Market – yes, the one with the meerkats – is a high-growth FinTech company on a transformational journey.We are focused on designing, building, and delivering the very best home loan, energy, insurance, and health comparison experience in Australia.Okay, in the...
-
Data Test Engineer
vor 1 Woche
Brisbane, Österreich Compare The Market VollzeitTesting & Quality Assurance (Information & Communication Technology)Full timeCompare the Market – yes, the one with the meerkats – is a high-growth FinTech company on a transformational journey. We are focused on designing, building, and delivering the very best home loan, energy, insurance, and health comparison experience in Australia. Okay, in the...
-
Data Test Engineer
vor 2 Wochen
Brisbane, Österreich Tideri Jobbörse VollzeitTesting & Quality Assurance (Information & Communication Technology) Position: ETL Data Test Engineer – Permanent Position Location: Brisbane CBD (4 days in office, 1 day WFH) Salary: $150,675 incl.superannuation + discretionary bonus We are looking for a highly skilled ETL Data Test Engineer to support data platform and business delivery initiatives.In...
