Data Engineer
vor 1 Monat
Hybrid and flexible working arrangements
About RDC Rich Data Co (RDC) Delivering the Future of Credit, Today
We believe credit should be accessible, fair, inclusive, and sustainable.
We are passionate about AI and developing new techniques that leverage traditional and non-traditional data to get the right decision in a clear and explainable way.
Global leading financial institutions are leveraging RDC's AI decisioning platform to offer credit in a way that aligns to the customers' needs and expectations.
RDC uses explainable AI to provide banks with deeper insight into borrower behaviour, enabling more accurate and efficient lending decisions to businesses.
Join the Future of Credit Work at a 5-Star Employer of Choice 2023 - RDC was named one of HRD Australia's "best companies to work for in Australia".Join a fast-growing global AI company - Grow your skills, capabilities and gain AI and global experience.High performance team - Work alongside some of the best product teams, data scientists and credit experts in the industry.Vibrant team culture - Join an innovative and agile team who celebrates wins and solves problems together.Work-life balance - Highly flexible working arrangements - work how's right for youFinancial inclusion - Be part of a company that is striving for global financial inclusion and driving the future of credit.About the Role Design, develop, and maintain ETL pipelines using Apache Airflow to ensure efficient and scalable data processing.
Use strong Python programming skills to write clean, maintainable code for data transformation and automation.
Manage data storage, retrieval, and optimization in both RDBMS (e.g., MySQL, PostgreSQL) and NoSQL (e.g., DynamoDB) databases.
Collaborate with cross-functional teams to gather requirements, integrating data from various sources to create comprehensive reports and dashboards.
Ensure scalability, performance, and security in data pipelines and visualizations while working in cloud-based environments.
Here's what a typical day might look like:
Team Stand-Up:
Start your day by participating in an agile stand-up, collaborating with product, sales, and customer support teams to discuss ongoing data engineering and reporting projects.
Data Integration:
Work closely with internal teams to ensure seamless data integration from various sources, optimizing data pipelines to ensure data flows correctly into your dashboards and reports.
Collaboration & Refinement:
Collaborate with stakeholders to gather data requirements and refine report outputs based on feedback.
Participate in agile ceremonies, helping clarify user stories and project timelines.
Learning & Continuous Improvement:
Stay updated on the latest trends in data engineering and dashboard development, focusing on optimizing performance and enhancing the user experience.
Your Skills & Experience You must have:
2+ years of proven experience in Apache Airflow for building and managing data pipelines.
Strong proficiency in Python, with experience in writing efficient and scalable data processing code.
Experience with both RDBMS (e.g., MySQL, PostgreSQL) and NoSQL (e.g., DynamoDB) databases.
Experience with data pipelines or ETL processes, ensuring data is available for dashboards and reports.
Strong SQL skills, with the ability to write complex queries and optimize them for performance.
Experience with data visualization tools such as Power BI, Tableau, or similar platforms.
Excellent communication skills to collaborate with cross-functional teams and translate business requirements into technical designs.
Strong problem-solving skills, with the ability to troubleshoot technical issues and optimize data pipelines and dashboards.
You ideally have:
Experience working in cloud-based environments such as AWS, Azure, or GCP.
Familiarity with API integration for real-time data fetching and interaction.
Experience with agile development methodologies, working within fast-paced, iterative environments.
Knowledge of DevOps practices and CI/CD pipelines.
What's Next? If this sounds like you, get in touch or apply now.
Our Head of Talent and Capability would love to speak with you
Get ready for the #futureofcredit
Please note candidates must have Australian working rights. Posted Date02 Oct 2024
LocationSydney
NSW /Australia
#J-18808-Ljbffr
-
Data Engineer
vor 1 Monat
Sydney, Österreich Rich Data Co. VollzeitHybrid and flexible working arrangementsAbout RDCRich Data Co (RDC) Delivering the Future of Credit, Today! We believe credit should be accessible, fair, inclusive, and sustainable. We are passionate about AI and developing new techniques that leverage traditional and non-traditional data to get the right decision in a clear and explainable way. Global...
-
Data Engineer
vor 1 Tag
Sydney, Österreich Rich Data Co. VollzeitHybrid and flexible working arrangementsAbout RDCRich Data Co (RDC) is delivering the future of credit today! We believe credit should be accessible, fair, inclusive, and sustainable. We are passionate about AI and developing new techniques that leverage traditional and non-traditional data to get the right decision in a clear and explainable way. Global...
-
Data Engineer
vor 13 Stunden
Sydney, Österreich Rich Data Co. VollzeitHybrid and flexible working arrangementsAbout RDC Rich Data Co (RDC) is delivering the future of credit today!We believe credit should be accessible, fair, inclusive, and sustainable.We are passionate about AI and developing new techniques that leverage traditional and non-traditional data to get the right decision in a clear and explainable way.Global...
-
Data Engineer
vor 13 Stunden
Sydney, Österreich Rich Data Co. VollzeitHybrid and flexible working arrangementsAbout RDC Rich Data Co (RDC) is delivering the future of credit today!We believe credit should be accessible, fair, inclusive, and sustainable.We are passionate about AI and developing new techniques that leverage traditional and non-traditional data to get the right decision in a clear and explainable way.Global...
-
Senior Data Engineer
vor 2 Monaten
Sydney, Österreich Cdc Data Centres VollzeitAbout us:Established in 2007, CDC Data Centres is Australia's leading operator of sovereign, secure, world-class data centre facilities.Headquartered in Canberra with multiple facilities in the ACT, NSW and New Zealand, CDC's diversified operations provide secure data centre configurations that support co-location, containerised and hyperscale compute...
-
Data Engineer
vor 4 Wochen
Sydney, Österreich Attribute Group VollzeitData Engineer Permanent $130k-$140k + Super Our client is seeking a seasoned Data Engineer with expertise in the Cloudera Data Platform (CDP) and Spark-based ingestion pipelines.This role is ideal for a professional with a strong background in building and optimising data pipelines and a track record of working with large-scale data infrastructures.Key...
-
Data Engineer
vor 1 Woche
Sydney, Österreich Finxl VollzeitData Engineer Summary: As a Data Engineer, you will work on site with clients to design, implement, and optimise scalable data pipelines and solutions. You'll leverage modern data engineering technologies such as AWS Glue, DBT, Redshift, and Lambda to transform Lion's data ecosystem and support its data-driven decision-making initiatives.Role...
-
Data Engineer
vor 1 Monat
Sydney, Österreich Westpac Group VollzeitData Engineer PermanentSydney, NSWJoin Westpac's Customer Analytics and Insights teamPurpose/Function of Team:The Data Engineer role is part of the Customer Analytics and Insights team within our Corporate & Customer Services (CCS) division.The CCS division supports common operations and customer services for Westpac Group, using customer insights, data, and...
-
Data Engineer
vor 2 Wochen
Sydney, Österreich Randstad VollzeitAbout the companyMy client is a leading and Australian bank headquartered in Sydney. The bank has a portfolio of financial services brands and businesses and provides a broad range of banking and financial services in the Australian market. They have strong customer facing divisions around consumer, banking and institution banking.About the roleAn immense...
-
Data Engineer
vor 1 Monat
Sydney, Österreich West Recruitment Pty Ltd VollzeitCall: West Sector: Technology Job Summary Job Description About Your New EmployerWest Technology is proud to be partnering with a large Australian business that is at the forefront of an industry that is currently being disrupted by new technologies and environmental impact.This business is leading the industry within this space and has invested...
-
Data Engineer
vor 2 Monaten
Sydney, Österreich Westpac Group VollzeitData EngineerPermanentSydney, NSWJoin Westpac's Customer Analytics and Insights teamPurpose/Function of Team:The Data Engineer role is part of the Customer Analytics and Insights team within our Corporate & Customer Services (CCS) division. The CCS division supports common operations and customer services for Westpac Group, using customer insights, data, and...
-
Data Engineer
vor 1 Monat
Sydney, Österreich Westpac Group VollzeitData Engineer Permanent Sydney, NSW Join Westpac's Customer Analytics and Insights team Purpose/Function of Team:The Data Engineer role is part of the Customer Analytics and Insights team within our Corporate & Customer Services (CCS) division. The CCS division supports common operations and customer services for Westpac Group, using customer insights, data,...
-
Ms Engineer
vor 1 Monat
Sydney, Österreich Dimension Data VollzeitMake an impact with NTT DATA Join a company that is pushing the boundaries of what is possible.We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society.Our workplace embraces diversity and inclusion – it's a place where you can grow, belong and thrive. Your day at NTT DATA The Managed...
-
Data Engineer
vor 4 Wochen
Sydney, Österreich Tideri Jobbörse VollzeitSaturday, 26 October 2024 Discover a career where care goes both ways!Based at Macquarie Park, close to Metro Station, WFH Options Permanent Opportunity to join a large internal IT team at a time of growth 7 additional leave days per year + NFP Salary Packaging + Fitness Passport Exciting things are happening at Catholic Healthcare!We've grown to 5500+...
-
Data Engineer
vor 2 Wochen
Sydney, Österreich Tideri Jobbörse VollzeitSaturday, 26 October 2024 Discover a career where care goes both ways!Based atMacquarie Park, close to Metro Station, WFH Options Permanent Opportunityto join a large internal IT team at a time of growth 7 additionalleave days per year + NFP Salary Packaging+ Fitness Passport Exciting things are happening at Catholic Healthcare!We've grown to 5500+ employees...
-
Data Engineer
Vor 5 Tagen
Sydney, Österreich Westpac Group VollzeitData Engineer BI Projects and Change Max Term until October 2025 Barangaroo Head Office Location Hybrid work from office and home Westpac Group is made up of Australia's most recognised financial services brands, including Westpac, St George, Bank of Melbourne, BankSA, BT Financial Group and RAMS.When you join Westpac Group, you will become part of one team...
-
Data Engineer
vor 1 Woche
Sydney, Österreich Westpac Group VollzeitData Engineer BI Projects and Change Max Term until October 2025Barangaroo Head Office LocationHybrid work from office and homeWestpac Group is made up of Australia's most recognised financial services brands, including Westpac, St George, Bank of Melbourne, BankSA, BT Financial Group and RAMS. When you join Westpac Group, you will become part of one team...
-
Data Engineer
vor 2 Monaten
Sydney, Österreich Open Axcss VollzeitThe Data Engineer is responsible for building and supporting the big data platform. As a Data Engineer, your responsibilities include:Develop, test and support future-ready data solutions for customers across industry verticals.Develop, test and support end-to-end batch and near real-time data flows/pipelines.Demonstrate understanding in data architectures,...
-
Data Engineer
vor 3 Wochen
Sydney, Österreich Catholic Healthcare VollzeitSaturday, 26 October 2024Discover a career where care goes both ways!Based at Macquarie Park, close to Metro Station, WFH OptionsPermanent Opportunity to join a large internal IT team at a time of growth7 additional leave days per year + NFP Salary Packaging + Fitness PassportExciting things are happening at Catholic Healthcare!We've grown to 5500+ employees...
-
Data Engineer
vor 4 Wochen
Sydney, Österreich Catholic Healthcare Limited VollzeitSaturday, 26 October 2024Discover a career where care goes both ways!Based at Macquarie Park, close to Metro Station, WFH OptionsPermanent Opportunity to join a large internal IT team at a time of growth7 additional leave days per year + NFP Salary Packaging + Fitness PassportExciting things are happening at Catholic Healthcare!We've grown to 5500+ employees...
