Principal Data Engineer
Vor 3 Tagen
Company DescriptionAt Neilson, we're reimagining the future of data-driven insights with our pioneering division,DataWorks.
As a cutting-edge division within the Neilson Group, DataWorks harnesses the latest advancements in AI, machine learning, and predictive analytics to empower growth across diverse markets and deliver next-generation solutions in Business Intelligence, Analytics, Data Science, and Actuarial science.
Our team, based in the UK and Australia, is at the forefront of digital transformation, using data to unlock powerful insights and drive competitive advantage on a global scale.As part of a vibrant and forward-thinking environment, DataWorks combines the agility and innovation of a high-tech AI startup with the backing of a trusted, established provider.
We develop sophisticated solutions with the latest in time-series forecasting, large language models (LLMs), and advanced machine learning, pushing the boundaries of what's possible in analytics.
Recognized for excellence in customer service, we're committed to delivering a high-quality, fully integrated experience for our clients and partners worldwide.We are seeking a highly technical Principal Data Engineer to define and drive our enterprise-wide data architecture and technical vision.
In this role, you will architect scalable data solutions, establish technical standards, and lead the implementation of our next-generation data platform across the organization.
This is a hands-on role requiring deep technical expertise with cutting-edge data tools within Microsoft's suite and beyond.
You will make key architectural decisions that shape our data infrastructure strategy while actively coding and implementing solutions.Reporting directly to the Head of Data & Analytics with a dotted line to the Group Chief Commercial Officer, you will design distributed systems, create technical frameworks, and establish best practices that enable seamless data flows across our global organization.
This position currently has 2 reports and you will be expected to foster a collaborative and high-performing environment while maintaining significant technical contribution.Job DescriptionKey Responsibilities:Design and implement the enterprise-wide data architecture strategy, including hands-on development of proof-of-concepts for new technologies and frameworksArchitect and actively develop complex distributed systems that can scale across multiple regions and handle diverse data workloadsDevelop, manage, and optimize ETL processes using Azure Data Factory to ensure accurate data integration across global databasesDesign, build, and maintain Microsoft SQL Server databases, ensuring data is well-organized, accessible, and secureLead by example through hands-on development and implementation of advanced data processing frameworks that can be reused across multiple teamsDefine technical standards and best practices for data engineering across the organization through practical implementation and documentationEvaluate emerging technologies through proof-of-concept development and make recommendations for adoption or retirement of data technologiesIdentify and implement performance optimization strategies for ETL processes and reports to ensure optimal user experienceMonitor and troubleshoot complex data processes to ensure uninterrupted service to global teams, including working occasionally outside regular business hours to support multiple time zonesCreate and maintain comprehensive technical documentation, architectural diagrams, and best practicesEnsure data governance and compliance principles are maintained across all architectural decisionsCommunicate technical information to non-technical stakeholders effectively, tailoring the messaging as needed for diverse audiencesMentor and guide team members in technical best practices and architectural principlesCollaborate effectively with cross-functional teams, including data scientists, analysts, and business stakeholdersRequired Technical Skills:Expert-level proficiency in SQL and database optimization techniquesDeep practical experience with Data Warehousing using Kimball and STAR schemaStrong coding abilities in at least one programming language (Python, Java, or C#)Hands-on experience with distributed computing frameworksPractical experience implementing data streaming solutionsExpert knowledge of performance tuning and optimization techniquesQualificationsQualifications:Bachelor's or Master's degree in Computer Science, Software Engineering, or related technical fieldSignificant,demonstrable hands-on data engineering experience, with at least 5 years in architectural roles preferablyProven experience as a Principal or Senior Data Engineer, with a focus on Microsoft SQL Server, Azure Data Factory, Power Automate and Power BIDemonstrated track record of designing and implementing large-scale distributed data systemsExperience creating and implementing technical frameworks adopted by multiple teamsStrong background in systems design, including handling complex data processing at scaleExperience evaluating and implementing emerging technologies in production environmentsLeadership experience, with a focus on mentoring and coaching team membersStrong problem-solving and troubleshooting skills with a hands-on approachExcellent communication and collaboration skillsWilling to work flexible hours to support a global businessWhat Sets You Apart:Contributions to open-source projects or internal shared librariesExperience with real-time data processing and streaming architecturesTrack record of solving complex technical challenges at scaleHistory of successful technical mentorshipExperience working in a global, distributed team environmentAdditional InformationWhy Join Us:Work in a dynamic and innovative team driving real business impact.Opportunities for professional growth and development in a leadership role.Collaborative culture and cross-functional engagement with various teams and stakeholders.
#J-18808-Ljbffr
-
Principal Data Engineer
vor 5 Stunden
Sydney, Österreich Recmatrix Consulting VollzeitJob Title: Principal Data EngineerLocation: Sydney Role: Fulltime/Contract/FixedTermPurpose of the Role:The Principal Data Engineer will lead the Data Engineering strategy and delivery across global projects and products.This role ensures the Data Engineering function operates as a unified team, promotes technical excellence, adheres to key principles, and...
-
Principal Data Engineer
vor 1 Woche
Sydney, Österreich This Is An It Support Group VollzeitCompany Description At Neilson, we're reimagining the future of data-driven insights with our pioneering division, DataWorks.As a cutting-edge division within the Neilson Group, DataWorks harnesses the latest advancements in AI, machine learning, and predictive analytics to empower growth across diverse markets and deliver next-generation solutions in...
-
Principal Data Engineer
vor 1 Woche
Sydney, Österreich This Is An It Support Group VollzeitCompany DescriptionAt Neilson, we're reimagining the future of data-driven insights with our pioneering division, DataWorks.As a cutting-edge division within the Neilson Group, DataWorks harnesses the latest advancements in AI, machine learning, and predictive analytics to empower growth across diverse markets and deliver next-generation solutions in...
-
Principal Engineer
vor 2 Wochen
Sydney, Österreich Qantas Airlines VollzeitThe Principal Engineer is a technical leadership role, responsible for driving technical outcomes of the team and advising and supporting best practices across the business within flight operations, airline, and mobile technologies.The Principal Software Engineer will have mastered the fundamentals of software development, from problem exploration and...
-
Principal Engineer
vor 2 Wochen
Sydney, Österreich Qantas Airlines VollzeitThe Principal Engineer is a technical leadership role, responsible for driving technical outcomes of the team and advising and supporting best practices across the business within flight operations, airline, and mobile technologies.The Principal Software Engineer will have mastered the fundamentals of software development, from problem exploration and...
-
Principal Engineer
vor 4 Wochen
Sydney, Österreich Westpac VollzeitPrincipal EngineerJob Description Principal Engineer - 52620 PermanentSydney How will I help?Working within Technology, Westpac Institution Banking (WIB) on the highly strategic Westpac One Core cash management project, the Principal Engineer function plays an important role in the development of a new portal/api, application, data and security platform for...
-
Qantas Airlines | Principal Engineer
vor 2 Wochen
Sydney, Österreich Tideri Jobbörse VollzeitThe Principal Engineer is a technical leadership role, responsible for driving technical outcomes of the team and advising and supporting best practices across the business within flight operations, airline, and mobile technologies.The Principal Software Engineer will have mastered the fundamentals of software development, from problem exploration and...
-
Principal Engineer
vor 1 Monat
Sydney, Österreich Insurance Australia Group Limited VollzeitMake a difference as a Principal Engineer.Join the largest general insurance group in Australia and New Zealand.Your Role Are you passionate about driving engineering excellence and shaping the future of technology? At IAG, we are on a mission to make the world a safer place, and we need a visionary Principal Engineer to join our dynamic team. If you thrive...
-
Principal Engineer
vor 4 Wochen
Sydney, Österreich Westpac VollzeitPrincipal EngineerJob DescriptionPrincipal Engineer - 52620PermanentSydneyHow will I help?Working within Technology, Westpac Institution Banking (WIB) on the highly strategic Westpac One Core cash management project, the Principal Engineer function plays an important role in the development of a new portal/api, application, data and security platform for the...
-
Principal Engineer
vor 1 Woche
Sydney, Österreich Westpac Group VollzeitPrincipal Engineer – 52620PermanentSydneyHow will I help?Working within Technology, Westpac Institution Banking (WIB) on the highly strategic Westpac One Core cash management project, the Principal Engineer function plays an important role in the development of a new portal/api, application, data and security platform for the banks Corporate and...
-
Westpac | Principal Engineer
vor 4 Wochen
Sydney, Österreich Tideri Jobbörse VollzeitPrincipal Engineer Job DescriptionPrincipal Engineer - 52620Permanent Sydney How will I help?Working within Technology, Westpac Institution Banking (WIB) on the highly strategic Westpac One Core cash management project, the Principal Engineer function plays an important role in the development of a new portal/api, application, data and security platform for...
-
Principal Civil Engineer
vor 2 Monaten
Sydney, Österreich Tideri Jobbörse VollzeitPrincipal Civil Engineer .Rare career opportunity.Brisbane CBD / Gold Coast / Sunshine Coast.Large international Engineering Consultancy.About the company Principal Civil Engineer to join a large, international Engineering Consultancy with multidisciplinary services across Australia and globally.They have offices in multiple locations across Australia and...
-
Principal Engineer
vor 4 Wochen
Sydney, Österreich Qantas VollzeitAbout Us Founded in the Queensland outback in 1920, Qantas has grown to be Australia's largest regional, domestic, and international airline.Qantas has a range of subsidiary businesses that support the overall operations of the Group.The Qantas Group's main business is the transportation of customers and freight using two complementary airline brands —...
-
Principal Engineer
vor 4 Stunden
Sydney, Österreich Motion Recruitment VollzeitAdd expected salary to your profile for insights.We're currently on the lookout for a Principal Engineer on behalf of our client as they grow their team and lead the transformation of their core systems to a modern, cloud-native platform.As a Principal Engineer, you'll be responsible for driving the architectural direction of the system modernization,...
-
Principal Engineer
vor 4 Wochen
Sydney, Österreich Qantas VollzeitAbout UsFounded in the Queensland outback in 1920, Qantas has grown to be Australia's largest regional, domestic, and international airline. Qantas has a range of subsidiary businesses that support the overall operations of the Group. The Qantas Group's main business is the transportation of customers and freight using two complementary airline brands —...
-
Data Engineer
vor 2 Monaten
Sydney, Österreich Rich Data Co. VollzeitHybrid and flexible working arrangementsAbout RDCRich Data Co (RDC) is delivering the future of credit today! We believe credit should be accessible, fair, inclusive, and sustainable. We are passionate about AI and developing new techniques that leverage traditional and non-traditional data to get the right decision in a clear and explainable way. Global...
-
Data Engineer
vor 2 Monaten
Sydney, Österreich Rich Data Co. VollzeitHybrid and flexible working arrangementsAbout RDC Rich Data Co (RDC) is delivering the future of credit today!We believe credit should be accessible, fair, inclusive, and sustainable.We are passionate about AI and developing new techniques that leverage traditional and non-traditional data to get the right decision in a clear and explainable way.Global...
-
Data Engineer
vor 2 Monaten
Sydney, Österreich Rich Data Co. VollzeitHybrid and flexible working arrangementsAbout RDC Rich Data Co (RDC) is delivering the future of credit today!We believe credit should be accessible, fair, inclusive, and sustainable.We are passionate about AI and developing new techniques that leverage traditional and non-traditional data to get the right decision in a clear and explainable way.Global...
-
Principal Engineer
vor 2 Wochen
Sydney, Österreich Qantas VollzeitAbout UsFounded in the Queensland outback in 1920, Qantas has grown to be Australia's largest regional, domestic, and international airline.Qantas has a range of subsidiary businesses that support the overall operations of the Group.The Qantas Group's main business is the transportation of customers and freight using two complementary airline brands —...
-
Principal Engineer
Vor 3 Tagen
Sydney, Österreich Qantas VollzeitBusiness Function: Information TechnologyParent Business Function: Digital, IT & AnalyticsTime Type: Full timeWorker Sub-Type: PermanentCompany DescriptionAbout UsFounded in the Queensland outback in 1920, Qantas has grown to be Australia's largest regional, domestic, and international airline.Qantas has a range of subsidiary businesses that support the...
