Senior Data Engineer
Vor 2 Tagen
You will be joining one of Australia's largest financial institutions, within the fastest paced financial markets area of the business. Working as part of a new team of highly skilled engineers, you will be working on building a new regulatory audit response capability, building controls around validating rates in trading.
As a Senior Data Engineer, you will play a crucial role in developing and maintaining the data infrastructure, ensuring the seamless integration and analysis of vast amounts of data. Your expertise will directly contribute to market-leading strategies and decision-making processes.
Day to day you will...
- Develop and maintain scalable, reliable, and secure data pipelines and architectures.
- Design, implement, and optimize complex SQL queries and Data Definition Language (DDL) operations.
- Utilize your strong hands-on coding ability in Python to build robust data solutions.
- Deploy and manage applications in a clustered environment using Docker and Kubernetes.
- Leverage AWS services to enhance our data processing and storage capabilities.
- Ensure seamless integration with modern systems through API-based solutions.
- Query and analyze big data using tools such as Redshift, Hive, Spark, and Presto.
- Implement and manage data pipeline orchestration tools like Airflow or Argo Workflows.
- Utilize source control tools like Bitbucket to manage and collaborate on codebase effectively.
- Apply your knowledge of Linux/Unix systems to maintain and optimize our data infrastructure.
- 7+ years of hands on Python coding experience working on complex applications
- Experience querying big data with tools like Redshift, Hive, Spark, and Presto, orchestrating data pipelines with Airflow or Argo Workflows
- Strong SQL experience, authoring complex queries and Data Definition Language (DDL)
- Experience within Linux/Unix environments
- Experience working in cloud environments, ideally AWS
- Experience with CI/CD tools
- Working knowledge of DevOps principals and best practices
- AU PR or Citizenship candidates only**
- Sydney based candidates only, Hybrid model (3 days a week in CBD office) **
-
Senior Data Engineer
Vor 2 Tagen
Brisbane City, Österreich Motion Recruitment VollzeitEngineering - Software (Information & Communication Technology) Full time Add expected salary to your profile for insights Currently working with a company that is seeking a highly skilled and experienced Senior Azure Data Engineer. This pivotal role involves designing, developing, and deploying advanced data pipelines to a lake house platform,...
-
Senior Data Engineer
vor 3 Wochen
Brisbane City, Österreich Blackroc VollzeitBLACKROC are seeking a Senior Data Engineer for a global technology business who will play a crucial role in designing, building, and optimising data infrastructures, collaborating with senior stakeholders and mentoring team members.You'll be joining a newly formed team charged with owning, operating and improving mission-critical data infrastructure that's...
-
Senior Data Engineer
vor 4 Wochen
Brisbane City, Österreich HTK VollzeitSelect how often (in days) to receive an alert: This is a full-time position with hybrid working arrangement (1-2 days in office) Role OverviewWe are passionate about harnessing the power of data to drive innovation and empower businesses. We are seeking a highly technical and experienced Senior Data Engineer to join our dynamic team. The successful...
-
Senior Data Engineer
vor 4 Wochen
Brisbane City, Österreich Compare the Market VollzeitEngineering - Software (Information & Communication Technology) Full time Add expected salary to your profile for insights This job ad is the universe’s way of telling you that you’re currently in the wrong job.Compare the Market – yes, the one with the meerkats – is a high-growth FinTech company on a transformational journey. We are focused...
-
Senior Data Engineer
Vor 5 Tagen
Brisbane City, Österreich The State of Queensland VollzeitTransport and Main Roads (Organisation site ) Structures; Engineering & Technology; Infrastructure Management and Delivery; Brisbane An exciting opportunity has become available for a high performing individual to join the Engineering & Technology branch of Transport and Main Roads (TMR) in the role of Senior Data Engineer. TMR is an organisation which...
-
Senior Network Engineer
vor 2 Wochen
Brisbane City, Österreich Data#3 VollzeitFull time Add expected salary to your profile for insights Join our high performing, and expanding Managed Services TeamBrisbane based – hybrid working modelEmployer of Choice – 9 years in a row!Data#3 Managed Services team is growing! And we are looking for an experienced Senior Network Engineer to join our team based in Brisbane.Why do we want...
-
Senior Data Engineer
vor 1 Monat
Brisbane City, Österreich HTK VollzeitPress Tab to Move to Skip to Content Link Select how often (in days) to receive an alert: Select how often (in days) to receive an alert: This is a Full-time position with a Hybrid working model.About Console ConnectConnecting networks, clouds and businesses, Console Connect by PCCW Global is dedicated to helping organizations overcome the...
-
Senior Data Engineer
vor 4 Wochen
Brisbane City, Österreich HTK VollzeitPress Tab to Move to Skip to Content Link Select how often (in days) to receive an alert: Select how often (in days) to receive an alert: This is a Full-time position with a Hybrid working model.About Console ConnectConnecting networks, clouds and businesses, Console Connect by PCCW Global is dedicated to helping organizations overcome the...
-
Senior data engineer
vor 3 Wochen
City of Boroondara, Österreich Coles Supply Chain VollzeitWe've been trusted to serve Aussie communities since 1914 and grown to become a top 30-listed on the ASX with 120,000 team members and a portfolio of iconic brands. At Coles Group, you'll not only get to make a difference to millions of Aussie lives-you'll also get to see your impact.Senior Data Engineer (122144)Want to discover opportunities that challenge...
-
Senior Data Engineer
vor 4 Wochen
Brisbane City, Österreich Michael Page Australia VollzeitAbout Our Client This globally recognised organisation is an industry leader, founded on over a century of history. With over 8000 staff globally, they are well on their way to transforming the business into a leading Digital and Data led organisation by 2025.A large part of this is building upon and enhancing their newly created Global Azure Data Platform,...
-
Senior Data Architect
vor 1 Woche
Brisbane City, Österreich CQMS Razer VollzeitSee more about the role below, including the responsibilities and skills we are looking for. Senior Data Architect Brisbane, Australia Reference: 6614117 Radical flexibility Ability to purchase annual leave Your birthday off Flexible public holidays Lead the charge in revolutionizing IoT data consumption as a Senior Data Architect at CR...
-
Data Engineer
vor 1 Monat
Brisbane City, Österreich ClearCompany VollzeitAbout the role As a Data Engineer, you will play a key role supporting digital projects that support operational challenges that are currently being addressed through manual methods. Responsibilities Define the data lifecycle (including data models and data sources for analytics / ML platforms), and to gather and clean business data from the business in...
-
Data Engineer
vor 4 Wochen
Brisbane City, Österreich ClearCompany VollzeitAbout the role As a Data Engineer, you will play a key role supporting digital projects that support operational challenges that are currently being addressed through manual methods. Responsibilities Define the data lifecycle (including data models and data sources for analytics / ML platforms), and to gather and clean business data from the business in...
-
Senior Data Engineer
vor 3 Wochen
Brisbane City, Österreich HUMANISED GROUP VollzeitAre you a skilled Data Engineer/Developer looking for an exciting opportunity in the energy sector? Join our client’s dynamic project team and be part of a transformation with significant impact!12 month contract position.Located right here in Brisbane’s CBD.Hybrid working arrangement.As the sole technical member in a team of 3-4, you’ll collaborate...
-
Senior Azure Data Engineer
vor 4 Wochen
Brisbane City, Österreich StudentUniverse VollzeitUpdate your details, view your application and progress >> Login Job search Job search e.g. "Administrator, Melbourne" Refine searchWork type Full time 1 Region Australia 1 Location Australia Queensland 1 Brand Product and Technology 1 Category Apply now Job no: 521008JJ Brand: Product and TechnologyWork type: Full time Location: Queensland...
-
Senior Azure Data Engineer
vor 4 Wochen
Brisbane City, Österreich StudentUniverse VollzeitUpdate your details, view your application and progress >> Login Job search Job search e.g. "Administrator, Melbourne" Refine searchWork type Full time 1 Region Australia 1 Location Australia Queensland 1 Brand Product and Technology 1 Category Apply now Job no: 521008JJ Brand: Product and TechnologyWork type: Full time Location: Queensland...
-
Data Engineer
Vor 5 Tagen
Brisbane City, Österreich Talenza Pty Limited. VollzeitTalenza's client, a leading superannuation company with offices Australia wide, is looking for a Data engineer to support them in defining solutions for clients in various industries, working with cutting edge technology to meet the clients' objectives.Essential Requirements+- 5 years in a Data Engineering roleRequirements GatheringData ProfilingSource to...
-
Senior Software Engineer
vor 3 Wochen
Brisbane City, Österreich HTK VollzeitSelect how often (in days) to receive an alert: Senior Software Engineer PCCW Global is a leading international communications service provider, offering the latest mobility, voice and data solutions to multinational enterprises, telecommunications partners, cloud and application service providers. With a network footprint reaching over 3,000 cities...
-
Data Engineer
vor 3 Wochen
Brisbane City, Österreich UnitingCare Queensland VollzeitEngineering - Software (Information & Communication Technology) Full time Add expected salary to your profile for insights We are seeking a Data Engineer to join our Digital Platforms team. Reporting to the Digital Platforms Manager, the Data Engineer will be responsible for gathering, analysing, managing and preparing technical data within the...
-
Senior Data Analyst
vor 3 Wochen
Brisbane City, Österreich The State of Queensland VollzeitEmployment, Small Business and Training (Organisation site ) Business Intelligence and Customer Reporting; Data and Analytics; Strategy; Brisbane City Working closely with the Manager, Business Intelligence and Customer Reporting (BICR), the Senior Data Analyst is responsible for contributing to the maintenance, development and implementation of various...