Senior Data Engineer
vor 2 Wochen
Role overview:
You will be joining one of Australia's largest financial institutions, within the fastest paced financial markets area of the business. Working as part of a new team of highly skilled engineers, you will be working on building a new regulatory audit response capability, building controls around validating rates in trading.
As a Senior Data Engineer, you will play a crucial role in developing and maintaining the data infrastructure, ensuring the seamless integration and analysis of vast amounts of data. Your expertise will directly contribute to market-leading strategies and decision-making processes.
Day to day you will...
- Develop and maintain scalable, reliable, and secure data pipelines and architectures.
- Design, implement, and optimize complex SQL queries and Data Definition Language (DDL) operations.
- Utilize your strong hands-on coding ability in Python to build robust data solutions.
- Deploy and manage applications in a clustered environment using Docker and Kubernetes.
- Leverage AWS services to enhance our data processing and storage capabilities.
- Ensure seamless integration with modern systems through API-based solutions.
- Query and analyze big data using tools such as Redshift, Hive, Spark, and Presto.
- Implement and manage data pipeline orchestration tools like Airflow or Argo Workflows.
- Utilize source control tools like Bitbucket to manage and collaborate on codebase effectively.
- Apply your knowledge of Linux/Unix systems to maintain and optimize our data infrastructure.
We are looking for...
- 7+ years of hands on Python coding experience working on complex applications
- Experience querying big data with tools like Redshift, Hive, Spark, and Presto, orchestrating data pipelines with Airflow or Argo Workflows
- Strong SQL experience, authoring complex queries and Data Definition Language (DDL)
- Experience within Linux/Unix environments
- Experience working in cloud environments, ideally AWS
- Experience with CI/CD tools
- Working knowledge of DevOps principals and best practices
** AU PR or Citizenship candidates only**
** Sydney based candidates only, Hybrid model (3 days a week in CBD office) **
Sound like an interesting next move, and have the skills to suit? Apply now
Desired Skills and ExperiencePython
Redshift, Hive, Spark, and Presto
Airflow or Argo Workflows
SQL
DDL
Linux/Unix
AWS Cloud
CI/CD - Bamboo
DevOps - Kubernetes
#J-18808-Ljbffr
-
Senior Data Engineer
vor 4 Wochen
Sydney, Österreich ClearCompany VollzeitSenior Data Engineer Sydney, Australia 6 Months (Intially) $970pd Inc Super We are seeking a highly skilled and experienced Azure Senior Data Engineer to join a leading insurance business based in Sydney. As an Azure Senior Data Engineer, you will play a critical role in designing and building ETL processes for their data warehouse, utilizing your...
-
Senior Data Engineer
vor 4 Wochen
Sydney, Österreich ClearCompany VollzeitSenior Data Engineer Sydney, Australia 6 Months (Intially) $970pd Inc Super We are seeking a highly skilled and experienced Azure Senior Data Engineer to join a leading insurance business based in Sydney. As an Azure Senior Data Engineer, you will play a critical role in designing and building ETL processes for their data warehouse, utilizing your...
-
Senior Data Engineer
vor 4 Wochen
Sydney, Österreich Talenza VollzeitOther (Information & Communication Technology) We are seeking a highly skilled and experienced Azure Senior Data Engineer to join a leading insurance business based in Sydney. As an Azure Senior Data Engineer, you will play a critical role in designing and building ETL processes for their data warehouse, utilizing your expertise in Databricks and Python...
-
Senior Data Engineer
vor 4 Wochen
Sydney, Österreich Talenza VollzeitOther (Information & Communication Technology) We are seeking a highly skilled and experienced Azure Senior Data Engineer to join a leading insurance business based in Sydney. As an Azure Senior Data Engineer, you will play a critical role in designing and building ETL processes for their data warehouse, utilizing your expertise in Databricks and Python...
-
Senior Data Engineer
vor 3 Wochen
Sydney, Österreich ClearCompany VollzeitBusiness facing role for an accomplished Senior Data Engineer within the Financial Services industry About our client: Our client is an instantly recognisable household name within the Financial Services industry. In recent years they have led the way in the creation of wealth management products and services for their customers. Due to this expansion in...
-
Senior Data Engineer
vor 2 Monaten
Sydney, Österreich https:www.bebee.comjoin VollzeitSenior Data Engineer - CREQ183850 Description ETL Dev and Testing Teradata Scala Python SQL Selenium Test automation Datawarehousing / BI experience Spark Hadoop / Big Data / HDFS Cloud migration experience AWS Cloud experience Primary Location Sydney, New South Wales, Australia Job Type Experienced Primary Skills Snowflake Years of...
-
Senior Data Engineer
vor 4 Wochen
Sydney, Österreich https:www.bebee.comjoin VollzeitSenior Data Engineer - CREQ183850 Description ETL Dev and Testing Teradata Scala Python SQL Selenium Test automation Datawarehousing / BI experience Spark Hadoop / Big Data / HDFS Cloud migration experience AWS Cloud experience Primary Location Sydney, New South Wales, Australia Job Type Experienced Primary Skills Snowflake Years of...
-
Senior Data Engineer
vor 1 Monat
Sydney, Österreich Tinybeans Pty Limited VollzeitTinybeans is a leading private photo-sharing app that connects families and turns moments into memories. We’re loved and trusted by millions of parents and families around the world since our founding in 2012, which is why we’ve got more than 150,000 5-star reviews in the Apple App and Google Play stores and users in almost every country in the world....
-
Senior Data Engineer
vor 4 Wochen
Sydney, Österreich Tinybeans Pty Limited VollzeitTinybeans is a leading private photo-sharing app that connects families and turns moments into memories. We’re loved and trusted by millions of parents and families around the world since our founding in 2012, which is why we’ve got more than 150,000 5-star reviews in the Apple App and Google Play stores and users in almost every country in the world....
-
Senior Data Engineer
vor 1 Monat
Sydney, Österreich Quantexa Limited VollzeitFounded in 2016 with only a handful of individuals, Quantexa was built with a purpose that through a greater understanding of context, better decisions can be made. 8 years, 15 locations and 700+ employees later we still believe that today. We connect the dots within our Customers data using dynamic entity resolution and advanced network analytics to create...
-
Senior Data Engineer
vor 4 Wochen
Sydney, Österreich Quantexa Limited VollzeitFounded in 2016 with only a handful of individuals, Quantexa was built with a purpose that through a greater understanding of context, better decisions can be made. 8 years, 15 locations and 700+ employees later we still believe that today. We connect the dots within our Customers data using dynamic entity resolution and advanced network analytics to create...
-
Senior Data Modeller/Engineer
vor 3 Wochen
Sydney, Österreich ClearCompany VollzeitRole: Senior Data Modeller/Engineer Daily Rate: $1100 - $1150 + Super Contract Length: 6 months Locations: Sydney/WFH As Senior Report Developer/Engineer, you'll be responsible for understanding data and transforming it into business value for stakeholders to meet business needs in accordance with strategic outcomes for our NSW Energy client.You will...
-
Senior Data Modeller/Engineer
vor 2 Wochen
Sydney, Österreich Talenza Pty Limited. VollzeitRole: Senior Data Modeller/Engineer Daily Rate: $1100 - $1150 + Super Contract Length: 6 months Locations: Sydney/WFH As Senior Report Developer/Engineer, you'll be responsible for understanding data and transforming it into business value for stakeholders to meet business needs in accordance with strategic outcomes for our NSW Energy client.You will provide...
-
Senior Software Engineer
Vor 6 Tagen
Sydney, Österreich ING Bank N.V. VollzeitData is one of the five building blocks of ING’s “Accelerated Think Forward” strategy and COO vision to become the Next Generation Digital Bank on the road of transformation.As a Senior Data Engineer, you will be responsible for designing and implementing data ingestion pipelines from multiple sources using Azure Synapse. Developing scalable and...
-
Senior Data Engineer
vor 1 Woche
Sydney, Österreich Lion Pty Ltd VollzeitPress Tab to Move to Skip to Content Link Select how often (in days) to receive an alert: Create Alert Don’t settle for ordinary – we welcome those on the hunt for more! At Lion, we believe that life is short and working in Growth just feels different when you sit at the heart of human connection and good times. So put a spark back in your...
-
Senior Data Engineer
Vor 6 Tagen
Sydney, Österreich Lion Inc VollzeitDon’t settle for ordinary – we welcome those on the hunt for more! At Lion, we believe that life is short and working in Growth just feels different when you sit at the heart of human connection and good times. So put a spark back in your day, working in an exciting industry as unique as you and with outstanding brands that those around you know and love...
-
Senior Data Engineer
vor 1 Woche
Sydney, Österreich TrooCoo VollzeitEngineering - Software (Information & Communication Technology) Full time Add expected salary to your profile for insights About our client:Our client is an iconic Australian brand within the Technology industry. As an organisation, they have gone through an impressive period of growth and are the market leaders in their niche area of hardware...
-
Senior Data Engineer
vor 1 Woche
Sydney, Österreich NobleOak VollzeitDevelopers/Programmers (Information & Communication Technology) We are seeking a highly skilled and experienced Senior Data Engineer to join our dynamic data team. As the most senior data engineer, you will play a pivotal role in supporting the Data Lead to build and maintain the infrastructure that enables the creation and distribution of insights and...
-
Sydney, Österreich eFinancialCareers Ltd. VollzeitSenior Data Engineer – Python, SQL, Optimization, Cloud, Trading Firm - Sydney Westbury Partners Sydney, Australia Senior Data Engineer – Python, SQL, Optimization, Cloud, Trading Firm - Sydney Westbury Partners Sydney, Australia Posted 3 days ago Hybrid Job Permanent AUD165k - AUD190k Design, Implement, Maintain, Optimise Data...
-
Senior Data Engineer
vor 2 Monaten
Sydney, Österreich Technology People Group VollzeitWe are seeking highly skilled and motivated Data Engineers to join our client who are in financial domain. As a Data Engineer, you will play a critical role in designing, implementing, and maintaining their data infrastructure. Your expertise in Snowflake, Redshift, AWS, CloudFormation, Python, and SQL will be instrumental in shaping their data...
