Address
Form of work#S-DNI
About the Company
Compare the Market, yep, the one with the meerkats, is on an exciting growth trajectory and we are inviting talented Senior Data Engineers to join us in making a significant impact on the lives of people all over Australia.
At CTM, you won't just be an employee; you'll be a crucial part of our mission to empower our customers to make informed purchasing decisions across various insurance, finance, and household product categories; thereby improving and simplifying their lives, while saving them time, effort, and money.
We are all about Integrity, Growth, Excellent Customer Service, and being Peerless - without compromise.
About the Role
As CTM continues to enhance our modern data platform (Databricks/AWS), we want to ensure we can best service our analytical use-cases and drive value for the business. Reporting to the Head of Data Science, you will have the opportunity to establish foundational engineering principles and provide technical leadership to support our business intelligence, data science, and machine learning practices.
As a Senior Data Engineer, in addition to your strong hands-on development experience, you’ll be able to provide guidance around architecture and solution design. You will contribute to the data strategy from an engineering perspective and help the broader team in the development of the data platform and overall ecosystem. You will work within and be supported by a great team that includes data scientists, business intelligence developers, Data Engineers, data architects, data modellers, and business analysts, in addition to the broader IT and business teams.
What you’ll do
- Work with data producers, data consumers, and other supporting roles to ensure data is well managed for consumption.
- Build, maintain, and optimize high quality data pipelines for serving analytics use-cases, including business intelligence and machine learning.
- Work with architects to develop architectural patterns for data pipelines, including for event based real-time processing.
- Support the development and implementation of Data Engineering roadmap.
- Champion best practices for data management and data governance. This includes data modelling; ETL and processing performance; data quality, observability, and discoverability; security and sensitive data handling; and codebase quality.
What you’ll bring
- 5+ years of experience as a professional Data Engineer or analytics engineer, developing ETL pipelines for production environments.
- Solid experience building analytical data pipelines in cloud systems.
- Solid data management experience covering data modelling, data quality monitoring, maintaining data dictionaries, row/column level security, sensitive data masking or tokenization, and access controls.
- Ability to write high quality code for data pipelines, preferably in Python.
- Excellent SQL skills.
- Experience with CI/CD and Infrastructure as Code builds.
- Experience providing Data Engineering leadership and mentorship.
- Solid written and verbal communication skills.
- Highly Regarded:
- Experience developing on Databricks and/or using Spark or PySpark.
- Experience building robust feature stores with batch and streaming data for use by machine learning models.
- Experience building highly automated metadata driven solutions.
What we enjoy at Compare the Market
Whether we're writing a single line of code or capturing requirements, our dedication to our customers is unwavering, and is at the very heart of all we do.
At CTM, our workplace is both diverse and inclusive, and we cultivate a culture that is collaborative and innovative within our close-knit teams. We are a “work from the office” company as we believe that performance, culture, innovation and collaboration are at their best when we’re working together in person.
If you are a high-performing individual, with a passion for problem-solving and a desire to make a positive difference, we encourage you to apply. Your expertise, combined with our supportive environment and exciting growth prospects, can create a successful and fulfilling career at Compare the Market, where you will enjoy:
- City fringe location - close to public transport, street parking, and the riverwalk.
- Compare the Market is launching a 9-day fortnight trial in January 2024. This program is designed to offer employees greater flexibility in their work schedules while maintaining business performance and ensuring a healthy work-life balance. In summary participants will work additional hours across the 9 working days to access every second Friday off. Your role will be eligible to participate in this trial if it suits your circumstances.
- We have vibrant social and community activities including annual celebrations, family fun days and regular events across each of our sites.
- Enjoy additional leave days - ‘ME’ leave and ‘Volunteer Day’ leave.
- Employee discounts on Car, Home, Travel insurance plus discounts with a broad range of providers, including gym memberships, accommodation, dental care and more.
- Income protection insurance provided to support you in the event of non-work related illness or injury.
- Access to the Employee Assistance Program
Compare the Market is an Equal Opportunity Employer. We acknowledge that we are strengthened by diversity, and we encourage all applicants to apply who have the right to live and work in Australia.
Intrigued? Don't limit yourself. Apply now … it’s Simples!!
*Note to Recruiters: We politely ask that you avoid any approaches or sending unsolicited resumes to our recruitment team and hiring leaders across our business.
