Senior Data Engineer

Are you interested in joining the dream team at Wesfarmers OneDigital?

Good call. We’re an exciting new digital enterprise with big ideas, supporting some of Australia’s most trusted and iconic brands focussed on making lives better for people all around Australia. We’re well on our way towards bringing the best of digital and data possibilities together to create more personalised shopping experiences for customers across our retail brands.

We’re continuing to bring the best talent and skills under one roof, working together and across disciplines to build amazing experiences for our customers. We continuously feed off each other’s insights, talents and capabilities, because we are a business that thrives on open collaboration and a shared vision of positive, fun and rewarding experiences.

Your Chapter Purpose

With plans to transform the Australian retail and industrial landscape, comes a big responsibility. We see a future where we are leaders in the data and digital space. It’s why we’ve been working hard to accelerate the development of data, digital and analytics capabilities across our businesses. We’re focused on harnessing the power of data and transforming it into meaningful insights that enhance our customer experience, strengthen our businesses, and help them pursue new growth opportunities. Our talented and agile team co-create and solve complex problems. It’s innovation, to create better experiences for our customers. It’s adding real value, that supports decision making across the Wesfarmers Group, and its transformational work, that’ll change the industries we operate

What you’ll be doing

In this role you will be responsible for optimising data platform engineering and architecture, as well as designing and building data products used by and co-created with cross functional teams focused on customer outcomes.

You will help evolve our data platform, which is built around technologies like Snowflake, Kafka, Airflow, DBT, Python – and will need continuous improvement as data use cases grow. This will involve closely working with other internal specialised tech teams such as platform engineering and security.

You’ll be collaborating with consumers of the data platform, helping to optimise ease of use, as well as deliver business outcomes through supporting the surfacing of customer insights, and enabling data-driven action. Platform consumers include data analysts, data scientists and product owners – and will grow in line with our data strategy and principles of decentralisation.

Key duties and deliverables:

• Contribute to the data platform product roadmap
• Influence and adopt architectural and engineering principles and ways of working
• Design and implement ingestion and ETL/ELT for batch, micro-batch and real-time data sources
• Work with key stakeholders in curating data products that meet functional / non-functional business requirements
• Source, cleanse and transform data into a format that can be easily, securely, and sustainably used and analysed by data users across the business
• Lead the development and delivery of appropriate leading practice data and analytical initiatives in an agile, pragmatic way, reflecting business needs, constraints and KPIs (e.g. time, quality, value & cost)
• Design and implement a strategic and specific data architecture, patterns and pipelines that supports large-scale analytics
• Develop and maintain data platform and product documentation and definitions as part of ways of working
• Establish and implement engineering principles and practices such as version management, documentation, testing and CI/CD to enable both quality and speed
• Help define and manage best practices for Data Engineering, including alignment with governance and data management
• Inform build vs buy decisions around data platform capability
• Anticipate complex issues, challenges, and opportunities with regards to alignment and implementation of vision, strategy, policies, and processes
• Work with stakeholders including Data, Technology and Customer areas to assist with data platform and data product related technical issues and support their data solution needs
• Collaborate with internal data and analytics community to strive for greater functionality in the Digital Ecosystem’s data systems
• Coach and mentor team members (2-3 Data Engineers within the team)

What you will need

• Hands-on experience building production data pipelines using one or more frameworks such as Airflow, Kafka, Spark or willingness to pick up these technologies.
• Programming experience. Proficiency in Python and interest in learning other languages as selected by the team (e.g. Scala)
• Experience with AWS and infrastructure-as-code and willingness to upskill
• Prior experience with data modelling either as a software engineer or as Data Engineer.
• Working knowledge of querying tools, such as SQL
• Well-developed communication and influencing skills
• Ability to anticipate issues, challenges, and opportunities and manage them accordingly
• Ability to work effectively in dynamic teams and collaborate with others
• Experience working within agile and lean methodologies

Nice to have

• Analytics or business intelligence experience (2+ years)
• 3+ years technology experience in Data Engineering or related roles
• 2+ years exposure in a large complex data environment
• Golang programming experience
• Working knowledge around data mining, machine learning, MLOps, natural language processing, or information retrieval

Why OneDigital?

• Working in a community of industry-leading innovators with a diverse and deep set of skills and experience, you will learn, collaborate, and co-create to achieve great things.
• You’ll have ownership of your role, which will allow you to find the right balance between stretch and sustainability, work, and life.
• Culture of comradery and collaboration - OneTeam
• Plus, all the tools and learning you need, the tone is set for you to shine and succeed.
• We know that diversity fosters greater innovation and better customer connection, so we strive to create a team where everyone feels like they belong. We support diversity, inclusion and we are a gender-neutral organisation. We celebrate individuals at their core, so they shine to their best.

Team Benefits – just to name a few!

To support you at work, what you value in life and in the community, our team member benefits include:

• Access to the latest technologies
• An annual budget for your learning and development (this includes learning of your choice, certifications and more)
• Extended parental leave (16 weeks for primary carers), and paid volunteer days
• Flexible working – we balance working together with working flexibly
• People-focussed culture that celebrates achievements big and small
• Oh, and did I mention paid subscriptions and discount cards.

Next steps

If this sounds like your next career move, then click on the ‘Apply’ button now. Please note that we may commence interviewing candidates prior to the application closing date.