Data Engineer

As a Data Engineer you will be enabling the business by providing data, reporting and analytics solutions, through developing and supporting Data Ingestion and transformation in our Unified Data Platform (UDP) based on Microsoft Azure Synapse Analytics.What will you be doing?

• Identifying, researching, and integrating new data sources into the Unified Data Platform.
• Developing and maintaining data ingestion pipelines using Azure Synapse Analytics.
• Monitoring and sustaining data flows, ensuring seamless integration with various data sources.
• Documenting all processes and data objects involved in the data ingestion and transformation processes.
• Collaborating with project teams and analysts to understand and meet their data needs.
• Designing, testing, and deploying data transformations into production environments.
• Providing expert guidance on data provisioning for analytics and advanced analytics.
• Building and maintaining robust data models as specified by analysts.
• Ensuring data solutions remain effective and update them as necessary.
• Offering expertise on the capabilities of Azure Synapse Analytics.
• Creating optimal solutions for pushing data from the Unified Data Platform to other systems.
• Gathering and documenting user requirements for data integration and data warehouse solutions.
• Providing ad-hoc support to users of the Unified Data Platform.

What are we looking for in you?

• Tertiary qualification, Bachelors and ideally Masters in a quantitative field such as Computer Science, Information Management, Mathematics, Engineering, Economics, Finance, Statistics, or in a Business/Commerce/Marketing discipline is mandatory.
• Commercial experience in the field of Data Engineering, preferably in Azure.
• Demonstrated experience in the development of data transformation processes using ETL (Extract, Transform & Load) tools.
• Understanding of business, particularly Motoring, Sales, Marketing and Finance.
• Cloud Experience understanding of cloud principles and modern data warehousing in the Azure cloud. Experience of building solutions in Microsoft Fabric (Lakehouse, Synapse Data Engineering, Synapse Datawarehouse and Realtime Intelligence)
• Azure Synapse Analytics (Azure Synapse Pipelines, Azure Synapse Notebooks Azure Data Lake, Azure Blob, Azure SQL Database and Azure SQL Data Warehouse).
• Experience of working with Delta Lake and Data warehouse
• Experience of working on Meta Data Driver Framework
• Experience with OCI
• Proficient in SQL, Pyspark, PySQL
• Proficient in Microsoft Power BI or other Business Intelligence tool
• Knowledge of data modelling techniques and tools like ER diagrams, dimensional modelling, and tools like ERwin or Lucidchart.
• Desired knowledge/experience in real time data processing and integration with Azure applications (such as MS Dynamics)
• Understanding of relational database concepts and Data Warehousing concepts.
• Experience in working with both structured and unstructured data.
• Advanced problem-solving skills and a meticulous attention to detail.
• An understanding of Business Intelligence and reporting concepts and an awareness of Business Intelligence toolsets.
• A broad understanding of Information Management, Data Quality, Master Data Management, Data Governance and Data Stewardship is not required, but would be beneficial.
• Proficient in the use of Microsoft Word, Microsoft Excel, Microsoft PowerPoint and Microsoft Outlook.

What can we offer you?

• Working in an environment that is embracing a continuous improvement culture using experimentation to support learning.
• Time dedicated to your personal development time with access to training, development, and certification programs to ensure you can upskill.
• Being part of empowered, cross-functional agile delivery teams that works with the business to build systems that solve problems.
• Complete flexibility to choose between working from the home or office with flexible hours for a better work life balance.
• Building digital systems that will shape the future for the RAC and a better WA.
• Gain RAC Staff Benefits including free Roadside Assistance and 25% discount on your Insurances, Social Club and access Fitness Passport for cheaper gym memberships.

About RACAs an Equal Opportunity Employer, RAC values inclusivity and promotes a workplace that actively seeks to welcome contributions from all people. We encourage people of all abilities, Aboriginal and Torres Strait Islanders, diverse cultures and backgrounds, LGBTIQ+ identities, and all age groups to apply.RAC is committed to flexibility. If you need assistance or adjustments to fully participate in the application process, please contact jason.crooks@rac.com.au.