- 12 Month Contract + 2 X 12 Month Extension
- Canberra, Sydney, Brisbane, Adelaide or Melbourne Opportunity
- Ability to obtain a Baseline Clearance
Our Client, a large Federal Government Department with offices across Australia is seeking skilled Data Engineers to work in a high performing data warehousing teams delivering analytics products to support business outcomes.
The Biosecurity Analytics Centre requires skilled Data Engineers to work in a high performing data warehousing team delivering analytics products to support business outcomes.
The Data Engineer's will provide services under direction including:
- Follow the principles defined¬ in the team's Data Engineering quality blueprint and training materials;
- Collaborate with data analysts, data scientists, and business stakeholders to understand data requirements and deliver solutions;
- Design, develop, and maintain data pipelines and code-first ELT processes using team standards and best practices;
- Optimise pipeline performance through performance-tuning techniques;
- Ensure data quality, reliability, and availability across different sources and destinations;
- Design and maintain reference data tables according to the team's reference data standards using manual and automated mechanisms;
- Implement defined data governance, security, and privacy policies and standards;
- Monitor, troubleshoot, and optimize data pipeline performance and issues;
- Write clear, business meaningful, code documentation that explains the intent and mechanics of scripts.
To be deemed suitable for this role, you will have:
- Ability to integrate disparate data assets through judicious use of reference data. By using a common standard as a translation of data from disparate systems, decision makers or analysts obtain a seamless view of multiple systems. The Data Engineer achieves this by designing golden reference tables, maintaining mapping tables between individual systems to the common reference, and create automated monitoring for outdated references;
- Ability to maintain the optimal execution performance of a complex data pipeline. The engineer takes pride in the background work to ensure the rest of the warehouse are not encumbered by the ever-growing SQL and Power BI pipeline. The engineer does this through daily monitoring of the pipeline execution, apply performance tuning techniques such as SQL optimisation, designing incremental extractions in SQL and partitioned refreshes in Power BI;
- Familiarity with the Australia's biosecurity systems. Familiarity with the imported cargo pathway will be highly regarded;
- Familiarity with the Australia's exports systems.
For a copy of the full job description, including the Application instructions please get in touch with Alison at the Recruitment Hive by clicking the Apply for this Job button. Alternatively, you can reach Alison on (02)6299 1*** to discuss further,
Please note, applications close on Wednesday the 10th of April at 11:00AM
Job ID AC9167 / DM 23086
Recruitment Hive offer a transparent fee structure for referred and non referred candidates. Contact our team for more details or visit our website.