Data Engineer

Outstanding opportunity for a Data Engineer responsible for delivery of development services supporting software architects, analysts and data scientists.

• Long term 1 Year Contract - paying up to $117 p/h.
• QLD Government opportunity based in Brisbane CBD
• Must have experience in Azure Data Factory, Tableau, Python or R, Power BI & ETL.

Our client is a Queensland government department that provide support with housing assistance, homelessness support services, local government support and advice, state and regional planning, public works building and design and industry regulatory reform.

In this role, you will report to directly to the Project Manager while you build data pipelines and data wrangle and optimise data systems and build them from ground up.

The Responsibilities:

• Design, develop, and maintain scalable data pipelines and ETL processes to efficiently collect, process, and store large volumes of structured, semi-structured and unstructured data.
• Implement data integration solutions to consolidate data from various sources, ensuring data consistency and integrity.
• Utilise analytical tools and techniques to explore, analyse, and visualise data to uncover trends, patterns, and insights that drive business decision-making.
• Develop dashboards and reports to communicate key metrics and findings to stakeholders.
• Identify opportunities to optimise data processing and storage systems for improved performance, scalability, and efficiency.
• Implement monitoring and alerting mechanisms to proactively detect and address issues impacting data pipeline reliability and performance.
• Enforce data governance policies and standards to ensure compliance with regulatory requirements and protect data privacy and security.
• Implement data quality checks and validation processes to maintain high standards.

Required Skills & Responsibilities:

• Must possess hands-on experience with Data Warehousing concepts, relational and non-relational databases, and big data technologies.
• Demonstrated experience with medallion data architecture, Azure data stack and emerging technologies - ADLS Gen 2, Azure Data Factory, Azure Synapse Analytics, Databricks and Fabric.
• Proficient experience in data visualisation tools such as Tableau, Power BI, or matplotlib.
• Proven experience in Data Engineering, including designing and implementing data pipelines, ETL processes, and data integration solutions.
• Strong proficiency in programming languages such as Python and R for data manipulation, analysis, and visualisation.
• Strong hands-on experience with SQL for database development and complex query design.
• Bachelor's or Master's degree in Computer Science, Statistics, Mathematics, or a related field would be highly regarded.
• Certifications in relevant technologies (e.g., Data Bricks Certified Data Analytics, Microsoft Certified: Azure Data Engineer Associate) would be nice to have.

If you wish to apply for this position, please submit your resume by clicking the 'Apply Now' button. For further information please contact Kate Pengelly at Clicks IT Recruitment on +61 419 721 ***.

At Clicks we embrace diversity, inclusion and equal opportunity.

We provide reasonable adjustments, including alternate formats to the recruitment process for individuals with disability. If you require an adjustment to be made during the recruitment process, please call 1300 254 257 or email ***********@clicks.com.au