Australian Citizens residing in Australia only respond.Must be able to obtain Baseline.OverviewAt the Clean Energy Regulator, youre signing up for a challenging and rewarding workplace. All our work is connected to measuring, managing, reducing or offsetting carbon emissions and increasing the use of clean energy in Australia.Role Responsibilities and Duties:
- Design, construct, and optimize data lakes, CI/CD, and Synapse pipelines within the Azure stack.
- Develop scalable architecture practices for pipeline designs.
- Lead data migration and integration for critical change programs.
- Ensure data integrity and align engineering tasks with program objectives.
- Mentor team members and drive new data engineering practices adoption.
- Monitor and improve data service performance and costs.
- Maintain documentation and adhere to data governance policies.
- Research and innovate within the Azure data engineering field.
- Bachelors degree in computer science, Engineering, or a related field.
- Certifications in Azure Data Services, such as the Microsoft Certified: Azure Data Engineer Associate.
- 3+ years of experience in data engineering with a focus on Azure services.
- Proven experience with Azure Data Lake, Azure Synapse Analytics, and CI/CD pipelines.
- Demonstrated ability to design and implement scalable data architectures.
- Experience in data migration and managing large-scale data pipelines.
- Familiarity with DevOps practices and tools within the Azure ecosystem.
- Strong technical skills in SQL, Python, and R
- Proficiency in data modelling including reuse and scalability patterns
- Knowledge of Azure Monitor, Azure Security, and compliance frameworks.
- Ability to work with cross-functional teams and lead technical projects.
- Experience building data profiling, data cleansing and data engineering frameworks