Lead Data Engineer

Lead Data Engineer

Sydney, Australia

$205,000 + Super

Role Overview:

As the Lead Data Engineer, you will play a crucial role in driving the migration of our data infrastructure from on-premises to the cloud, specifically in Azure. You will lead a team of skilled engineers, architecting and implementing scalable and efficient data solutions while ensuring the seamless integration of our systems with the cloud environment. This role requires a combination of technical expertise in Python/PySpark, SQL Azure Cloud, Data Bricks, as well as proven leadership and managerial skills.

Key Responsibilities:

• Lead the end-to-end migration process from on-premises to Azure cloud infrastructure.
• Architect, design, and implement scalable data solutions leveraging Python/PySpark, SQL Azure Cloud, and Data Bricks.
• Collaborate closely with cross-functional teams to gather requirements, define project scope, and drive the successful delivery of data migration projects.
• Provide technical leadership and mentorship to a team of Data Engineers, ensuring best practices and standards are followed throughout the migration process.
• Develop and maintain documentation related to Data Engineering processes, systems, and configurations.
• Stay updated on emerging technologies and industry trends to continuously improve our Data Engineering practices.

Requirements:

• Bachelor's degree in Computer Science, Engineering, or related field. Advanced degree preferred.
• 5-7+ years of experience in Data Engineering roles, with a focus on cloud migration projects.
• Proven experience with Python/PySpark, SQL Azure Cloud, and Data Bricks.
• Strong understanding of cloud-based data architectures and services, particularly within the Azure ecosystem.
• Demonstrated leadership and managerial experience, including leading teams through complex technical projects.
• Excellent communication and interpersonal skills, with the ability to effectively collaborate with cross-functional teams.
• Experience working in the insurance or financial services industry is a plus.

If you possess the relevant skills to the above, apply now with most updated CV!