Address
Form of workSenior Data Engineer (WFH Flex)
Sydney, Australia
$190,000 Inc Super + Bonus
Permanent, Full-time
Leading Insurance business require a highly skilled Azure Data Engineer to join their dynamic team in Sydney. As an integral part of our digital transformation journey, you will be responsible for designing, developing, and maintaining data solutions leveraging the Azure ecosystem. The ideal candidate will have expertise in digital streaming, real-time use cases, and a strong background in Kafka streaming, Azure Event Hub, and Azure Stack.
Key Responsibilities:
- Design, develop, and implement data streaming solutions using Kafka streaming and Azure Event Hub.
- Collaborate with cross-functional teams to understand business requirements and design efficient data processing pipelines.
- Develop and maintain real-time data processing applications to support various use cases.
- Implement and optimize data ingestion, transformation, and delivery processes.
- Work closely with marketing teams to design and implement a Customer Data Platform (CDP) on Azure Cloud.
- Utilize Pyspark for data processing and analytics tasks.
- Ensure data solutions adhere to best practices in security, scalability, and performance.
Qualifications:
- Bachelor's degree in Computer Science, Engineering, or related field.
- Proven experience as a Data Engineer with a focus on Azure technologies (Databricks)
- Strong expertise in digital streaming and real-time data processing.
- Hands-on experience with Kafka streaming, Azure Event Hub, and Azure.
- Proficiency in Pyspark for data processing and analytics.
- Experience designing and implementing Customer Data Platforms (CDP) is highly desirable.
- Effective communication and collaboration skills.
If you feel your experience matches the above, please apply with most updated CV!
