Data Engineer

Seeking a highly skilled and experienced Data Engineer to join dynamic team on Permanent basis. skills set - Azure and PySpark

Data Engineer - Melbourne - Permanent Position
Our client is seeking a skilled Data Engineer to join their experienced team for the Biggest Australian Supermarket client.
Position – Permanent Position
Job Location – CBD, Melbourne
Work – Hybrid,2/3 days from office
Full Job Description
Skill Set: Data Engineering,Azure,PySpark
Skill to Evaluate: Data Engineering,Azure,PySpark,Spark,Data Management,Systems,Azure Data,Azure Data Factory, ADF, Analytics, Azure Cloud,Services,SQL
Work Experience:
A minimum of 3+ years of experience in a Data Engineer role, preferably in a similar industry."
Job Description:
Seeking a highly skilled and experienced Data Engineer to join dynamic team. The ideal candidate will have a broad experience in Data Engineering, particularly in Azure and PySpark-based Data Engineering applications.
- Bachelor’s degree in Computer Science, Information Systems, or a related field.
- Master’s degree is a plus.
- Proven experience as a Data Engineer, Software Developer, or similar.
- Strong experience with Azure cloud services, Azure Data Factory (ADF) pipelines, and PySpark.
- Experience with Spark implementation and real-time data streaming in Spark.
- Proficiency in SQL, Python, and other programming languages.
- Familiarity with machine learning algorithms and data visualization tools is a plus.
- Excellent analytical and problem-solving skills.
- Strong communication skills and ability to work as part of a team.
Key Responsibilities
- Design, construct, install, test and maintain highly scalable data management systems.
- Develop and implement data pipelines in Azure Data Factory (ADF).
- Implement complex, scalable, and robust architecture to support real-time data streaming using Spark.
- Work closely with data scientists and analysts to provide direct and indirect data-related support.
- Ensure systems meet business requirements and industry practices.
- Integrate up-and-coming data management and software engineering technologies into existing data structures.
- Develop set processes for data mining, data modeling, and data production.
Create custom software components and analytics applications.
- Research new uses for existing data.
APPLY NOW ..
Interested candidates please send your resume (word doc) to savi@redwolfrosch.com.au or call Savi at 0491681079 for a confidential discussion.
Redwolf + Rosch invite and encourage applications from all backgrounds of gender, disability, culture, and race. If you are a person with a disability and require modifications to the recruitment process, please contact the Recruitment Consultant.