Senior Data Engineer

Parramatta, NSW, AU, 2150

You excel at connecting the dots as a problem solver, ensuring the seamless delivery of reliable services from beginning to end.

You’re an innovative tech enthusiast who wants to explore and create cutting-edge solutions. You'll have the opportunity to be part of an expert team that improves technology experiences, shaping the digital landscape for a seamless future.
 

In this role, you'll:

Work as part of a team delivering Data Architecture & Data Analytics you will build data pipelines by integrating various data sources and the maintenance, improvement, cleaning, and manipulation of data from divisional and other databases.

This role will see you create and maintain the implementation of an optimal data pipelines from a wide variety of internal and external sources into a large cloud environment and work with genuinely large datasets and implement against reference designs to meet the functional requirements of the cluster, branch and consumers.

This is a fixed term full time opportunity until Feb 2025 with good potential for extensions and is based at Parramatta with flexible work practices.

For more information on this position and business unit, view the role description.  

About you

• Expertise in Cloud ETL development experience using various ETL tools and extensive knowledge in Data Warehousing principles.
• Design, develop, and implement ETL (Extract, Transform, Load) pipelines using cloud ETL tools (e.g. Matillion) to extract data from various sources, transform it into a usable format, and load it into cloud data warehouse (e.g. Snowflake).
• Design and maintain data models within Snowflake to optimize query performance and facilitate data analysis.
• Demonstrate strong SQL skills to write efficient queries for data extraction, transformation, and analysis within Snowflake (SnowSQL).
• Develop and implement data quality checks and monitoring processes to ensure data accuracy and consistency.
• Leverage AWS S3 for efficient data storage and retrieval as part of the data pipeline.
• Automate data pipeline workflows and scheduling using tools like cron or CloudWatch.
• Troubleshoot and resolve issues related to data pipelines, Snowflake, and AWS services.
• Collaborate effectively with engineers, analysts, and stakeholders to understand data needs and deliver solutions.
• Document data pipelines and processes for clear communication and future reference.
• Demonstrate strong production implementation experience by successfully deploying and maintaining data pipelines in a production environment.

Matillion experience is highly desirable.  

Who we are

Transport for NSW provides a safe, integrated, and efficient transport system. We connect people, communities and industry every day. 

Join us
 

Our workforce is as diverse as the community we serve. If you’d like further information on our inclusion and diversity initiatives, visit Transport careers.

We offer a wide range of employee benefits, like our award-winning flexible and hybrid work options.

This role is hybrid-friendly, meaning you can mix in-person days at your team’s home base location with remote days. 

What are you waiting for…? Connect with us.  Apply now!

Applications close: 11:59 pm Wednesday 10th June 2024.

For more information about this role, please contact ***************@TRANSPORT.NSW.GOV.AU.

People living with disability are supported throughout the recruitment process and at work. Visit Supporting people with disability for more info or speak to your talent team member to arrange any adjustments to how you interact with us. 

Need some help with your application? Take a look at our application tips video series.