Principal Platform Engineer
- $151,509 - $182,270 plus superannuation
- Ongoing Full Time opportunity x2
- SNSW Grade 11/12
- Hybrid working
Service NSW is at the cutting edge of technology and is expanding our digital teams to manage the demands of delivering innovative services to the millions of NSW residents. We need a range of skill levels to enhance our existing teams, including people with extensive experience through to emerging talent with strong foundation skills and huge potential. If you're looking for an opportunity to shine, then look no further!
About the team
SaaS Platforms and Observability Team support product teams in achieving their objectives by furnishing them with cutting-edge observability solutions and industry best practices.
Our aim is to foster a culture of observability by enlightening teams on the advantages of real-time monitoring, proficient troubleshooting, and data-informed decision-making. Through close collaboration with our product teams and partners, we endeavor to establish a seamless and comprehensive observability framework that yields actionable insights and empowers teams to continuously enhance their products. Additionally, our team oversees all SaaS-based collaboration tools for our Digital Services team, managing tasks such as administration, user onboarding, and change management.
About the role
As a Principal Engineer your new role will see be responsible for establishing and operating the Observability platform whilst ensuring that all services are working and running optimally. More specifically you will:
- Enable distributed application monitoring for complex systems and specifically on solutions that involve proactive monitoring, tracing, and error detection that help developers be successful with daily troubleshooting tasks.
- Support, maintain and expand tools infrastructure to meet future architecture design and deployment requirements
- Design, implement, support optimize Splunk, PagerDuty and other observability tools in SNSW ecosystem
- Develop new dashboards, searches, and alerts to enhance use cases.
- Deploy Best Practices for developing Splunk Apps, Monitoring, PagerDuty event management and create conceptual architecture for a continuous improvement initiative.
- Help to ensure the engineering team successfully delivers on critical projects and initiatives.
- Troubleshoot platform related issues and assist team members with technical issues.
- Optimise the technical health of observability tools by providing and a plan of improvements and implementing them in line with best practice.
- Work with the wider engineering team to expand and grow their understanding of the New Relic, PagerDuty and Splunk platform
- Optimise the costs of our different observability tools solution and bring data volumes back within our agreed limits with the vendor.
Required Certifications:
- Splunk Cloud Administrator Certification
- Splunk O11y Certified Metrics User Certification
- PagerDuty Administrator Certification
- Splunk Cloud
- Splunk Observability
- Splunk Enterprise Security
- PagerDuty
- OpenTelemetry
- JFrog Administration
- Confluence Administration
- Twilio + Sendgrid Administration
- Slack Administration
- Miro Administration
- GitLab CI/CD Pipelines
- Terraform
- Apigee
- AWS
- EKS (Kubernetes)
- VMWare Tanzu
- Designing, building, and maintaining extensive Splunk Observability setups with Kubernetes
- Deploying Splunk Observability private locations utilizing Kubernetes
- Instrumenting both back-end and front-end applications with Splunk APM and RUM through OpenTelemetry
- Proficient in advanced instrumentation techniques, including custom events, metrics, and attributes
- Establishing and managing PagerDuty business and technical services, escalation policies, event routing, service orchestration, on-call schedules, and StatusPage integration
- Integrating various event sources with PagerDuty
- Automating recurring administrative tasks across Splunk Cloud, Splunk Observability, and PagerDuty using Terraform
- Developing dashboards and alerts within Splunk Cloud and Splunk Observability
- Creating custom Splunk Cloud (TA) technology add-ons
There are lots of reasons why a role with us is rewarding - working with us gives you:
- The opportunity for meaningful work that matters to all of us in NSW
- Hybrid working, compressed hours and generous leave conditions, so you can make time for what counts
- Much more than just a job, you can build a career here
- Unmatched opportunities for growth and development
If this role sounds like you, you can apply by clicking the button 'Apply Online' below - it's a simple online process.
If you don't meet all the criteria, but still believe you could succeed in this role, please still apply - we'd love to hear from you.
Salary Grade 11/12, with the base salary for this role starting at $151,509 base plus superannuation
Click Here to access the Role Description.
For enquiries relating to recruitment please contact Tiffany Martin via **************@customerservice.nsw.gov.au
Visit the Capability Application Tool to prepare for the recruitment process by accessing practice application and interview questions based on the focus capabilities listed in the role description.
Closing Date: Wednesday 15 May 2024 at 9:59am
Careers at Department of Customer Service
A career at the Department of Customer Service (DCS) gives you the opportunity to help improve government services and be part of reform that benefits people across NSW. We are focused on delivering excellent customer service, digital transformation, and regulatory reform. Come join us and influence the future of our great state.
Belong in our diverse and inclusive workplace
The strength of our workforce lies in its diversity and embracing difference, while the key to our success is leveraging the contributions of employees with different backgrounds and perspectives.
You can view our full diversity and inclusion statement here.
We want you to bring your best self to this application process. If you feel you may require an adjustment during the recruitment process, please contact our Diversity, Equity and Inclusion team via **************@customerservice.nsw.gov.au or 02 9494 8***.
For more information, please visit
Information on some of the different types of disabilities
Information on adjustments available for the recruitment process