Data Engineer

My client is a leading customer owned bank with multiple offices all over Australia.

They are seeking a highly skilled and experienced Data Engineer to join their Data team.

As a Data Engineer, you will play a critical role in designing, implementing, and maintaining their data infrastructure.

• Work with cutting-edge technologies, including Databricks, DBT, and AWS, to support the data-driven decision-making processes.
• CI/CD implementation/support and play a crucial role in automating and streamlining software development and deployment processes.
• Work with cutting-edge tools such as Terraform, AWS Code Commit to create robust and efficient CI/CD pipelines.
• Mentor, train and support other team members and provide expert technical advice.
• Develop and enhance automation scripts as well as engage with stakeholders to improve processes.

• 8+ years experience developing ETLs using data transformation tools and techniques.
• Experience with Databricks, PySpark and working knowledge of DBT for data processing and transformation.
• A working understanding of Data Warehousing concepts of Data Vault, Dimensional modelling, slowly changing dimensions, OLAP design.
• Working knowledge in Infrastructure as Code (IaC) using tools such as CloudFormation, Terraform, and ARM templates.
• Skilled in scripting languages including Python, Bash, and PowerShell.
• Familiarity with log and monitoring solutions, with a focus on CloudWatch, Log Analytics Workspace, and Azure Sentinel and Splunk in the security sector.
• Extensive experience with CI/CD platforms such as GitLab CI, GitHub Actions, AWS CodeBuild, Azure Pipelines, and Jenkins.
• Demonstrated ability to design robust CI/CD solutions. Well-versed in Git, with a strong understanding of branching strategies.
• Experience in utilising development containers, unit testing/code quality review/linting - standard best practise.
• Familiarity with containerization and orchestration technologies (Docker, Kubernetes, etc.).
• Experience with CI/CD automation tools such as AWS CodePipeline/CodeCommit, Jenkins, GitLab CI/CD
• Understanding of cloud platforms (e.g., AWS, Azure, GCP) and experience with cloud-based CI/CD pipelines.
• Knowledge of monitoring and logging solutions (e.g., Splunk).
• Strong problem-solving and troubleshooting skills.
• Excellent communication and collaboration skills to work effectively with cross-functional teams.

Career Growth Plan

Discounted Financial and Insurance products

Flexible and supportive work environment

If you satisfy the above, then APPLY NOW!!! or call Nav Zarshoy on 0472604***