Data Engineer - $800-$900 Aud Day - 3 - 6 Month Contract

$800-$900 AUD per day
Mid to senior level
up to 6 month contract (probable extension)

Data Engineer to work across a global payments platform at one of the big 4 banks in APAC. This will be a 3-6 month contract with a probable extension.

Roles and Responsibilities:
Lead the ongoing maintenance, development, and enhancement of our data warehouse.
In-depth knowledge of Relational Database technology and multi-dimensional data modeling, structured query language (SQL) skills, data warehouse, and reporting techniques
Expert in the design and development of data pipelines
Experience with enterprise ETL platforms (such as Informatica, SSIS, etc.)
Understanding of Unix scripting is preferred.
A good working experience on several open-source technologies and big data components such as HDFS, Airflow, Spark, Scala, Hive, Apache Kafka, HBase, etc.

Skills:
Databases Oracle, PostgreSQL, SQLite
Advanced SQL
Scala
Python
Git
Apache Spark & ETL processing
Hive, Yarn, MapReduce
Test frameworks (both in Scala and Python)
(Optionally) Apache Kafka
Apache Airflow
Hadoop

Data modelling, HDFS