Big Data Engineer

Sydney, Australia
Contract
$500 - $700 per day

• Exciting opportunity for a Mid Level Big Data Engineer with a large banking client
• Consulting role with innovative firm delivering digital solutions to their clients
• Initial 3 to 6 month contract with view to extend

Opus Recruitment Solutions have partnered with a leading global consultancy to deliver on multiple requirements with a Tier 1 Banking Client in Sydney. These roles will be 3 to 6 month initial contract with the view to
We are looking to speak with experienced Mid Tier (5-7+ years) Data Engineering experience across Cloudera & the Big Data Stack, ideally with Finance experience.
You will have:

• Strong Cloudera skills
• Experience with Big Data Stack including Spark, Scala, Hive, HDFS
• E2E experience
• Ability to do own automation and testing
• Strong understanding of Data Processing and Migration tools
• Scripting experience with Python or Shell

You will be:

• Designing, building and maintaining Data Processing Systems to migrate and refactor ETL pipelines in Cloudera
• Building ETL data pipelines for migration
• Partaking in Data Analysis activities, including data profiling and mapping to ensure data integrity and quality
• Developing and implementing data migration strategies, including Data Validation and Testing
• Collaborating with cross functional teams
• Writing technical documentation including data migration plans, data flow diagrams and process documentation
• Providing technical guidance and support to stakeholders and team member

These roles are Sydney based hybrid roles and will require full Australian work rights. There is the opportunity to go permanent after an initial contract. For more information, please apply today or reach out to siena.grippi@opusrs.com.au. Please note, overseas applicants will not be contacted.