AddressData Engineer
Sydney
$175,000 Inc Super + Bonus
As a Data Engineer within our dynamic Engineering team, you will play a crucial role in developing cutting-edge applications to support our Data Transformation initiatives. This is a permanent position offering the opportunity to work on innovative projects within a supportive team environment.
Key Responsibilities:
- Utilize your expertise in data warehousing and information management to contribute to the development of our future-ready Data Platform.
- Design and implement data models to support business requirements.
- Leverage your Linux/Unix skills and prior experience with AWS to build robust and scalable data solutions.
- Develop and optimize complex SQL queries and data manipulation processes.
- Utilize Big Data querying tools such as Hive, Spark, and Presto to extract insights from large datasets.
- Implement API-based integrations and orchestrate data pipelines using tools like Apache Oozie, Airflow, or Argo Workflows.
- Apply your knowledge of technical solutions, design patterns, and code to develop medium/complex applications deployed in clustered computing environments.
Desired Skills and Experience:
- Proficiency in programming languages such as Scala, Java, or Python, particularly in the context of Big Data technologies like Spark.
- Redshift.
- Experience working with Docker, Kubernetes, and familiarity with containerized environments.
- Exposure to security concepts and best practices related to Data Engineering.
- Knowledge of machine learning concepts and tools such as Spark ML or R.
- Experience with major Hadoop distributions such as Cloudera, MapR, or Hortonworks HDP.
- Familiarity with build tools like Maven, Gradle, and Ant.
If you feel you possess the relevant skills to the above, apply now with most updated CV!
