Granite Consulting is working closely with a large player in the automotive industry at the forefront of innovation and technology. We are seeking a skilled Data Engineer to contribute to large-scale data extraction and transformation initiatives. This is an exciting opportunity to work with cutting-edge technologies and make a significant impact in the industry.
Role Overview:
Working with a modern analytics stack, including Google Cloud, BigQuery, Airflow, Informatica and Python, the Data Engineer will be building data pipelines, transforming, structuring, and operationalising data to support BI, Analytics and Data Science projects. Contribute to the development and design of the data platform, including the design and execution of data extraction, transformation, and optimal data pipeline architectures and solutions at an enterprise scale to enable business intelligence, analytics, and data science use-cases.
Key Responsibilities:
- Design and implement processes around data-loading, data-transformation, and feature engineering as well as access control, data security and data privacy.
- Develop complex code based ETL/ELT data pipelines with performance optimised data modelling.
- Develop source of truth data models to power business analytics solutions using data warehouse modelling techniques, data quality checks, reconciliation processes and thorough testing practices
- Ensure code is manage, validated, and released using best practices (DevOps) making effective use of automation for these processes.
- Proficiency in designing efficient and robust ETL/ELT workflows, data pipelines –batch and/or event driven.
- Proficiency in designing data solutions and creating solution architecture is beneficial.
- Experience working in a complex enterprise data warehouse environment and developing and maintaining pipeline processes to move and transform data.
- Experience with data warehousing principles, including orchestration framework, schema structure and data architecture principles.
- Experience with cloud architectures (GCP preferred).
- Experience with Informatica ETL and Governance, or similar tools.
- Competitive salary package.
- Flexible working arrangements – 2-3 days in the office in Melbourne (Rowville) or Sydney.
- Exciting projects in the automotive industry with a focus on innovation and technology.