Azure Data Engineer

Azure Data Engineer
Weir Minerals
Artarmon
Hybrid
Weir is a successful global organization that is leading the way in Industry 4.0 transformation. We are looking for an experienced Data Engineer to join our IoT team. The ideal candidate is an experienced data pipeline builder and data wrangler who enjoys optimizing data systems and building them from the ground up. This role will support our software developers, data analysts and data scientists with data initiatives and will ensure optimal data delivery architecture is consistent throughout ongoing projects. This is an execution-focused position and to succeed in this role you would require a strong hand-on experience.
We offer a competitive salary package and excellent career growth and development opportunities. The role is based in Artarmon with flexibility available but works within a wider global team environment.
Why choose Weir:
Be part of a global organization dedicated to building a better future: At Weir, the growing world depends on us. It depends on us constantly reinventing, quickly adapting and continually finding better, faster, more sustainable ways to access the resources it needs to thrive. And it depends on each of us doing the best work of our lives. It’s a big challenge – but it is exciting.
An opportunity to grow your own way: Everything moves fast in the dynamic world of Weir. This creates opportunities for us to take on new challenges, explore new areas, learn, progress and excel. Best of all, there is no set path that our people must take. Instead, everyone is given the support and freedom to tailor-make their own career and do the best work of their lives.
Feel empowered to be yourself and belong: Weir is a welcoming, inclusive place, where each individual’s contribution is recognized and all employees are encouraged to innovate, collaborate and be themselves. We continually focus on people and their wellbeing. We believe in fairness and choose to be honest, transparent and authentic in everything we do.
Key Responsibilities:
Build and maintain data pipelines for data integration and processing
Design and implement data storage solutions on Azure
Ensure data quality and accuracy through testing and validation
Optimise data processing performance through tuning and monitoring
Safety First: Demonstrate 100% commitment to our zero harm behaviors in support of our drive towards developing a world class safety culture
Key Role Requirements:
3+ years of Azure Data Engineering experience
Experience building and optimizing ‘big data’ data pipelines, architectures and data sets
Extensive knowledge of data integration tools such as Azure Data Factory and Azure Databricks
Experience with Azure data storage solutions such as Azure SQL Database, Azure Cosmos DB, and Azure Data Lake Storage
Strong experience with API based integration, Rest API, OData etc.
Familiarity with big data processing frameworks such as Apache Spark
Understanding of data modelling and schema design principles
Ability to work with large datasets and perform data analysis
Azure Data Factory
Azure Data Lake
Azure Data Explorer
Azure Key Vaults
Data Bricks
Azure Functions
Python / C#
SQL/TSQL; SQL Server
Rest API
DevOps and Git
Experience with Databricks, Delta Lake and Medallion Architecture is desirable
Azure Certifications is desirable
Experience with OSIsoft PI APIs is desirable
Founded in 1871, Weir is a world leading engineering business with a purpose to make mining operations smarter, more efficient and sustainable. Thanks to Weir’s technology, our customers can produce essential metals and minerals using less energy, water and waste at lower cost. With the increasing need for metals and minerals for climate change solutions, Weir colleagues are playing their part in powering a low carbon future. We are a global family of 11,000 uniquely talented people in over 60 counties, inspiring each other to do the best work of our lives.
For additional information about what it is like to work at Weir, please visit our and .
Weir is committed to an inclusive and diverse workplace. We are an equal opportunity employer and do not discriminate on the basis of race, national origin, gender, gender identity, sexual orientation, veteran status, disability, age, or any other legally protected status.
#minerals
#LI-SL