We are looking for a Data Engineer to join this dynamic data team, with responsibilities spanning client engagement and internal projects. Your role will be pivotal in delivering data-driven solutions and supporting the technical and business teams.Key Duties
- Client Collaboration: Collaborate with our internal team to achieve data-related goals for our external clients within advisory and consultancy projects.
- Data Insight and Issue Resolution: Work alongside our internal business and technical teams to interpret data and address any data-related challenges.
- ETL/ELT Implementation: Utilise cutting-edge technologies such as Snowflake, Microsoft Azure components (Data Factory, Key Vault, Storage Accounts, etc.), Databricks, and dbt to create and maintain data workloads (ETL/ELT).
- Data Team Support: Provide support to our internal software developers, data analysts, and data scientists across various data projects and initiatives.
- Automation and Best Practices: Develop in-house solutions and frameworks to streamline processes and establish industry best practices, standards, and patterns.
- Data Visualisation: Craft interactive dashboards and reports, potentially utilising Power BI for data visualisation.
- Data Expertise: A solid grasp of data warehousing and data lake concepts, indicating familiarity with fundamental data storage and management principles.
- Technology Proficiency: Experience with key technologies like Microsoft Azure Data, Snowflake, Databricks, and dbt.
- SQL Mastery: Strong proficiency in SQL and a track record of working with relational databases, essential for effective data manipulation.
- Python Proficiency: While not mandatory, proficiency in Python is advantageous for scripting and data manipulation tasks.
- ETL/ELT Proficiency: Proven expertise in implementing and supporting ETL (Extract, Transform, Load) and ELT (Extract, Load, Transform) processes, crucial for data integration.
- Data Analysis and Modelling: Strong skills in data profiling, data analysis, and data modelling, indicative of a robust analytical foundation.
- Data Visualisation Skills: Experience using data visualisation and analysis tools like Power BI is a valuable addition for deriving meaningful insights from data.
- CI/CD and Infrastructure Competence: Familiarity with Continuous Integration/Continuous Deployment (CI/CD) and Infrastructure as Code (e.g., Terraform) is advantageous for efficient and automated development and deployment practices.
- Problem-Solving and Self-Learning Aptitude: Strong problem-solving abilities are essential in Data Engineering, along with a demonstrated willingness to learn and adapt to new technologies and tools.
- Self-Motivation and Team Contribution: Being self-driven, proactive, and a valuable contributor to the team's success are essential attributes for this role.