AddressGlobal IT consultancy is looking for Senior Data Engineers to join their team in working on their banking and financial services clients. With a focus on leveraging cutting-edge technologies, they deliver tailored solutions to address their clients' unique challenges and drive their digital transformation journey forward. As a Senior Data Engineer, you will be responsible for designing, developing, and implementing Azure-based data solutions while collaborating closely with various technical teams to ensure the successful delivery of projects.
Key Responsibilities:
- Design, develop, and implement Azure solutions leveraging Azure Synapse, ADLS2, Spark (Python and Scala), and Cosmos DB.
- Utilise programming languages such as Python or Scala to create robust data products and demonstrate proficiency in data mesh concepts.
- Possess expertise in Linux scripting and PowerShell, with a strong understanding of source version control using tools like Bitbucket, Git, Jenkins, and DevSecOps.
- Identify existing gaps at customer locations and provide scalable solutions across various Azure services.
- Translate business requirements into technical specifications aligned with customer architecture and initiatives.
- Develop documentation including Software Technical Solution (STS), Detail Design Approach (DDA), Impact Analysis, Detailed Technical Design (DTD), and Interface Specifications.
- Estimate project efforts, perform project planning, and conduct Impact Analysis on downstream applications.
- Conduct unit testing, diagnose, and correct errors and faults according to established guidelines and quality standards.
- Provide software development support for production implementation and warranty defect fixes.
- Review code to ensure coding and quality standards are met, and actively participate in Agile ceremonies such as Daily Scrum Stand-ups, Sprint Planning, PI Planning, Demos, and Retrospectives.
- Provide technical support to the team, mentor team members, and resolve conflicts as needed.
- Minimum 5 years experience in Data Engineering
- Extensive experience in creating Azure solutions and enabling Azure capabilities.
- Hands-on experience with Synapse, Purview ADLS2, Spark (Python and Scala), and Cosmos DB.
- Proficiency in either Python or Scala programming languages.
- Strong understanding of Linux scripting and PowerShell.
- Knowledge of source version control using Bitbucket, Git, Jenkins, and DevSecOps.
- Ability to translate business requirements into technical specifications.
- Excellent communication and interpersonal skills, with the ability to collaborate effectively across technical teams.
- Proven experience in Agile methodologies and Agile ceremonies.
- Strong analytical and problem-solving skills.
- Ability to mentor team members and resolve conflicts effectively.
