Senior Data Engineer

Our CompanyWe exist to bring amazing people together to explore the art of possible.Bailey Abbott are a progressive and dynamic IT Consultancy business working across both Public and Private sectors. People are at the core of everything we do. We’re all about nurturing and inspiring people – ours and our clients. We bring a positive attitude and mindset to everything we do. We confidently use our knowledge and skills to solve problems, finding a better and easier way forward.We deliver transformational outcomes to take businesses further, fearlessly. Confidence and trust is fundamental to delivering superior outcomes and we take ownership and responsibility for our commitments.Our PeopleOur specialist IT Consultants are creative, collaborative, and passionate. We’re strong advocates for change, challenging the status quo through new thinking, technology, and practices. Always exploring creative ways to simplify complexity.As a Consultant with Bailey Abbott, you will have the opportunity to build your project portfolio by gaining exposure and experience working across different clients, industries, technologies, and methodologies, all while having the stability and security of a permanent position.Our Career OpportunityBailey Abbott have an exciting opportunity for a Senior Data Engineer to join our Data Intelligence capability. Our Data Intelligence specialists work within an active community of practice, enabling you to benefit from their years of collective experience and wisdom.Working as a Senior Data Engineer you will get the opportunity to:

• Represent Bailey Abbott, sharing your skills and knowledge to help deliver projects for our clients
• Develop and maintain ETL (Extract, Transform, Load) pipelines to ingest, process, and transform data within our Microsoft Azure-based data lake, utilising Azure Data Factory
• Design and implement efficient data models and schemas in Azure to ensure data quality and reliability, integrating Azure Purview for data governance
• Utilise your proficiency in SQL and NoSQL databases to optimise data storage and retrieval in Azure environments
• Leverage big data technologies such as Apache Spark, Hadoop, or Azure HDInsight to process and analyse large datasets
• Collaborate with data scientists, analysts, and stakeholders to understand business requirements and deliver valuable data solutions tailored for Azure ecosystems
• Write high-quality, scalable code in languages such as Python, Java, or Scala to support Azure-based Data Engineering tasks
• Continuously monitor, troubleshoot, and optimise data pipelines in Azure for performance and reliability
• Stay up-to-date with industry best practices and emerging technologies in the Azure landscape to drive innovation in our data platform

Requirements

• Bachelor's degree in a related field or equivalent work experience
• Demonstrated experience in Data Engineering or a related role, with a specific focus on Microsoft Azure
• Proficiency in SQL and NoSQL databases, with a strong understanding of data manipulation and querying in Azure
• Demonstrable experience in ETL pipeline development using Azure Data Factory, data modeling, and schema design
• Familiarity with Azure big data technologies such as Apache Spark, Hadoop, or Azure HDInsight
• Experience with Azure Purview for data governance and cataloging
• Application of CI/CD and DevOps methodologies, including source code management
• Programming skills in languages like Python, Java, or Scala, with a focus on Azure applications
• Experience with Snowflake is advantageous
• Strong problem-solving skills and attention to detail
• Effective communication and collaboration skills in an Agile team setting
• Azure certification or relevant cloud experience is highly desirable
• Exposure to emerging approaches such as Azure Fabric

Benefits

• Paid Birthday Leave
• Access to Employee Assistance Program
• Flexible Working Options
• Novated Leasing
• Regular team gatherings including monthly team lunch
• Professional development opportunities and continuous learning
• Financial benefits through Discount Store

Our clients are diverse and so are we. We engage with great talent from all walks of life to bring their extensive and varied experience to help promote innovation. We encourage applications from candidates from all backgrounds to further strengthen Bailey Abbott.Bailey Abbott. Explore Possible.