Senior Data Engineer

Innovative organisation working on Microsoft Data Lakehouse Architecture and looking for a Senior Data engineer to join the team!

Senior Data Engineer

Join one of the most innovative organizations in Newcastle for an exciting 12-month contract opportunity! They are seeking a talented Senior Data Engineer to contribute to their dynamic team. If you have experience in Spark, Python, Cloud technologies, SQL, and ERP Systems, we want to hear from you.
Key Responsibilities:

• Design, develop, and maintain scalable data pipelines and infrastructure.
• Collaborate with cross-functional teams to gather requirements and implement data solutions.
• Optimize data processing and storage for efficiency and performance.
• Ensure data quality and reliability through rigorous testing and validation.
• Integrate data from ERP systems into data pipelines for analysis and reporting.
• Stay up-to-date with emerging technologies and best practices in Data Engineering.

Requirements:

• Proven experience as a Senior Data Engineer or similar role.
• Proficiency in Spark, Python, and SQL for data processing and analysis.
• Strong understanding of cloud platforms (e.g., AWS, Azure, GCP) and related services.
• Experience with big data technologies such as Hadoop, Kafka, or similar.
• Familiarity with ERP systems and data extraction methodologies.
• Excellent problem-solving and communication skills.
• Ability to thrive in a fast-paced, collaborative environment.

Preferred Qualifications:

• Advanced degree in Computer Science, Engineering, or a related field.
• Certification in relevant technologies (e.g., AWS Certified Big Data Specialty).
• Experience with containerization and orchestration tools (e.g., Docker, Kubernetes).
• Knowledge of NoSQL and/or distributed databases.
• Familiarity with machine learning concepts and frameworks.

Location: Newcastle (Hybrid working model with 2 days WFH)
12-month contract with a high chance of getting an extension for another 12 months.
If you're passionate about leveraging data to drive innovation and have the skills and experience we're looking for, we want to hear from you! This is a fantastic opportunity to join a forward-thinking organization and make a meaningful impact. Don't miss out – apply now!