Senior Data Engineer required to design, develop and implement big data analytics applications on AWS for a well-known financial services business.
Senior Data Engineer required to design, develop and implement big data analytics applications on AWS for a well-known financial services business.Responsibilities:
- liaising with business stakeholders to gather requirements
- building pipelines to migrate data from source systems onto enterprise data lake
- ensuring code is implemented to support automation
- getting applications up and running in production environment, including looking after testing and security
- extensive Pyspark coding skills
- strong experience working with Airflow and Redshift
- proven background working on end-to-end projects on an enterprise scale