AddressWe are seeking a talented and experienced PySpark Developer to join our dynamic team, with atleast 8+ years of experience.
- PySpark, Python, SQL, AWS/ Azure
- 8+ years experience
- experience building data pipelines in Python, PySpark and SQL
- Demonstrated experience working in an Engineering role in cloud environments.
- Hands on experience setting up an ETL Orchestration framework such as Apache Airflow or alternatives.
- Setting up CI/CD systems such as ArgoCD, Jenkins, Bamboo
- Exposure to Financial Markets is an advantage.
Key Responsibilities
- Responsible for building new features on our data platform primarily in PySpark
- Drive best practices for data engineering and site reliability.
- Challenge the development team on their delivery of quality, unit test coverage and assistance in the creation of development artefacts
