FTSE Russell is establishing a team of engineers to build a next-generation data platform to power the indices trusted by financial institutions worldwide. The problem is to create scalable, reliable, and high-quality data solutions within an AWS environment.
Requirements
- Technical knowledge of data engineering solutions and practices. Implementation of data pipelines using tools like EMR, AWS Glue, AWS Lambda, AWS Step Functions, API Gateway, Athena
- Proficient in Python and Spark, with a focus on ETL data processing and data engineering practices.
- Familiar with data services in a Lakehouse architecture.
- Familiar with technical design practices, allowing for the creation of scalable, reliable data products that meet both technical and business requirements
- Familiarity with terraform
- Solid understanding of AWS services and cloud solutions, particularly as they pertain to data engineering practices. Familiar with AWS solutions including IAM, Step Functions, Glue, Lambda, RDS, SQS, API Gateway, Athena.
- Proficient in quality assurance practices, including code reviews, automated testing, and standard methodologies for data validation.
Responsibilities
- Crafting and developing scalable, testable data processes using Python and Apache Spark
- Working with AWS tools such as Glue, EMR Serverless, Lambda, and S3
- Applying software engineering practices: version control, CI/CD, modular design, and automated testing
- Helping in the development of our Lakehouse using Apache Iceberg
- Building observability into data flows and implementing basic quality checks
- Participating in code reviews, pair programming, and architecture discussions
- Continuously learning about the financial indices domain and sharing insights with the team
Other
- Collaborating with our business users and translate requirements into data-driven solutions
- Writes high quality code, ensuring solutions meet business requirements and technical standards.
- Works with architects, Product Owners, and Development leads to decompose solutions into Epics, assisting the design and planning of these components.
- Builds clear, comprehensive documentation that clearly showcases understanding of the implementation and compliance.
- Experienced in Agile development, including sprint planning, reviews, and retrospectives
