Arrowstreet Capital is looking to enhance its data infrastructure by streamlining the ingestion and transformation of new data sources, enabling rapid delivery of actionable analytics across the firm.
Requirements
- At least 5 years of experience working with data lakes, data warehousing, and/or database systems, including processing frameworks like Spark, Hadoop, Presto, etc.
- You strive to write elegant code, and you're comfortable with picking up new technologies independently
- You are fluent in at least one major programming language (e.g. Python, C)
- Hands-on experience working with AWS. and automation through infrastructure as code with one of the Terraform, Pulumi, Cloudformation and CDK etc.
- Experience designing and deploying APIs and client libraries using tools such as OpenAPI, FastAPI, or similar frameworks.
- You have experience with real-time streaming processing with Kafka, Kinesis, and Apache Flink etc.
- Experience with modern data processing frameworks
Responsibilities
- Define and execute the technical roadmap for the platform that can support batch and real-time data sets using modern data processing frameworks.
- Oversee and contribute to building features for data discovery, lineage, governance, ingestion operation, cost management, performance, etc.
- Lead and assist the team in investigating potential improvements achieved by adopting new data technologies and frameworks.
- Achieve high quality metrics through automated testing, robust operational tooling, and highly-available cloud architecture.
- Production support of the platform to avoid disruption to investment processes.
- Collaborate closely with business stakeholders to understand their data needs, translate business objectives into scalable and efficient data engineering solutions.
- Partner with IT operations and cloud security teams to ensure platform solutions are secure, scalable, and reliable.
Other
- Bachelor’s degree in Computer Science, Computer Engineering or a related discipline
- Develop and mentor a junior Data Engineers
- We maintain a friendly, team-oriented environment and place a high value on professionalism, attitude and initiative.
- All qualified applicants will receive consideration for employment without regard to sex, race, color, religion, national origin, ancestry, genetic information, age, pregnancy, medical condition, disability, veteran or military status, marital status or any other characteristic protected by federal, state, or local law.
- Arrowstreet Capital is committed to working with and providing reasonable accommodations for qualified individuals with disabilities and disabled veterans.
