Akuna Capital is looking to solve the problem of providing trustworthy data to support various data-driven initiatives within its Quant, Trading, and Business Operations business units by designing, building, and maintaining systems, applications, and infrastructure needed to collect, store, process, manage, and query Akuna’s data assets.
Requirements
- Java/Scala experience required – Python experience a significant plus
- Prior hands-on experience with data platforms and technologies such as Delta Lake, Spark, Kubernetes, Kafka, ClickHouse, and/or Presto/Trino
- Experience building large-scale batch and streaming pipelines with strict SLA and data quality requirements
- Recent hands-on experience with AWS Cloud development, deployment and monitoring necessary
- Demonstrated experience working on an Agile team employing software engineering best practices, such as GitOps and CI/CD, to deliver complex software projects
- Experience with Big Data and hybrid cloud architecture
- Knowledge of Kubernetes/EKS, Kafka/MSK and Databricks/Spark
Responsibilities
- Drive the ongoing design and expansion of our data platform across a wide variety of data sources, supporting an array of streaming, operational and research workflows
- Build and deploy batch and streaming pipelines to collect and transform our rapidly growing Big Data set within our hybrid cloud architecture utilizing Kubernetes/EKS, Kafka/MSK and Databricks/Spark
- Mentor junior engineers in software and data engineering best practices
- Produce clean, well-tested, and documented code with a clear design to support mission critical applications
- Build automated data validation test suites that ensure that data is processed and published in accordance with well-defined Service Level Agreements (SLA’s) pertaining to data quality, data availability and data correctness
- Challenge the status quo and help push our organization forward, as we grow beyond the limits of our current tech stack
- Work closely with Trading, Quant, Technology & Business Operations teams throughout the firm to identify how data is produced and consumed, helping to define and deliver high impact projects
Other
- BS/MS/PhD in Computer Science, Engineering, Physics, Math, or equivalent technical field
- 5+ years of professional experience developing software applications
- Highly motivated and willing to take ownership of high-impact projects upon arrival
- Must possess excellent communication, analytical, and problem-solving skills
- Ability to react quickly and accurately to rapidly changing market conditions