Kipu is looking to advance behavioral health care by building the foundation that powers real-time and batch data products, delivering critical insights to users and customers. The company aims to improve data movement across systems, enable joins between batch and streaming data, and facilitate secure data exchange with internal and external partners.
Requirements
- Deep expertise in streaming technologies, especially Apache Flink.
- Strong experience with AWS services (e.g., Kinesis, Lambda, S3, Glue, EMR, ECS, Redshift).
- Proficient with Apache Iceberg, or similar table formats (e.g., Delta Lake, Hudi).
- Proven experience in joining streaming and batch data, with a strong understanding of consistency models, watermarking, and state management.
- Solid SQL skills for data exploration, transformations, and performance tuning.
- Experience designing and managing data exchange pipelines, delivering large-scale, scheduled datasets safely to various consumers.
- Strong understanding of distributed systems, networking, and data architecture.
Responsibilities
- Design and develop scalable, low latency streaming data pipelines using Apache Flink on AWS.
- Architect and implement solutions to join streaming and batch data, ensuring consistency, accuracy, and performance.
- Build and manage infrastructure for efficient and secure data exchange, enabling scheduled delivery of large datasets to internal teams and external partners.
- Leverage Apache Iceberg for reliable, scalable table formats across both batch and streaming systems.
- Write and optimize complex SQL queries for analytical workflows and platform integration.
- Work with AWS Redshift to support scalable, performant batch processing and business intelligence use cases.
- Collaborate with data scientists, product teams, and platform engineers to enable real-time analytics and data-driven features.
Other
- Preference will be given to candidates who live in Florida, as well as Salt Lake City, Utah and Phoenix, Arizona.
- Excellent communication and collaboration skills; able to work cross-functionally in a fast-paced environment.
- Highly competitive salary with bonus potential.
- Flexible paid time off.
- We are an equal opportunity employer and highly value diversity at our company.
