The company is looking to optimize its data pipelines for improved stability, scalability, and cost efficiency.
Requirements
- Proven expertise in ElasticSearch, Databricks, Cassandra, Kafka, and Kubernetes
- Experience with AWS cost optimization
- Solid understanding of distributed systems, databases, and performance tuning
- Strong proficiency in Python and Golang and their respective libraries
- Experience with GitLab CI/CD and Argo CD
Responsibilities
- Analyze and enhance data pipeline stability, scalability, and cost efficiency
- Work on performance tuning and cost reduction of ElasticSearch, Databricks, Cassandra, Kafka, and Kubernetes
- Collaborate with engineering and product leaders to align optimization efforts with business goals, ensuring no adverse impact on user experience
Other
- 3+ years of experience in data platform engineering, with a focus on data pipeline optimization
- Strong analytical skills and a data-driven approach to problem-solving
- Excellent collaboration and communication skills
- Base Salary Range $140,000—$188,000 USD
- Competitive compensation with equity and 401k
- Comprehensive healthcare with dental and vision coverage
- Flexible paid time off and paid holiday time off
- 12 weeks of new parent or family leave
- Personal and professional development resources
