Slingshot Aerospace is seeking to manage and process observational satellite data with minimal latency and high reliability, and the Data Engineering team plays a critical role in ensuring its success
Requirements
- Proficiency in Python and experience building high-performance data processing systems
- Strong experience with MongoDB; familiarity with PostgreSQL and Databricks
- Solid understanding of ETL pipelines, data transformation, and large-scale data management
- Experience developing in Linux environments, including containerized deployments using Docker and Kubernetes in AWS
- Experience with source control systems (e.g., Git) and CI/CD workflows
- Experience building and debugging distributed data pipelines using Databricks, Apache Spark, or similar platforms
- Familiarity with MongoDB change streams and streaming frameworks like RabbitMQ or Kafka
Responsibilities
- Design, build, and maintain high-performance ETL pipelines using Python, MongoDB, and AWS EKS, supporting the ingestion and processing of 20–30GB of satellite data daily
- Develop and maintain scalable APIs and services for data ingestion, transformation, and export to customers
- Optimize data workflows to improve throughput, latency, and system uptime, ensuring reliable data delivery at scale
- Build and maintain monitoring, alerting, and performance dashboards using Datadog for proactive system health tracking and fault resolution
- Collaborate with engineering, product, and operations teams to deliver mission-critical data systems that meet customer needs
- Contribute to the architecture, automation, and observability of cloud-native systems, following industry best practices
- Support the strategic transition of workloads to Databricks and PostgreSQL, helping modernize and scale our data platform
Other
- Must be able to work remotely with sufficient internet bandwidth to support video conferencing and development activities
- Ability to travel up to 10% of the time
- Strong written communication skills and ability to produce clear technical documentation
- Self-starter with the ability to work independently and collaboratively in a fast-paced, remote environment
- 5+ years of experience in software or data engineering
