Astronomer is looking to solve highly complex technology problems through inventive algorithms and world-class practices around scale for their R&D organization, specifically by building out a world-class Observability team to deliver data observability capabilities that provide customers visibility, reliability, and actionable insights into their data pipelines and products.
Requirements
- Strong technical experience building complex distributed systems, preferably with Golang, Python, Kubernetes, SQL/OLAP databases, and stream processing.
- Hands-on experience designing, developing, and scaling production infrastructure.
- Experience building or scaling data observability products.
- Familiarity with Apache Airflow or similar workflow orchestrators.
- Background in observability, monitoring, or infrastructure at scale (e.g., Datadog, Honeycomb, or similar).
Responsibilities
- Lead the end-to-end architecture and evolution of major platform components, making foundational design decisions that will shape the long-term direction of the observability platform.
- Build scalable, reliable, and performant features that provide visibility into customer data pipelines.
- Write high-quality, maintainable code while following best practices in testing, CI/CD, and operational excellence.
- Set and champion engineering standards for code quality, testing, design, and operational excellence across the team.
- Help improve and evolve the observability platform’s tooling, infrastructure, and processes.
- Lead and coordinate responses to complex production incidents, guiding the team towards rapid resolution and long-term improvements.
- Proactively identify technical opportunities, risks, and gaps - and drive initiatives to address them.
Other
- Collaborate closely with product, design, and cross-functional engineering teams.
- Collaborate closely with product, design, and engineering teams to define and deliver high-impact initiatives.
- Excellent collaboration and communication skills to work effectively across teams.
- Focus on delivering customer value through thoughtful technical solutions.
- Enthusiasm for contributing to a healthy, inclusive engineering culture and supporting the growth of teammates.
- Comfort working in areas of high ambiguity, able to break down open-ended problems and drive them to completion with clarity and structure.
- Mentor engineers of all levels through design reviews, pairing, and feedback, and contribute to the professional growth of the team.
