Dagster Labs is looking for a software engineer to contribute to the Dagster platform, which empowers organizations to create scalable and productive data platforms. The role aims to solve real-world problems and deliver meaningful solutions for users and customers by enhancing the core Dagster framework and developer experience.
Requirements
- Proficiency in Python or a similar high-level programming language, and working familiarity with frontend development.
- Expertise across the full software development lifecycle, from planning to delivery and iteration
- Experience with Dagster or related data orchestrators.
- Experience with data engineering, MLOps, or AI pipelines (e.g. ETL tools, Spark, MLflow, Hugging Face, etc).
- Experience with data platforms, infrastructure as code, and Docker-based deployment patterns.
- Candidates should be comfortable making incremental changes in this React codebase, though most day‑to‑day work will be in Python.
Responsibilities
- Contribute to the core Dagster framework by designing, implementing, and maintaining foundational features that power data orchestration at scale.
- Enhance the open source developer experience through improved documentation, tooling, and workflows that help contributors and users be productive from day one.
- Build and extend Components to enable modular, reusable patterns for data platform development.
- Evolve the core API including features such as freshness policies, declarative automation, sensors, schedules, Ops & Jobs, configuration, resources, and legacy functionality.
- Drive AI-driven innovation by exploring and implementing scaffolding and automation tools in the open source ecosystem.
- Improve local development and testing workflows to make it faster, easier, and more reliable for developers to build, run, and validate their Dagster projects.
Other
- Relevant degree in a Computer Science related field OR 3+ years of relevant software development experience
- Strong written and oral communication skills
- Proven effectiveness at contributing to and executing as part of a team
- This is a full-time, competitively paid position with benefits, based out of our San Francisco office.
- You’ll be part of a highly collaborative, in-person team that works closely together to design, build, and ship high-impact features.
