Lawrence Livermore National Laboratory (LLNL) needs to architect and modernize the data lifecycle for Strategic Deterrence (SD) by moving beyond legacy tooling to build robust, automated data pipelines that capture, characterize, and democratize critical test data, enabling seamless data sharing and real-time decision-making within LLNL and across the NNSA complex.
Requirements
- Experience with Python, including modern development practices, visualization libraries (Plotly, Streamlit), and the scientific stack (pandas, numpy).
- Experience with modern version control (Git), CI/CD platforms, and containers.
- Experience handling structured and unstructured data formats (JSON, YAML, Parquet, XML) and utilizing RESTful APIs.
- Experience with workflow orchestration tools (e.g. Airflow, Prefect, Dagster).
- Knowledge of S3-compatible object storage and Data Lake architectures.
- Comprehensive experience with Python.
- Broad experience independently analyzing and interpreting complex data/business processes requiring advanced knowledge of materials management, manufacturing data management, and/or scientific experimentation.
Responsibilities
- Design and implement data pipelines using both scripting and modern orchestration tools to process unstructured test data from diverse sources.
- Champion DataOps and Software Engineering best practices by implementing version control (Git), CI/CD workflows, containerization, and automated testing to ensure software and pipeline reliability and reproducibility.
- Develop interactive dashboards to democratize data access for scientists and engineers, working with subject matter experts (SMEs) to define programmatic data needs.
- Translate scientific requirements into technical specifications for APIs, pipelines, and visualization tools, acting as a bridge between SMEs and the software team.
- Collaborate with customers to define schemas/ontologies for their data, utilizing tools for data quality validation to ensure standardized characterization of experiments.
- Exercise independent discretion and judgement to define, develop, and implement original solutions to complex data management across a broad set of disciplines at the team, directorate, and institutional level.
- Provide formal/informal technical leadership and/or domain expertise in researching, advising and recommending technical solutions and approaches.
Other
- Ability to obtain and maintain a US DOE Q-level security clearance which requires U.S. Citizenship.
- Ability to travel when necessary.
- Proficient verbal and written communication skills necessary to present technical architectures to non-technical stakeholders and advocate for modern tooling.
- Broad experience collaborating with management, customers or high-level technical personnel to provide direction in the design, evaluation, recommendation, and implementation of systems, services, or processes.
- Comfortable being an advocate for a new technical product.
