The J.R. Simplot Company needs a Data Engineer to build and support data pipelines in their cloud environment to create long-term differential business value by sourcing and structuring raw information to help data scientists solve complex business problems.
Requirements
- Proficient in one or more programming languages such as Python or SQL.
- Experience with Azure DevOps, Databricks, SQL, and Data Modeling.
- Experience with Azure Data Factory and Databricks for data processing.
- Experience with DevOps automation, cloud platforms, and advanced data analytics.
- Experience in data collection from sensors and monitoring systems installed on industrial machinery within a manufacturing facility is ideal but not required.
- Experience delivering data solutions through agile software development methodologies is ideal but not required.
- Experience with scalable ML infrastructure and model lifecycle management within environments like Posit Workbench is ideal but not required.
Responsibilities
- Maintains and optimizes data platform performance, ensuring reliability and efficiency across development and production environments.
- Collaborates with data scientists to deploy, monitor, and optimize machine learning models and applications.
- Performs analysis of technical requirements of high complexity.
- Designs and develops solutions of high complexity.
- Designs, prepares, and executes manual and/or automated test plans and scripts.
- Applies in-depth or broad technical knowledge of data engineering to provide maintenance and support of solutions across multiple areas.
- Develops innovative architectural solutions to complex problems.
Other
- Participates as a member of a data engineering team; mentors and guides other engineers.
- Represents team to leadership, business, and technical partners.
- Demonstrates technical leadership and exerts influence beyond immediate team.
- Integrates technical expertise and business understanding to create superior solutions for company and customers.
- Manages work completed by Vendors for specific initiatives.