Iron Systems is looking for a Software Engineer III to support efforts to perform data mitigations on large scale datasets (image, video, text) leveraged by FAIR research teams, with the goal to proactively mitigate potential risks associated with these datasets.
Requirements
- writing scripts to automate file processing and data transferring
- creating tools to improve productivity and streamline workflows
- Data pipeline building
- Data processing and cleaning, transformation and formatting, data quality control and validation
Responsibilities
- Preprocessing: converting original datasets into a format that can be consumed by mitigation pipelines.
- Filtering: running filtering using Integrity's pipeline.
- Post-processing: consuming filtering results to filter in the original datasets, repackaging, and re-ingestion.
- Optimization: identify optimization opportunities and improve the process.
- Software engineering skills include writing scripts to automate file processing and data transferring, and creating tools to improve productivity and streamline workflows.
- Data pipeline building.
- Data processing and cleaning, transformation and formatting, data quality control and validation
Other
- Strongly prefer CWs with prior experience at Meta (full 2 years preferred), as this would enable them to leverage their existing knowledge of Meta's internal tools and processes, facilitating a faster onboarding process and more effective contribution to the FAIR mitigation efforts.
- Communication - effective communication skills to collaborate with stakeholders and team members
