Reflexive Concepts is seeking a skilled Software Engineer to develop and maintain scalable real-time ETL pipelines to process large-scale data streams, transforming raw data into actionable insights.
Requirements
- Experience using the Linux CLI
- Experience developing scripts using Bash/Python
- Recent software development experience with Java in a Linux environment
- Familiarity with real-time streaming concepts, distributed computing fundamentals, and big data ecosystems such as Apache Storm, Apache Flink, Apache Spark, or Apache NiFi
- Experience with CI/CD concepts, principles, methodologies, and tools such as GitLab CI
- Experience with containerization technologies such as Docker
- Experience with Git Version Control System
Responsibilities
- developing, and maintaining scalable real-time ETL (Extract, Transform, Load) pipelines using Apache Storm and Java to process large-scale data streams
- transforming raw data into actionable insights by ensuring high performance, availability, and reliability of the HPC organization’s data feeds
Other
- Master's degree in Computer Science or related discipline from an accredited college or university. OR Bachelor's degree in Computer Science or related discipline from an accredited college or university, plus two (2) years of experience as a SWE, in programs and contracts of similar scope, type, and complexity. OR Four (4) years of experience as a SWE, in programs and contracts of similar scope, type, and complexity.
- Experience with the Atlassian Tool Suite (JIRA, Confluence)
