Iron EagleX (IEX) is seeking a Data Engineer SME to design, build, and maintain data collection, processing, and integration pipelines to centralize and structure data from various web-based applications, empowering organizations and end users to operate smarter, faster, and more securely in dynamic environments
Requirements
- Experience with Apache Airflow for workflow orchestration.
- Strong programming skills in Python.
- Experience with ElasticSearch/OpenSearch for data indexing and search functionalities.
- Understanding of vector databases, embedding models, and vector search for AI applications.
- Expertise in event-driven architecture and microservices development.
- Hands-on experience with cloud services (e.g. MinIO), including data storage and compute resources.
- Strong understanding of data pipeline orchestration and workflow automation.
Responsibilities
- Design, develop, and implement scalable data pipelines and ETL processes using Apache Airflow, with a focus on data for AI applications.
- Develop messaging solutions utilizing Kafka to support real-time data streaming and event-driven architectures.
- Build and maintain high-performance data retrieval solutions using ElasticSearch/OpenSearch.
- Implement and optimize Python-based data processing solutions.
- Integrate batch and streaming data processing techniques to enhance data availability and accessibility.
- Ensure adherence to security and compliance requirements when working with classified data.
- Deploy and manage cloud-based infrastructure to support scalable and resilient data solutions.
Other
- Bachelor's degree in Computer Science, Information Systems, Engineering, or a related field (or equivalent experience).
- An active TS/SCI security clearance is REQUIRED, and candidates must have or be willing to obtain a CI Poly.
- Due to US Government Contract Requirements, only US Citizens are eligible for this role.
- This is an onsite position in Crystal City, VA.
- Advanced degrees are a plus.
