BTI360 is seeking a Senior Data Platform Engineer to modernize the unclassified OSINT data layer, expanding an enterprise data lake into a community-wide data hub. The role involves architecting scalable ingestion, storage, and data-sharing solutions on AWS, driving new access patterns, performance optimizations, and AI-powered data enrichments to solve large-scale data challenges and elevate OSINT capabilities.
Requirements
- A strong software engineering foundation with 4+ years of Java and Spring Framework experience, emphasizing robust testing practices and clean architecture.
- Hands-on experience with AWS cloud services, including S3, DynamoDB, EKS/Kubernetes, DocumentDB, Lambda, Timestream, and CloudWatch.
- Experience operating production systems at terabyte-to-petabyte scale, optimizing data propagation, versioning, and distributed access.
- A passion for system observability, with expertise in monitoring and alerting mechanisms for data pipelines (Prometheus, Grafana, Splunk).
- Proficiency with Infrastructure as Code (Terraform, CloudFormation, AWS CDK), ensuring scalable and repeatable deployments.
- Strong problem-solving skills in tackling complex architectural challenges and influencing technical decisions across multiple teams.
Responsibilities
- Work closely with teammates and stakeholders in a Lean Agile environment to build mission-critical production applications focused on data ingestion, storage, routing, and access control
- Participate in code reviews, system design discussions, and continuous improvement initiatives
- Leverage modern build tools, testing frameworks, and CI/CD pipelines to ensure quality and delivery speed
- Design, implement, and test backend services and APIs using a Java/Spring stack for production applications
- Integrate with cloud services to expose high-value data through secure, performant interfaces
- Leverage DevSecOps pipelines, containers, and modern deployment tools to deliver software efficiently and reliably
Other
- A self-starter mindset, demonstrating leadership in delivering high-impact solutions and aligning engineering efforts with mission objectives.
- An active Secret clearance, with the ability to upgrade to TS/SCI with Polygraph.
- Familiarity with intelligence workflows, data discovery, and unclassified OSINT operations.
- Experience leading cross-functional technical initiatives and driving best practices across engineering teams.
- Effective communication and collaboration skills to engage with stakeholders at various levels.
