Two Six Technologies needs an AI/ML Data Pipeline Engineer to help policy makers, corporate leaders, and operators make sense of increasingly complex information spaces by collecting and synthesizing huge quantities of publicly available data in multiple languages, then serving that data to be easily queried by expert analysts and used in machine learning analytics.
Requirements
- Extensive experience with the full Elasticsearch stack, including indexing and search APIs, and Kibana, ideally with both locally hosted and Elastic hosted instances
- Experience with SQL database technologies, ideally Postgres
- Experience with AWS or similar cloud-based infrastructure
- Experience with Python
- Experience with the design, development, testing, and support of scalable, data-driven applications deployed to production SaaS environments
- Experience working independently and as a part of an Agile team
- Experience with technologies like Docker and Kubernetes
Responsibilities
- Developing and enhancing high volume data storage and querying solutions that enable analysis by both human experts and machine learning solutions
- Creating proofs-of-concept and prototypes to quickly test ideas, as well as designing and building scalable, production-ready solutions
- Working closely with application engineers, mostly working in Python, to implement scalable solutions for loading, generating, aggregating, and analyzing data
- Creating and executing both manual and automated testing
- Operating in a collaborative, agile environment, with a focus on taking action and working closely with peers to enable team success
- Considering security best practices at every phase of software development
- Actively participating in the peer code review process
Other
- Operating in a collaborative, agile environment, with a focus on taking action and working closely with peers to enable team success
- Continuously learning and improving
- Working within Agile software development methodologies and being an active part of our continuous improvement efforts
- Working in a fully remote team with a diverse set of skills and experiences
- Independently identifying and solving problems, and questioning assumptions in pursuit of the right solutions
