Two Six Technologies is looking for a Data Engineer to help policy makers, corporate leaders, and operators make sense of increasingly complex information spaces by collecting and synthesizing huge quantities of publicly available data in multiple languages, then serving that data to be easily queried by expert analysts and used in machine learning analytics.
Requirements
- Extensive experience with the full Elasticsearch stack, including indexing and search APIs, and Kibana, ideally with both locally hosted and Elastic hosted instances
- Experience with SQL database technologies, ideally Postgres
- Experience with AWS or similar cloud-based infrastructure
- Experience with Python
- Experience with the design, development, testing, and support of scalable, data-driven applications deployed to production SaaS environments
- Experience working independently and as a part of an Agile team
- Comfortable with both SQL and noSQL databases, in particular the Elasticsearch stack
Responsibilities
- Developing and enhancing high volume data storage and querying solutions that enable analysis by both human experts and machine learning solutions
- Creating proofs-of-concept and prototypes to quickly test ideas, as well as designing and building scalable, production-ready solutions
- Considering security best practices at every phase of software development
- Working closely with application engineers, mostly working in Python, to implement scalable solutions for loading, generating, aggregating, and analyzing data
- Creating and executing both manual and automated testing
- Applying best practices for data storage and retrieval in the design and implementation of new products, features, and capabilities
- Organizing data in a way that supports the latest in Natural Language Processing analytics, including generative AI
Other
- Operating in a collaborative, agile environment, with a focus on taking action and working closely with peers to enable team success
- Continuously learning and improving
- Working within Agile software development methodologies and being an active part of our continuous improvement efforts
- Working in a fully remote team with a diverse set of skills and experiences
- Independently identifying and solving problems, and questioning assumptions in pursuit of the right solutions
