Two Six Technologies needs to solve the business problem of helping policy makers, corporate leaders, and operators make sense of increasingly complex information spaces by collecting and synthesizing huge quantities of publicly available data in multiple languages, then serving that data to be easily queried by expert analysts and used in machine learning analytics.
Requirements
- Extensive knowledge of HTTP, HTML, CSS, JavaScript, and other web technologies
- Working with Python for multiple years
- Experience building solutions using AWS, Linux, and with containerization technologies like Docker and Kubernetes
- Previously built and maintained web scraping tools that navigate and collect publicly available data at scale
- Experience with the design, development, testing, and support of scalable, data-driven applications written in Python and deployed to production SaaS environments
- Experience with web scraping and other techniques for collecting data from the internet
- Deep understanding of HTTP, HTML, JavaScript, CSS, and other technologies that power websites
Responsibilities
- Leading the development of high volume data collection solutions that enable analysis by both human experts and machine learning solutions
- Rapidly develop software as an individual contributor at a high level and be an exemplar of quality, scalable, robust code
- Creating proofs-of-concept and prototypes to quickly test ideas, as well as designing and building scalable, production-ready solutions
- Collaborating with architects and Product leads on the roadmap for data collection capabilities
- Staying current with the latest technological developments in web scraping and the challenges of maintaining collection as data sources quickly evolve
- Overseeing the data collection codebase, setting and maintaining coding standards, patterns, and best practices
- Supporting the data collection capability, researching and responding quickly to issues, adapting collection to meet new challenges
Other
- Must be eligible to obtain a US government clearance
- Experience working in Agile software development environments
- Experience being a “go-to” technical expert, leading the implementation of features and fixes, while ensuring the continued quality, scalability, and security of the codebase
- Working in a fully remote team with a diverse set of skills and experiences
- Independently identifying and solving problems, and questioning assumptions in pursuit of the right solutions
