QinetiQ US is looking to solve the problem of successfully ingesting, cleansing, transforming, loading, and displaying significant amounts of data, with a particular focus on Cloud data, by hiring a Software Developer.
Requirements
- Strong software development experience, to include significant Java development, data analysis/parsing, and SQL/database experience.
- Strong experience with the full data lifecycle, from ingest through display, in a Big Data environment.
- Strong experience with Java-related technologies, such as JDK, J2EE, EJB, JDBC, and/or Spring, and experience with RESTful APIs.
- Experience developing and performing ETL tasks in Linux and/or Cloud environments.
- Demonstrated experience delivering solutions using Cloud technologies, such as AWS, Microsoft Azure, etc.
- Experience with Hadoop, Hbase, MapReduce.
- Experience with Elasticsearch.
Responsibilities
- Designing, implementing, and optimizing large-scale ingest systems in a Big Data Cloud environment.
- Optimizing all stages of the data lifecycle, from initial planning, to ingest, through final display and beyond.
- Designing and implementing data extraction, cleansing, transformation, loading, and replication/distribution.
- Developing custom solutions/code to ingest and exploit new and existing data sources.
- Developing data profiling, deduping logic, and matching logic for analysis.
- Organizing and maintaining data layer documentation, so others are able to understand and use it.
- Collaborating with teammates, other service providers, vendors, and users to develop new and more efficient methods.
Other
- Active TS/SCI clearance with polygraph required
- Effectively articulating the risks and constraints associated with software solutions, based on environment.
- Experience working in a mission environment and/or with many different types of data.
