The company is looking to solve the problem of designing and implementing large-scale ingest systems in a Big Data environment, optimizing the data lifecycle, and developing custom solutions to ingest and exploit new and existing data sources.
Requirements
- Strong software development experience, to include significant Java development, data analysis/parsing, and SQL/database experience
- Strong experience with the full data lifecycle, from ingest through display, in a Big Data environment
- Experience developing and performing ETL tasks in Linux and/or Cloud environments
- Strong experience with Java-related technologies, such as JDK, J2EE, EJB, JDBC, and/or Spring, and experience with RESTful APIs
- Experience with Hadoop, Hbase, MapReduce
- Experience with Elasticsearch
- Experience working in a mission environment and/or with many different types of data
Responsibilities
- Designing and implementing large-scale ingest systems in a Big Data environment
- Optimizing all stages of the data lifecycle, from initial planning, to ingest, through final display and beyond
- Designing and implementing data extraction, cleansing, transformation, loading, and replication/distribution
- Developing custom solutions/code to ingest and exploit new and existing data sources
- Developing data profiling, deduping logic, and matching logic for analysis
- Organizing and maintaining data layer documentation, so others are able to understand and use it
- Collaborating with teammates, other service providers, vendors, and users to develop new and more efficient methods
Other
- Equal Opportunity Employer/Protected Veterans/Individuals with Disabilities
- Collaborating with teammates, other service providers, vendors, and users to develop new and more efficient methods
- Effectively articulating the risks and constraints associated with software solutions, based on environment
- This employer is required to notify all applicants of their rights pursuant to federal employment laws
- For further information, please review the Know Your Rights notice from the Department of Labor
