LMI is looking to solve the problem of extracting datasets from different sources, coordinating the cleaning process, maintaining data integrity, and preparing them for client use in their enterprise data environment for NASA.
Requirements
- Experience developing and automating data pipelines using Databricks
- Proficient in Python for object-oriented programming, automation, and data analysis; also experienced with computational tools such as R.
- Experience with ETL processes, including ingesting data from raw sources (APIs, web scraping), transforming them into usable formats for analysis, and validating them with automated checks
- Hands-on experience with GitHub for version control.
- Familiarity with GitHub Projects for task management.
- Experience building out common AWS infrastructure (e.g. EC2, S3, Lambda rules)
- Working knowledge of databases and SQL; preferred qualifications include linking analytic and data visualization products to database connections
Responsibilities
- Serve as an advisor to our NASA OCHCO (Office of the Chief Human Capital Officer) customer while leading development in data engineering activities
- Develop, implement and maintain a data pipeline using the Databricks platform, including extracting datasets using APIs, manipulating common data formats (e.g., parquet, text files, JSON), and automating routine data refreshes
- Build AWS resources to support data pipelining, storage, and analysis efforts
- Research and recommend software, systems, and processes as needed
- Be an effective consultant, including gathering analytic requirements to provide clear and concise solutions.
- Conduct extensive quality control and record keeping procedures to ensure the highest levels of data integrity
- Work in a fast-paced, solutions-oriented environment focused on client deliverables, analysis, and reporting.
Other
- Bachelor’s Degree (Master's preferred) in a STEM or social science related field including coursework in basic statistics and measurement is required
- 3+ years of related data engineering or technical consulting experience
- Excellent communication skills and proven ability to work with business customers and technical teams
- Ability to work in a fast-paced, solutions-oriented environment focused on client deliverables, analysis, and reporting.
- Travel requirements not specified
