Clarity Innovations is looking to support the U.S. Special Operations Command (SOCOM) with data governance and data modernization efforts to make them more capable and effective when leveraging their data resources.
Requirements
- Verifiable work experience working with data structures, database management, distributed computing, and API driven architectures using SQL and No-SQL engines.
- Proficient in modeling frameworks like Universal Modeling Language (UML), Agile Development, and Git Operations.
- Familiarity with PowerBI, Foundry, Databricks.
- Administer cloud computing and CI/CD pipelines to include Azure, Google, and Amazon Web Service (AWS).
- A basic knowledge in machine learning is also required to build efficient and accurate data pipelines to meet the needs for downstream users such as data scientists to create the models and analytics that produce insight.
- Data engineers can create and integrate application programming interfaces (APIs).
- Their technical skills generally include multiple programming languages and a deep knowledge of SQL database design.
Responsibilities
- Developing, maintaining, and testing infrastructures for data generation to transform data from various structured and unstructured data sources.
- Develop complex queries to ensure accessibility while optimizing the performance of NoSQL and or big data infrastructure.
- Create and maintain optimal data pipeline architecture.
- Build and maintain the infrastructure to support extraction, transformation, and loading (ETL) of data from a wide variety of data sources.
- Extract data from multiple data sources, relational SQL and NoSQL databases, and other platform APIs, for data ingestion and integration.
- Configure and manage data analytic frameworks and pipelines using databases and tools such as NoSQL, SQL, HDInsight, MongoDB, Cassandra, Neo4j, GraphDB, OrientDB, Spark, Hadoop, Kafka, Hive, and Pig.
- Apply distributed systems concepts and principles such as consistency and availability, liveness and safety, durability, reliability, fault-tolerance, consensus algorithms.
Other
- Minimum of 1-year experience is required.
- A Top Secret clearance with SCI eligibility is required.
- Familiarity with DoD.
- Coordinate with stakeholders, including product, data and design teams to assist with data-related technical issues and support their data infrastructure needs
- A Certified Data Management Professional certification is preferred.
