Steampunk is looking for a Data Engineer to develop enterprise-grade data platforms, services, and pipelines for their clients, who are aiming to become data-driven organizations leveraging visual analytics platforms.
Requirements
- 5-7 years direct experience in Data Engineering with experience in tools such as: Big data tools: Hadoop, Spark, Kafka, etc.
- Relational SQL and NoSQL databases, including Postgres, CloudSQL, MongoDB
- Data pipeline and workflow management tools: Azkaban, Luigi, Airflow, etc.
- AWS cloud services: EC2, EMR, RDS, Redshift (or Azure and GCP equivalents)
- Data streaming systems: Storm, Spark-Streaming, etc.
- Search tools: Solr, Lucene, Elasticsearch
- Object-oriented/object function scripting languages: Python, Java, C++, Scala, etc.
Responsibilities
- Lead and architect migration of data environments with performance and reliability.
- Assess and understand the ETL jobs, workflows, BI tools, and reports.
- Address technical inquiries concerning customization, integration, enterprise architecture and general feature / functionality of data products.
- Experience in crafting database / data warehouse solutions in cloud (Preferably GCP. Alternatively Azure, AWS).
- Key must have skill sets – Python.
- Support an Agile software development lifecycle.
- You will contribute to the growth of our Data Exploitation Practice!
Other
- Ability to hold a position of public trust with the US government.
- 5-7 years industry experience coding commercial software and a passion for solving complex problems.
- As part of the application process, you are expected to be on camera during interviews and assessments.
- We reserve the right to take your picture to verify your identity and prevent fraud.
- We are an equal opportunity employer and all qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, disability status, protected veteran status, or any other characteristic protected by law.
