The company is looking to solve big data analysis problems using Hadoop ecosystem
Requirements
- Primary Skill: Hadoop Developer
- Secondary: UI – Hive, Spark
- Experience: Minimum 7 years
- Advanced knowledge of the Hadoop ecosystem and its components
- In-depth knowledge of Hive, HBase, and Pig
- Knowledge of SQL Server and Linux is good to have
- Shell Scripting concepts
Responsibilities
- Hive Experience, HOL, File Ingestion
- SQL knowledge (using different functions in the sql rank, dense rank, group)
- Partitioning concepts
- Slowing Changing Dimensions
- Spark Concepts (RDD, Dataframe, Datasets, etc)
- Designing and coding Hadoop applications to analyze data collections
- Creating data processing frameworks
Other
- Minimum 7 years of experience
- High-level analytical and problem-solving skills