The company is looking to solve data engineering problems using Hadoop stack of technologies and other relevant tools.
Requirements
- Hadoop Stack of Technologies ( Hadoop ,Spark, HBase, Hive , Pig , Sqoop, Scala ,Flume, HDFS , Map Reduce)
- Python & Kafka
- Database concepts , Data Design , Data Modeling and ETL
- Teradata & Informatica
- Machine Learning Models and Artificial Intelligence
- Data Components , Data Processing & Data Analytics on AWS
- Data modeling tools like Erwin
Responsibilities
- Hands on Experience in Hadoop Stack of Technologies ( Hadoop ,Spark, HBase, Hive , Pig , Sqoop, Scala ,Flume, HDFS , Map Reduce)
- Hands on experience with Python & Kafka
- Analyzing, designing, and coding ETL programs which involves Data pre-processing , Data Extraction , Data Ingestion , Data Quality ,Data Normalization & Data Loading
- Delivering projects in Agile Methodology
- Working with Jira
- Co-ordinating deliverables across the SDLC
- Data Modeling and ETL
Other
- 6+ Years experience working in Data Engineer
- Good communication & thought leadership skills
- Client Facing Roles
- Agile Methodology experience
- Good understanding of SDLC
