The company is looking to hire a Data Engineer to help clients progress on their Data and Analytics journey by building data pipelines. This involves understanding client needs, designing and developing data integration solutions, optimizing performance, and ensuring data quality.
Requirements
- Strong Experience on data engineering tools - DataBricks (primary), Python.
- Strong experience in designing and developing efficient and scalable data. integration/engineering solutions to support key client initiatives.
- Working Knowledge on Qlik, Kafka, Pentaho, Snowflake is required.
- Must have strong SQL experience and extract data from various databases and perform required analysis on data.
- Understanding of data modelling concepts, including relational and dimensional modelling.
- Knowledge on AI Frameworks, LLMs, Basics of Data Science.
- Experience on any BI tools like Microstrategy, Power B.
Responsibilities
- Design, develop, and implement data integration solutions using Data Engineering tools like DataBricks primarily, along with Qlik, Kafka
- Develop and maintain automated data pipelines for real-time and scheduled data ingestions
- Conduct performance tuning and optimization of queries and data models.
- Optimize data workflows for efficiency and scalability.
- Design and implement database objects such as tables, views, schemas, and stored procedures.
- Troubleshoot and resolve data-related issues.
- Provide required technical support to development team while delivering the code/project
Other
- Work with clients to understand and define the data initiatives based on business needs
- Work closely with cross-functional teams to gather requirements and translate them into technical specifications.
- Collaborate seamlessly with clients across multiple geographies.
- Communication with business users to understand the requirements. Able to convert the business requirements into technical requirements.
- 7-9 years of experience to Design and develop efficient and scalable data. integration/engineering solutions to support our organization's data analytics and reporting needs.
