Sam's Club is looking to solve the problem of data management and analysis to better serve its customers and improve its business operations.
Requirements
- Proficient in real time ; batch pipelines in big data technologies (i.e.Spark/Kafka/Cassandra/Elasticsearch, No Sql Dbs etc.).
- Proficiency in languages such as Java , Scala , Python
- Experience with the workflow management platform like Airflow/hudi.
- Experience with Cloud computing platforms like GCP and Azure.
- Proficient with Designing and building APIs
- Hands on Experience with PL/SQL to query data ; generate insights using complex queries, stored procedures, and user defined functions.
- Security, API Gateway.
Responsibilities
- Data Transformation and Integration: Extracts data from identified databases and transform data to a structure that is relevant to the problem by selecting appropriate techniques.
- Data Source Identification: Helps identify the most suitable source for data that is fit for the requirements.
- Data Modeling: Analyses complex data elements, systems, data flows, dependencies, and relationships to contribute to conceptual, physical, and logical data models.
- Build and maintain robust and scalable data pipelines with internal and external partners.
- Perform deep analysis leveraging customer datasets to build customer insights.
- Raise the bar on sustainable engineering by improving best practices, producing best in class of code, documentation, testing and monitoring.
- Participates in medium- to large-scale, complex, cross-functional projects by reviewing project requirements; translating requirements into technical solutions; gathering requested information (for example, design documents, product requirement); writing and developing code; conducting unit testing; communicating status and issues to team members and stakeholders; collaborating with cross functional teams; troubleshooting open issues and bug-fixes; enhancing design to prevent re-occurrences of defects; ensuring on-time delivery.
Other
- Bachelors degree in computer science, Data Engineering, Mathematics, or a related field and 3-5 years of proven experience as a Data Engineer or similar role in data management
- Or, masters degree in computer science, Data Engineering, Mathematics, or a related field and 2-3 years of proven experience as a Data Engineer or similar role in data management.
- Excellent problem-solving and analytical skills.
- Strong project management and organizational skills.
- Ability to work in a fast-paced environment and manage multiple priorities.
