SHEIN is looking to hire a Senior Big Data Engineer to own US-based Big Data operations, drive refactoring and redesign efforts, and collaborate with a global organization to build and deploy highly scalable data pipelines, ensuring data security and quality.
Requirements
- 8+ years of hands-on experience engineering data pipelines using big data technologies (Hive, Presto, Spark, Flink).
- Demonstrated ability to write complex SQL, a high degree of competency in programming with Python, and a passion for writing clean, maintainable code.
- Proficient in scripting language such as shell, Perl, or others.
- Experience working in Unix/Linux environments.
- Experience using Azure, AWS, GCP, or another cloud provider
Responsibilities
- Design and implement efficient, scalable data pipelines to extract, transform, and load data, ensuring seamless data movement across systems.
- Automate current workflows using AI tools or other software technologies to improve efficiency and scalability.
- Perform data-quality checks to maintain accuracy, consistency, and completeness.
- Optimize pipelines for performance and reliability, addressing bottlenecks and inefficiencies.
- Ensure data integrity, security, privacy, and high availability across all systems.
- Monitor pipelines for issues, diagnose problems as they arise, and implement timely resolutions.
- Conduct detailed root-cause analyses of data processes, providing actionable insights for improvement.
Other
- Partner with global teams (data, security, infrastructure, and business) to understand requirements and deliver scalable solutions.
- Collaborate cross-functionally to identify root causes and implement long-term preventive measures.
- Maintain comprehensive documentation of pipeline designs, processes, and troubleshooting guides, ensuring clear communication with stakeholders.
- Provide 24x7x365 on-call support on a rotational basis, ensuring the continuous availability of data systems.
- High level of personal integrity, with the ability to handle confidential matters professionally, exercise sound judgment, and demonstrate maturity.
- The ability to remain calm during crises and effectively resolve issues in accordance with SLAs.
- Demonstrated leadership skills with the ability to lead large-scale projects and initiatives with quantifiable impact, providing vision, direction, and mentorship to team, while also demonstrating strategic thinking.
- Excellent verbal and written communication skills, with a proven ability to work effectively with geographically distributed teams.
- Ability to speak/read Mandarin Chinese
