Citi is seeking a Big Data Lead to deliver on major business priorities within the Client Financial Platform by designing, developing, and maintaining big data applications and pipelines.
Requirements
- Strong understanding of big data concepts, architectures, and technologies (e.g., Hadoop, Spark, Hive, Kafka, NoSQL databases)
- Proficiency in programming languages such as Java, Scala, or Python
- Experience with data warehousing and business intelligence tools
- Experience with data visualization and reporting
- Knowledge of cloud-based big data platforms (e.g., AWS EMR, Azure HDInsight, Google Cloud Dataproc)
- Certifications in relevant big data technologies
- Experience with Spark, Hadoop, Hive, and other relevant tools
Responsibilities
- Leadership and Mentorship: Lead and mentor a team of big data engineers, fostering a collaborative and high-performing environment. Provide technical guidance, code reviews, and support for professional development
- Architecture and Design: Design and implement scalable and robust big data architectures and pipelines to handle large volumes of data from various sources.
- Technology Selection and Implementation: Evaluate and select appropriate big data technologies and tools based on project requirements and industry best practices. Implement and integrate these technologies into our existing infrastructure.
- Data Processing and Analysis: Develop and optimize data processing and analysis workflows using technologies such as Spark, Hadoop, Hive, and other relevant tools.
- Data Quality and Governance: Implement data quality checks and ensure adherence to data governance policies and procedures.
- Performance Tuning and Optimization: Continuously monitor and optimize the performance of big data systems and pipelines to ensure efficient data processing and retrieval.
- Research and Development: Stay up-to-date with the latest advancements in big data technologies and explore new tools and techniques to improve our data infrastructure.
Other
- Bachelor’s degree/University degree or equivalent experience
- Master’s degree preferred
- Demonstrated leadership and project management skills
- Consistently demonstrates clear and concise written and verbal communication
- Ability to adjust priorities quickly as circumstances dictate
