Live Nation Entertainment is looking to enhance and continuously improve the performance and reliability of their existing Data Platform Services to meet the requirements from Data Engineering/Product team
Requirements
Good understanding of Data Lakes, Data Warehouses
Software development, coding expertise in the Data engineering field using any of the Python/PySpark
Hands on experience using version control systems such as Git and CI/CD workflows and practice
Decent expertise using ANSI SQL and Spark SQL
Workflow automation, orchestration using Airflow or equivalent tools stack
Hands on working knowledge on at least in one of these : Databricks, Hadoop and related stacks
Working experience in at least one of cloud services from any of the Amazon AWS, Google GCP or Microsoft Azure, preferably AWS
Responsibilities
Contribute to the enhancements and continuous improvement of performance and reliability of the existing Data Platform Services to meet the requirements from Data Engineering/Product team
Design and build self servicing onboarding and automation capabilities in Core Data Platform services in a scalable, reliable and secure way
Design and build platform capabilities to support onboarding and operation effectiveness
Design and develop scalable data platform and integration solutions for various data sources leveraging Databricks Unified Platform
Ensure data quality and integrity across all data systems
Ensure data security and compliance with relevant regulations
Implement best practices for data management and governance
Other
Bachelor's degree in Computer Science, Information Technology, or related field
5+ years of experience in data engineering
Excellent communication and collaboration skills
Ability to work in a fast-paced environment and meet deadlines
Strong problem-solving skills and attention to detail