HCA Healthcare is looking to manage and develop data pipelines on Google Cloud Platform (GCP) to integrate data from various HCA source systems and external vendors, ensuring data accessibility and usability for analysis, visualization, machine learning, and product development.
Requirements
- 5+ Years of hands-on experience with many of the following components: Spark Streaming, Kafka
- SQL, JSON, Avro, Parquet
- Java, Python, Scala
- 3+ Years of hands-on experience with GCP platform and experience with many of the following components: Cloud Run, GKE, Cloud Functions
- Bigtable, Firestore, Cloud SQL, Cloud Spanner
- GoLang, Pub/Sub
- BigQuery, Dataflow, Data Fusion
Responsibilities
- Manage data engineers towards the successful development and maintenance of data pipelines using HCA’s Google Cloud Platform (GCP).
- Guide the teams that build and maintain data pipelines from all HCA source systems that require data to be integrated into the GCP.
- Oversee the building and maintenance of pipelines that send and receive data to external vendors and affiliates.
- Oversees all the development and operational aspects of the Enterprise Big Data Management team.
- Recruit, develop, and manage employees within area of responsibility to lead data engineers who build data pipelines into various source systems, and enable exploration and access for analytics, visualization, machine learning, and product development efforts across the company.
- Assist in the design and support of data flows required to support current and future Enterprise reporting initiatives.
- Perform unit tests and conduct reviews with other team members to make sure our code is rigorously designed, elegantly coded, and effectively tuned for performance.
Other
- Advanced communication and interpersonal skills, be able to work well in teams, and be self-motivated.
- Manage your project goals, contribute to product strategy, and help develop your team.
- Set and communicate team priorities that support the broader organization's goals.
- Upholds and strengthens best practices and SOP’s in compliance with audit and regulatory standards along with any HCA or department specific defined guidelines.
- Demonstrate strong, problem solving, communication, organizational, time management, and multi-tasking skills.