Comcast is looking to hire a Lead Software Engineer (Data) to provide technical leadership for a team responsible for creating and maintaining large-scale Big Data systems and Data Environments. These systems are used to ingest and process large data sets, providing actionable recommendations through data warehousing and business intelligence.
Requirements
- developing software in an Agile development environment using SQL, Scala, Java, or Python
- using Kubernetes
- using AWS
- using Presto or Spark
- Datadog or similar observability tool
- Terraform
- Jenkins
Responsibilities
- Provide technical leadership to a team responsible for creating and maintaining large scale Big Data systems and Data Environments, used to ingest and process large data sets and provide actionable recommendations using data warehousing and business intelligence
- design, develop, test, and maintain software that extracts, transforms, and loads large volumes of data
- develop software systems in an Agile development environment and on Kubernetes within AWS cloud-based platform using SQL, Golang, Python, Presto, Spark, Datadog, Terraform, Jenkins, Scala, Apache Hadoop, Spark, Snowflake, Databricks, and AWS Elastic MapReduce
- deploy software on AWS using Terraform
- develop Microservices API systems to support overall product development
- store relational data in MySQL to support API and data processing applications
- concurrently execute data processing software using multithreading
Other
- Bachelor’s degree, or foreign equivalent, in Computer Science, any Engineering, or related technical field
- seven (7) years of experience
- one (1) year of experience includes using Snowflake or Databricks or Google BigQuery
- storing relational data in MySQL or Postgres to support API and data processing applications
- debugging functional and performance issues on software modules
