The MLOps Engineer (GCP Specialization) is responsible for designing, implementing, and maintaining infrastructure and processes on Google Cloud Platform (GCP) to enable the seamless development, deployment, and monitoring of machine learning models at scale.
Requirements
- Proficiency in programming languages such as Python.
- Expertise in GCP services, including Vertex AI, Google Kubernetes Engine (GKE), Cloud Run, BigQuery, Cloud Storage, and Cloud Composer, Data proc or PySpark and managed Airflow.
- Experience with infrastructure-as-code - Terraform.
- Familiarity with containerization (Docker, GKE) and CI/CD pipelines, GitLab and Bitbucket.
- Knowledge of ML frameworks (TensorFlow, PyTorch, scikit-learn) and MLOps tools compatible with GCP (MLflow, Kubeflow) and Gen AI RAG applications.
- Understanding of data engineering concepts, including ETL pipelines with BigQuery and Dataflow, Dataproc - Pyspark.
- Experience with large-scale distributed ML systems on GCP, such as Vertex AI Pipelines or Kubeflow on GKE, Feature Store.
Responsibilities
- Design and implement pipelines for deploying machine learning models into production using GCP services such as AI Platform, Vertex AI, or Cloud Run, Cloud Composer ensuring high availability and performance.
- Build and maintain scalable GCP-based infrastructure using services like Google Compute Engine, Google Kubernetes Engine (GKE), and Cloud Storage to support model training, deployment, and inference.
- Develop automated workflows for data ingestion, model training, validation, and deployment using GCP tools like Cloud Composer, and CI/CD pipelines integrated with GitLab and Bitbucket Repositories.
- Implement monitoring solutions using Google Cloud Monitoring and Logging to track model performance, data drift, and system health, and take corrective actions as needed.
- Manage versioning of datasets, models, and code using GCP tools like Artifact Registry or Cloud Storage to ensure reproducibility and traceability of machine learning experiments.
- Optimize model performance and resource utilization on GCP, leveraging containerization with Docker and GKE, and utilizing cost-efficient resources like preemptible VMs or Cloud TPU/GPU.
- Ensure ML systems comply with data privacy regulations (e.g., GDPR, CCPA) using GCP’s security tools like Cloud IAM, VPC Service Controls, and Data Loss Prevention (DLP).
Other
- Work closely with data scientists, Data engineers, Infrastructure and DevOps teams to streamline the ML lifecycle and ensure alignment with business objectives.
- Strong problem-solving and analytical skills.
- Excellent communication and collaboration abilities.
- Ability to work in a fast-paced, cross-functional environment.
- Exposure to Generative AI (GenAI) and Retrieval-Augmented Generation (RAG) applications and deployment strategies.
