Twilio's Go-to-Market (GTM) Data Engineering team needs to scale out its ML + AI infrastructure and better support stakeholders ranging from Sales Systems to Marketing by providing a robust data foundation for sophisticated automations.
Requirements
- 5+ years of experience in developing ML platforms and/or data engineering.
- Experience with big data processing frameworks such as Spark, Flink, or Ray.
- Experience with data orchestration tools like Airflow or Dagster.
- Experience with data warehousing platforms such as Snowflake or BigQuery.
- Experience with Kubernetes and/or other container orchestration systems.
- Experience with infrastructure-as-code tools (e.g., Terraform) and modern CI/CD pipelines.
- Experience on building large scale distributed systems in AWS or a similar cloud provider.
Responsibilities
- Collaborate with other engineers, business partners, and data scientists to build best-in-class data infrastructure that meets evolving needs.
- Design and optimize infrastructure for managing ML workflows at scale.
- Design high-performance systems to ensure fast and efficient AI agent serving.
- Design and manage reverse ETL pipelines to power sales operations and marketing automation.
- Improve internal tooling and developer experience for our data scientists.
- Develop and maintain our data warehouse (Snowflake) to enable efficient and accurate usage of data.
- Document data pipelines, data models, and data transformation processes.
Other
- Proven track record of delivering large-scale data projects and working with business partners.
- Participate in our team’s on call rotation to ensure the availability of our broader data engineering services.
- This role will be remote,but is not eligible to be hired in CA, CT, NJ, NY, PA, WA.
- For this role, you may be required to travel occasionally to participate in project or team in-person meetings.
- The successful candidate’s starting salary will be determined based on permissible, non-discriminatory factors such as skills, experience, and geographic location.
