Marriott International is looking to solve the problem of efficiently managing and processing data for its AI-driven intelligent assistant systems. This involves building robust data pipelines to ingest, transform, and store various data types (text, image, voice) to power AI initiatives like knowledge graphs and vector databases, ensuring data accuracy, timeliness, and cost-efficiency.
Requirements
- 7+ years of professional data engineering experience.
- 2+ years of experience working with embeddings or vector databases.
- Proficiency with Spark, Flink, Kafka, or Kinesis.
- Experience with modern ELT tools such as DBT, Airflow, or Dagster.
- Strong understanding of CDC, schema evolution, and GDPR/CCPA compliance.
- Proficiency in Python and TypeScript for production environments.
- Experience with Infrastructure as Code (Terraform, CDK).
Responsibilities
- Build and operate streaming and batch ETL/ELT pipelines to ingest reservation, loyalty, and property data into analytics, vector, and graph stores.
- Automate embedding generation and refresh processes across text, image, and voice data, utilizing change-data capture techniques and cost-aware routing to GPU/CPU resources.
- Define data contracts and schema evolution strategies that are consumable by autonomous agents and downstream microservices.
- Implement tiered storage and retention policies for managing short-term session memory and encrypted long-term guest profiles.
- Instrument data pipelines with OpenTelemetry metrics and develop dashboards to monitor lineage, data freshness, and cost metrics.
- Collaborate with enterprise architects on data governance standards and partner with technical leads to optimize data retrieval performance.
- Ensure data pipelines adhere to compliance standards and support scalable, secure data architecture.
Other
- Collaborate with enterprise architects and technical teams to optimize data retrieval, storage, and processing.
- Ensure that the data feeding Marriott’s AI systems is accurate, timely, and cost-efficient.
- Play a critical role in enabling Marriott’s AI initiatives by building robust infrastructure that supports knowledge graphs, vector databases, and other advanced data structures.
- Fostering an inclusive and diverse workforce and do not discriminate based on race, color, religion, sex, national origin, age, disability, veteran status, or any other protected characteristic.
