The company is looking to build the next generation of data pipelines and applications using emerging technologies like generative AI and large language models. The goal is to prove the value of new technologies and bring them to production quickly, while also crafting a vision for LLM analytics.
Requirements
- Some working knowledge and curiosity about GenAI technologies, such as LLMs, vector databases, or AI-driven data pipelines.
- Familiarity with the development ecosystem evolving around LLM integration, such as langchain.
- Understanding REST-based APIs, vectorized embeddings, and other Retrieval Augmented Generation AI workload components.
- Direct experience with data modeling, ETL/ELT development principles, cloud development, and data warehousing concepts
- Knowledge of cloud technologies such as AWS, Azure, GCP
- Knowledge of data management fundamentals and data storage principles
- Experience in building data pipelines using Python/SQL or similar programming languages.
Responsibilities
- Design, build, and scale data pipelines across a variety of source systems and streams (internal, third-party, and cloud-based), distributed/elastic environments, and downstream applications and self-service solutions.
- Interface with other technology teams to extract, load, and transform data from a wide variety of data sources using cloud-native data engineering principles.
- Become a subject matter expert for data engineering-related technologies and designs.
- Coach and guide others within the organization to build scalable pipelines based on foundational data engineering principles.
- Build and manage relationships with supporting engineering teams to deliver work products to production effectively.
- Develop automated tests for your code, ensuring every function, service, and object is compatible with your team's work and with the many systems within the NBCUniversal system portfolio and cross-device and browser compatibility.
- Deploy to cloud-based platforms and troubleshoot application, cloud, and configuration issues when necessary.
Other
- 8+ years of experience in a data engineering role, with a strong emphasis on leading data engineering teams
- Ability to think critically about problems, decipher user preferences versus challenging requirements, and effectively use online and onsite resources to find appropriate solutions.
- Proven ability to thrive in an agile development environment, adept at incorporating feedback and adjusting to changing priorities.
- Effective communication skills, capable of working collaboratively across diverse teams and navigating a large, matrixed organization efficiently.
- Fully Remote
