Filtr uses AI to scan 1000+ jobs and finds postings that perfectly matches your resume

The Trade Desk is looking to solve problems at scale in building the back-end infrastructure of their platform with a focus on quality at scale, enabling the business to create powerful and efficient insights from data, and delivering features to improve clients' abilities to make real-time decisions and troubleshoot campaigns.

Requirements

• You are an expert in building and tuning large scale data pipelines in Spark
• Experience building complex data pipelines in Airflow is a plus
• You understand engineering fundamentals. At our scale, many off-the-shelf techniques and existing technologies (open source and enterprise) simply don't work.
• You are able to work from first principles to evaluate solutions and adapt them to a unique environment.
• You are a broadly skilled engineer, accustomed to developing web services. You have experience building always-on systems, working across a variety of technologies and service layers.

Responsibilities

• Shaping the vision and execution of how we manage data across its lifecycle — from curated internal datasets to powering production features or privacy-centric exports for external partners.
• Building solutions that will help enable data transparency throughout the org through establishing processing that improve our overall metadata and data lineage
• Designing and owning core, foundational datasets that reduce redundant and costly downstream transformations across the data ecosystem.
• Collaborating closely with Legal, Security, and Governance teams to ensure responsible and compliant usage of data as a steward of our internal data platform.
• Helping define and uphold standards for data quality, observability, and lineage to increase trust and traceability across the organization.

Other

• You are a strong communicator. You’re able to identify and build robust datasets that provides value to multiple functions
• You have a passion for making large scale systematic improvements
• You have a sustained track record of leading engineers with a wide range of experience, while also making significant, self-directed, and end-to-end contributions to large and impactful software projects.
• You are a driver. You will be driving technical projects and providing leadership in a ground-breaking and fast-paced environment. This includes task planning and conducting code reviews, as well as individual code contribution.
• You have a product-focused mindset. You have the passion and ability to contribute to the process of discovering what will delight our clients and push forward one of the world’s largest and most influential industries toward a vision of openness, transparency, and evidence-based decision-making.