Quora is looking to optimize, enhance, and potentially re-design its company's data architecture/pipelines to support its next generation data initiatives, focusing on improving system reliability, cost efficiency, and data modeling.
Requirements
- Proficiency in Python and SQL query design
- Experience with big data processing frameworks, like: Hive, Spark and Trino
- Experience building data-intensive applications (high velocity/high volume)
- Experience with SQL/NoSQL data store & data lake operations
- Experience in performance optimization or cost saving projects
- Hands-on experience with AWS technologies like S3, EC2, RDS, EKS, or in Apache Iceberg
Responsibilities
- Identify and implement improvements to system’s cost efficiency, reducing data storage and processing costs
- Design and implement scalable and efficient data architectures, meeting data needs from data scientists, engineers and business partners
- Bring your expertise to help model structured & unstructured data.
- Own these data models at a high level & be a data consultant for partner teams
- Champion best practices on system usages and hold high-quality code standards
- Participate in the team’s oncall rotation, helping solve timely reliability incidents
Other
- Availability for meetings and impromptu communication during Quora's “coordination hours" (Mon-Fri: 9am-3pm Pacific Time)
- 2-5 years of experience working in Data Infrastructure
- Flexibility for working and owning different Data Engineering systems - open to working on the areas with highest priority for the company at a given time
- Flexible and positive team player with good interpersonal skills