Discord is seeking to improve its data infrastructure and services to drive business insights and innovation, particularly in the gaming sector where over 90% of its users play games, spending a combined 1.5 billion hours playing thousands of unique titles on Discord each month.
Requirements
- 5+ years of experience in software engineering with a focus on large-scale distributed systems or data infrastructure.
- Expertise in building and maintaining scalable data platforms, including data ingestion pipelines, stream processing, and batch processing systems.
- Proficiency in programming languages such as Python, Java, Rust, or similar.
- Proficiency with open source data projects and experience working with open source communities.
- Hands-on experience with modern data technologies such as Kafka, Spark, Flink, Airflow/Dagster, or similar.
- Deep understanding of database systems (e.g., SQL, NoSQL, columnar storage) and data modeling principles.
- Strong knowledge of cloud infrastructure (AWS, GCP, or Azure), containerization tools (Docker, Kubernetes), and microservices architecture.
Responsibilities
- Define and execute the technical vision for Discord's data platform, enabling scalable, reliable, and performant data systems.
- Design, implement, and optimize data infrastructure to process and analyze petabytes of data across millions of users.
- Develop innovative data architectures to support analytics, machine learning, and operational insights.
- Build monitoring, logging, and alerting systems to ensure the health and performance of data services.
- Partner with data scientists, data engineers, product managers, and leadership to align technical solutions with business goals.
- Promote and drive best practices in data governance, security, and compliance across the organization.
- Provide technical leadership, mentor junior engineers, and foster a culture of excellence and continuous improvement.
Other
- Excellent communication skills with a demonstrated ability to collaborate and influence across teams and levels.
- Proven ability to thrive in a fast-paced environment.
- Candidates must reside in or be willing to relocate to the San Francisco Bay Area (Alameda, Contra Costa, Marin, Napa, San Francisco, San Mateo, Santa Clara, Solano, and Sonoma counties).
- Relocation assistance may be available.
- Discord is committed to inclusion and providing reasonable accommodations during the interview process.
