Discord is seeking to improve its data infrastructure and services to drive business insights and innovation.
Requirements
- Expertise in building and maintaining scalable data platforms, including data ingestion pipelines, stream processing, and batch processing systems
- Proficiency in programming languages such as Python, Java, Rust, or similar
- Proficiency with open source data projects and experience working with open source communities
- Hands-on experience with modern data technologies such as Kafka, Spark, Flink, Airflow/Dagster, or similar
- Deep understanding of database systems (e.g., SQL, NoSQL, columnar storage) and data modeling principles
- Strong knowledge of cloud infrastructure (AWS, GCP, or Azure), containerization tools (Docker, Kubernetes), and microservices architecture
- Experience with open source data projects and open source communities
Responsibilities
- Define and execute the technical vision for Discord's data platform
- Design, implement, and optimize data infrastructure to process and analyze petabytes of data
- Develop innovative data architectures to support analytics, machine learning, and operational insights
- Build monitoring, logging, and alerting systems to ensure the health and performance of data services
- Partner with data scientists, data engineers, product managers, and leadership to align technical solutions with business goals
- Promote and drive best practices in data governance, security, and compliance across the organization
- Provide technical leadership, mentor junior engineers, and foster a culture of excellence and continuous improvement
Other
- 5+ years of experience in software engineering with a focus on large-scale distributed systems or data infrastructure
- Excellent communication skills with a demonstrated ability to collaborate and influence across teams and levels
- Proven ability to thrive in a fast-paced environment
- A strong passion for Discord and gaming (bonus point)
- Open source contributions to data-related projects (bonus point)