Resonate is looking for a Senior Data Engineer to design, build, and optimize complex data pipelines in a cost-conscious environment, improving customer acquisition and lifetime value through AI-powered consumer data.
Requirements
- 5+ years of hands-on experience with Apache Spark using Scala exclusively (no PySpark).
- Proven track record of optimizing large-scale data pipelines for performance and cost.
- Strong AWS EMR experience, including fleet management and instance optimization.
- Proficiency in AWS Step Functions.
- Deep understanding of distributed computing principles and resource management.
- Experience debugging and tuning multi-terabyte daily workloads.
- Comfort working across Scala, Python, and SQL as needed.
Responsibilities
- Design and develop high-performance data pipelines using Scala/Spark on AWS EMR.
- Build new features and data products while maintaining operational excellence.
- Optimize pipelines for both performance and cost efficiency.
- Debug complex distributed system issues using appropriate tools and methodologies.
- Implement comprehensive monitoring and observability from day one.
- Write efficient Snowflake/Snowpark procedures across multiple languages.
- Balance new development with continuous improvement of existing systems.
Other
- Strong communication skills
- Proactive mindset
- Actively collaborating with your squad
- Ownership
- Collaboration
