Later is looking to scale its data platform and integrate multiple data sources to ensure high availability, efficiency, and security.
Requirements
- Expertise in cloud technologies (Google Cloud Platform, AWS, Azure)
- Strong proficiency in SQL, Python, and distributed data processing frameworks (Apache Spark, Flink, Beam, etc.)
- Extensive experience with streaming data architectures using Kafka, Flink, Pub/Sub, Kinesis, or similar technologies
- Expertise in data modeling, schema design, indexing, partitioning, and performance tuning for analytical workloads
- Strong experience designing and optimizing scalable, fault-tolerant data pipelines using workflow orchestration tools like Airflow, Dagster, or Dataflow
- Experience with machine learning infrastructure and integrating ML models into data pipelines (preferred)
- Experience with Kappa/Lambda architectures for real-time data processing (preferred)
Responsibilities
- Lead the design and evolution of a scalable data architecture
- Architect and optimize data pipelines for batch and real-time data processing
- Implement best practices for distributed data processing
- Define and enforce data governance policies
- Ensure data security and compliance with industry regulations
- Drive innovation in data engineering practices
- Develop reusable frameworks, libraries, and automation tools
Other
- 10+ years of experience in data engineering, software engineering, or related fields
- Proven experience leading the technical strategy and execution of large-scale data platforms
- Ability to lead and influence engineering teams, drive cross-functional projects, and align stakeholders towards a common data vision
- Experience mentoring senior and mid-level data engineers to enhance team performance and skill development
- You’re proactive and results-driven, always taking initiative, aligning your actions with company goals, and delivering consistent outcomes
- Strategic and forward-thinking, you balance immediate needs with long-term opportunities to drive impactful, innovative results
- Salary Range: $200,000- 228,000 USD
