Life360 is looking to enhance and modernize its data platform infrastructure towards a robust and secure data system.
Requirements
- Minimum 5+ years of experience working with high volume data infrastructure.
- Experience with Databricks, AWS, ETL and Job orchestration tooling.
- Extensive experience programming in one of the following languages: Python / Java.
- Experience in data security, data governance, data contracts, data quality, cost management, optimizing SQL queries, and system performance tuning.
- You are proficient with SQL, AWS, Databases, Apache Spark, Spark Streaming, EMR, and Kinesis/Kafka
- Experience in modern data engineering SDLC including Agile methodology, CI/CD, automated deployments using Terraform, GitHub Actions etc.
- Knowledge and proficiency in the latest open source and data frameworks, lakehouse architecture, open table format, modern data platform tech stacks and tools.
Responsibilities
- Design, implement, and manage scalable data processing platforms used for real-time analytics and exploratory data analysis.
- Build and Manage our core data infrastructure from ingestion through ETL to storage and batch and real-time processing utilizing the latest tools and tech in the industry.
- Automate, test and harden all data workflows.
- Architect logical and physical data models to ensure the needs of the business are met.
- Collaborate with multiple stake holders like mobile app, cloud, product, data science and analytics teams, in recommendation and applying best practices
- Architect and develop systems and algorithms for distributed real-time analytics and data processing
Other
- BS in Computer Science, Software Engineering, Mathematics, or equivalent experience
- Good communication skills and can work independently
- Ability to mentor junior engineers, imparting best practices and institutionalizing efficient processes to foster growth and innovation within the team
