Livefront is looking for a Director, Data Engineering to lead their data practice, which includes data engineering, data science, machine learning, and data analytics. The goal is to help clients design and build digital products by leveraging data to understand consumer behavior and drive business outcomes, while also mentoring and growing the internal data team.
Requirements
- Deep expertise with Databricks as a developer, architect, and practice leader, including proficiency with Spark and large-scale data processing.
- Proven experience designing and implementing data warehousing solutions at scale.
- Expertise in building production ETL/ELT pipelines with a focus on reliability and performance.
- Deep understanding of cloud data platforms (AWS, Azure, and GCP) with the ability to architect solutions on any of them.
- Strong proficiency in SQL and Python with the ability to write clean, performant, and maintainable code.
- Strong understanding of data modeling, schema design, and query optimization.
- Knowledge of data governance, security best practices, and compliance requirements.
Responsibilities
- Architect and oversee the design of scalable, secure, and performant data systems across a variety of cloud environments (e.g., AWS, Azure, GCP) and data platforms (e.g., Databricks, Snowflake).
- Define our standards for data engineering, code reviews, testing, security, performance monitoring, and data governance, and ensure conformance with those standards across all our projects.
- Plan, estimate, and execute data engineering initiatives for the organization and our client projects.
- Ensure the security, privacy, and compliance of all data systems, pipelines, and products.
- Roll up your sleeves and work directly in the codebase frequently.
- Create architecture diagrams, data flow diagrams, and other technical illustrations to enable effective communication regarding technical requirements.
- Stay current with AI trends, technologies, models, frameworks, eval methods, and responsible AI practices.
Other
- You lead major data-related decisions and initiatives, inspire collaboration and support, and drive initiatives to completion with the team.
- You stay informed about industry trends, participate in community and industry events, and share knowledge through regular publications and presentations.
- You are empathetic, curious, and always learning and improving.
- Provide technical leadership, guidance, and mentorship for data engineers on the team.
- Conduct employee performance reviews and support and cultivate professional growth for the engineers directly reporting to you.
