Marsh McLennan is seeking a Lead Data Engineer to design, develop, and maintain their data infrastructure to support analytics and business intelligence initiatives, with a focus on building scalable data pipelines, managing cloud-based data solutions, and working with Databricks and AWS services.
Requirements
- Proficiency in SQL and experience with enterprise data warehousing technologies such as Databricks and Redshift.
- Proven experience designing, developing, and automating data pipelines, with familiarity in version control (Git), CI/CD, and DevOps practices.
- Extensive experience working in enterprise environments with strict data governance, security, and compliance requirements.
- Over 10+ years of practical experience with cloud-based data engineering platforms like Databricks, AWS S3, Athena, Glue, or similar.
- Demonstrated thought leadership through best practices, standards, and comprehensive documentation of data processes and architectures.
- Proficiency in data visualization tools such as Power BI, Tableau, or equivalent.
- Knowledge of containerization (Docker, Kubernetes) and orchestration tools like Apache Airflow.
Responsibilities
- Lead the design and implementation of data ingestion processes from diverse sources into the Databricks Lakehouse platform, ensuring adherence to architectural standards.
- Oversee the development, maintenance, and optimization of data models and ETL pipelines supporting the Medallion Architecture (Bronze, Silver, Gold layers) to improve data processing and transformation workflows.
- Drive data integration, cleansing, and consolidation efforts using Databricks and Delta Lake for version control and data reliability.
- Manage data governance policies via Unity Catalog, ensuring secure, compliant, and centralized data access across the organization.
- Lead migration of existing ETL processes from Informatica IICS to cloud-based pipelines within Databricks, minimizing disruption and maximizing efficiency.
- Collaborate with clients and stakeholders to support architectural design, address technical queries, and provide strategic guidance on Databricks Lakehouse utilization.
- Mentor and lead a team of data engineers, fostering a culture of continuous learning, innovation, and best practices.
Other
- Bachelor’s or master’s degree in computer science or equivalent.
- Strong analytical, problem-solving, and communication skills, with the ability to translate complex concepts for diverse audiences.
- Ability to work in a hybrid environment, with at least three days per week in the local office.
- Must be willing to work onsite with clients as needed.
- Must have a need that requires accommodation, please let us know by contacting reasonableaccommodations@mmc.com.
