West Monroe is looking for a Principal Data Engineer to lead the design, implementation, and optimization of data solutions that empower clients to make data-driven decisions, shaping data strategies, mentoring teams, and ensuring the delivery of scalable and efficient data systems.
Requirements
- Development of or architecture of modern distributed architectures using modern messaging patterns and tools
- Expertise within Databricks.
- Experience working with relational databases (Microsoft SQL Server) and working with large unstructured data sets
- Strong experience with ETL procedures and ideation from scratch
- Experience using cloud platforms such as AWS, Azure, etc.
- Experience with reporting tools such as Microsoft PowerBI and Tableau
- Working knowledge or experience working with Azure SQL, Azure Data Lake or Azure Data Factory.
Responsibilities
- Architect robust, scalable, and secure data solutions, including data pipelines, warehouses, lakes, and analytics platforms.
- Establish and enforce data governance frameworks, ensuring data quality, security, and compliance with industry standards and regulations.
- Stay ahead of emerging technologies and trends, evaluating and recommending tools, platforms, and frameworks to enhance data capabilities.
- Create and maintain technical documentation, including architecture diagrams, data models, and operational procedures.
- Drive innovation by identifying opportunities to leverage AI, machine learning, and advanced analytics in data engineering solutions.
- Development of or architecture of modern distributed architectures using modern messaging patterns and tools
- Strong data engineering experience with the following core competencies: Expertise within Databricks.
Other
- Collaborate with senior leadership and stakeholders to define data strategies and roadmaps aligned with business objectives.
- Mentor and guide junior engineers, fostering a culture of continuous learning and innovation. Lead technical teams in delivering high-quality projects on time and within scope.
- Work closely with business analysts, data scientists, and software engineers to integrate data solutions into broader business applications.
- Act as a trusted advisor to clients, providing thought leadership and technical expertise in solving complex data challenges.
- 7-11+ years of work experience in a data environment, preferably with expeirence at a consulting firm