Design, build, and maintain the data pipelines and models that power AI/ML solutions, ensuring high-quality, well-structured data flows from ingestion through transformation to downstream consumption.
Requirements
- 3+ years of experience developing data technologies and deploying ETL/ELT solutions in production
- 3+ years of hands-on work with cloud-based data services—preferably Azure (Data Factory, ADLS) or AWS
- 3+ years of experience building and optimizing pipelines on Azure Databricks (Spark, Delta Lake) or equivalent platforms
- 3+ years developing backend or data-wrangling solutions in Python, Scala, Java, .NET, or similar
- Fluency with one or more database technologies (relational and/or NoSQL)
- Familiarity with distributed data platforms (e.g., Spark, Hadoop)
- Experience deploying, monitoring, and maintaining Databricks-based data pipelines in production
Responsibilities
- Use a variety of programming languages and tools to develop, test, and maintain data pipelines within the Platform Reference Architecture.
- Working directly with management, product teams and practice personnel to understand their platform data requirements
- Collaborating on an Agile team to design, develop, test, implement and support highly scalable data solutions
- Collaborating with product teams and clients to deliver robust cloud-based data solutions that drive tax decisions and provide powerful experiences
- Securing data in alignment with internal information and data security policies, best practices and client requirements
- Creating and implementing robust cloud-based data solutions that scale effectively, and provide powerful experiences for both internal teams and clients
- Performing unit tests and conducting reviews with other team members to make sure solutions and code are rigorously designed, elegantly coded and effectively tuned for performance
Other
- Maintaining a positive work atmosphere by behaving and communicating in a manner that encourages productive interactions with customers, co-workers and supervisors
- Developing and engaging with team members by creating a motivating work environment that recognizes, holds team members accountable, and rewards strong performance
- Fostering an innovative, inclusive and diverse team environment, promoting positive team culture, encouraging collaboration and self-organization while delivering high quality solutions
- Analyzing user feedback and activity and iterate to improve the services and user experience
- Staying on top of tech trends, experimenting with and learning new technologies, participating in internal & external technology communities and mentoring other members of the engineering community
