Enigma is seeking an experienced Senior Data Engineer to help shape the trajectory of their next generation of small business intelligence products. The role will directly impact the accuracy, scalability, and predictive capabilities of their data platform, influencing key business decisions for their customers.
Requirements
- 5+ years of engineering or data science experience, including 3+ years working on distributed data systems.
- Practical experience extracting value from data in a creative way to deliver customer impact.
- Prior experience in Python, Spark and Databricks.
- Databricks SQL
- PySpark
- MLFlow
- Dagster for orchestration
- LakeFS for data versioning
Responsibilities
- Designing, building, and maintaining our core small business data product.
- Collaborate with cross-functional teams to build out new product capabilities starting from raw source data, through scalable data pipelines and models to the customer interface.
- Understand the unmet needs of our customers and create capabilities to address these. This usually involves a process of exploring data, prototyping, and evaluation, followed by the build of robust and maintainable data pipelines.
- Engineer scalable and maintainable data systems that tell the story of millions of U.S. small businesses (we use Databricks SQL, PySpark, and MLFlow).
- You’ll be building on top of our innovative data infrastructure that’s designed for iteration and experimentation (uses Dagster for orchestration and LakeFS for data versioning).
- Apply a data-focused, first-principles approach to problem solving.
- Inspire your teammates to perform at their best while fostering a collaborative, supportive team culture.
Other
- Cares deeply about creating value and wants to learn, ship, and iterate quickly.
- Strong collaboration skills and a desire to work in a cross-functional environment.
- A principled, metrics-driven approach to solving complex data problems.
- Have built data products in the entity resolution, sales, marketing, KYB, or credit underwriting space.
- Ownership and Impact: Work directly with customers and internal teams to build product capabilities in an environment of high-trust and responsibility.
