Curinos is looking to hire a Senior Data Engineer to build and maintain their next generation data and AI platforms, support product migration from legacy infrastructure, and help product engineering teams leverage these platforms to launch new products and build new genAI applications. The reliability, scalability, and effectiveness of their data & AI platforms are integral to their product offerings.
Requirements
- Advanced proficiency in Python and SQL.
- Required experience with Spark, including distributed computing and optimization.
- Experience with Databricks (Unity Catalog, Feature Store, Delta Live Tables).
- Extensive experience with data pipeline and workflow management tools (e.g., Airflow, Databricks, Glue).
- Strong understanding of data engineering best practices (ETL/ELT, monitoring, observability, validations).
- Experience with big data, scaling data processing, and distributed computing.
- Production support experience.
Responsibilities
- Design, build, and maintain scalable and reliable data and AI platforms, including ingestion, storage, validation, governance, monitoring, and ELT patterns.
- Implement data monitoring and pipeline observability.
- Proactively identify opportunities and implement solutions to optimize pipeline operations and reduce manual work.
- Develop and maintain ETL data pipelines for large volumes of data, writing clean, maintainable, and efficient code.
- Maintain and evangelize high standards in software and data engineering best practices (SDLC, testing, scaling, performance).
- Proactively identify and implement new technologies and tools.
- Conduct code reviews and provide feedback.
Other
- Support adoption of data platform tools and frameworks across teams.
- Participate in agile ceremonies.
- Stay current with emerging technologies and industry best practices.
- Self-discipline and eagerness to learn new skills, tools, and technologies.
- Solid verbal and written communication skills.
