The partner company is seeking to design, develop, and scale a next-generation data platform to support critical business operations and AI initiatives.
Requirements
- Advanced programming skills in Python and SQL; experience with orchestration/streaming frameworks such as Temporal, Dagster, Airflow, Spark, or Kafka.
- Strong knowledge of relational and NoSQL databases (Postgres, MySQL, MongoDB, ElasticSearch, Cassandra).
- Experience with cloud computing and data warehousing platforms, preferably Databricks and AWS.
- Strong analytical skills, attention to data quality, and experience with both OLTP and OLAP systems.
- Experience mentoring engineers and providing technical and architectural guidance.
- Familiarity with ML feature stores and productionizing ML pipelines is a plus.
- Bonus: experience with energy market or weather data, dbt, DataOps practices, real-time data technologies, or knowledge of power systems.
Responsibilities
- Design, implement, and maintain scalable ETL/ELT pipelines using Python, SQL, and modern orchestration frameworks.
- Build and optimize data models and schemas for cloud warehouses and relational databases, supporting AI and analytics workflows.
- Develop and operate distributed, real-time data systems for high-throughput ingestion and processing.
- Collaborate with cross-functional teams including AI, engineering, and product to deliver high-quality datasets and robust data products.
- Lead large-scale data initiatives from planning through execution, ensuring performance, cost efficiency, and reliability.
- Mentor and provide architectural guidance to other engineers, promoting best practices in data engineering and pipeline development.
- Support testing, debugging, and QA processes to ensure system stability and data integrity.
Other
- Bachelor’s degree in Computer Science, Data Science, Engineering, or a related technical field. Graduate degrees are a plus.
- 7+ years of progressive experience in data or software engineering, building complex data systems.
- Flexible, remote-first working environment with unlimited vacation policy.
