Sofi is looking to solve independent risk management goals by designing, building, and maintaining highly scalable and robust data solutions.
Requirements
- 4-7 years of hands-on experience in a senior data engineering role, with a strong background in data warehousing and modern data stack architectures.
- Demonstrated expertise in Snowflake, including deep knowledge of its architecture, advanced features, and performance optimization techniques for large datasets.
- Expert-level proficiency with dbt for complex data transformation, dependency management, and building production-grade data models.
- Advanced experience with Apache Airflow for orchestrating and managing mission-critical data workflows.
- Hands-on experience with streaming data platforms - Apache Kafka (preferred)
- Experience in building and maintaining CI/CD pipelines using tools like GitHub Actions, GitLab CI/CD
- Experience with Infrastructure as Code (IaC) using Terraform (preferred), CloudFormation, or Ansible.
Responsibilities
- Lead the architecture and implementation of complex data solutions, collaborating with risk analysts and business stakeholders to translate advanced requirements into robust data models and pipelines.
- Design and build highly optimized data workflows on Snowflake, utilizing its advanced features for large-scale financial data processing, cost optimization, and performance tuning.
- Develop, manage, and optimize sophisticated ETL/ELT pipelines using dbt, Python, and Apache Airflow to ensure data integrity and address high-exposure risks within financial datasets.
- Integrate and manage data from various sources, including external data sources, into our core data platform, ensuring seamless and automated data flow for critical business applications.
- Design and configure workflows based in Airtable for complex orchestrations of tasks
- Drive the strategic evolution of our modern data platform, taking full ownership of its design, maintenance, and long-term direction.
- Establish and enforce advanced data governance and quality processes, acting as a primary point of contact for escalations related to data accuracy and compliance within the financial domain.
Other
- Provide mentorship and technical guidance to other engineers, championing best practices and fostering a culture of technical excellence.
- Experience in the banking or financial services industry is highly preferred, with a strong understanding of financial data models, compliance, and regulatory requirements.
- Proven track record of providing technical leadership and mentoring other engineers.
- Due to insurance coverage issues, we are unable to accommodate remote work from Hawaii or Alaska at this time.
