The company is looking to build data pipelines to ingest various source data from enterprise technologies and PitchBook Platform data, and make the data available to end consumers in the form of PitchBook data products.
Requirements
- 5+ years of experience in data engineering roles, including creating and maintaining data pipelines, data modeling, and data architecture
- 5+ years of experience in advanced SQL, including expert-level skills in querying large datasets from multiple sources and developing automated reporting
- 5+ years of experience in Python, with skills for diverse components of data pipelines, including scripting, data manipulation, custom extract, transform, and loads, and statistical/regression analysis
- Expertise in extract, transform, and load (ETL) and extract, load, transform (ELT) processes and pipelines, platforms (e.g. Airflow), and distributed messaging (e.g. Kafka)
- Experience with tools that capture and control data modeling change management (e.g. SQLMesh)
- Experience building data alerting and notifications (e.g. on deviations, thresholds, etc.)
- Proficient in data storage solutions, data warehousing, and cloud-based data platforms (e.g. Snowflake)
Responsibilities
- Design, develop, document, and maintain database and reporting structures used to compile insights
- Define, develop, and review extract, load, and transform (ELT) processes and data modeling solutions
- Establish and help define reports and dashboards used to translate business data into insights
- Contribute to the ongoing improvement of quality assurance standards and procedures
- Mentor and guide less experienced data engineers, contributing to their professional development
- Stay updated with the latest data engineering technologies and trends and share your insights with the team
- Support the vision and values of the company through role modeling and encouraging desired behaviors
Other
- Bachelor's degree in a related field (Computer Science, Engineering, etc.)
- Excellent communication and collaboration skills with the ability to engage with non-technical stakeholders
- Ability to work in the office 3+ days/week, with some flexibility to work remotely
- Limited corporate travel may be required to remote offices or other business meetings and events
- Physical demands of the job include using PC and phone on an on-going basis throughout the day
