Crowd Street is looking to build a new data platform from scratch and needs a Senior Data Engineer to influence its architecture and manage its lifecycle.
Requirements
- 5+ years experience working hands-on in Microsoft’s Azure data stack including: Azure Data Factory, Azure Synapse Analytics, Microsoft Power BI
- Experience designing and implementing data platforms using industry best practices
- Experience building ETL pipelines from scratch
- Experience independently troubleshooting and resolving issues
- Experience building and maintaining data warehouses
- Experience writing Python (or similar) code in Synapse or Databricks Notebooks
- Experience creating data models from Data Warehouse
Responsibilities
- building Crowd Street’s new data platform from zero to one
- influence the architecture of our new data platform
- responsible for the full lifecycle of software development including design, implementation, testing, documentation, operation, and ongoing support
- Unlock business-critical reporting through the ingestion of disparate data sources into our centralized data platform
- Reveal key insights through proper data modeling, aggregation and analysis in our data warehouse
- Own and maintain data pipelines that support the essential day-to-day operation of Crowd Street’s business
- Monitor and manage the overall effectiveness of the data platform to balance performance, stability, and cost
Other
- Interact directly with teams across Crowd Street’s business to translate ambiguous data needs into actionable initiatives for the Data team.
- Collaborate with Application Engineering, Product Management, and other teams to identify and deliver the highest impact enhancements in a timely manner
- Experience working in a dynamic startup environment
- Comfortable decomposing large ambiguous projects into actionable tasks
- Experience interacting directly with business stakeholders to identify requirements and communicate progress
