Instacart is looking to hire a Senior Software Engineer to shape their data infrastructure, design, develop, and maintain comprehensive access controls and governance frameworks to safeguard the integrity and privacy of their data, and elevate data utilization across several departments to enable valuable insights, informed decision-making, and drive business value.
Requirements
- Has 5+ years of experience in software engineering.
- Exhibits an in-depth understanding of distributed systems, with proven experience with data processing technologies such as DBT and Airflow, and common web frameworks such as Rails.
- Proficiently uses SQL for writing and reviewing complex queries for data analysis and debugging.
- Can design for scale with the entire system in mind.
- Possesses strong analytical and debugging skills.
- Have experience with big data technologies such as Spark, Hadoop, Flink, Hive, or Kafka, and with both streaming and batching data pipelines.
- Have proven experience with distributed system designs.
Responsibilities
- Designing, developing, and sustaining the comprehensive access controls and governance systems that improve the integrity and privacy of our data.
- Ensuring the reliability, scalability, and security of the data platform.
- Collaborating with various stakeholders and actively involve in the data infrastructure.
- Design, develop, and maintain comprehensive access controls and governance frameworks to safeguard the integrity and privacy of our data.
- Elevate the data utilization across several departments, enabling valuable insights, informed decision-making, and driving business value.
- Shape these systems from design, technical decisions, project management to execution.
- Driving the Data Strategy and building the platform that Instacart data lake will be built upon.
Other
- Can design for scale with the entire system in mind.
- Capably communicates and is comfortable seeking and receiving feedback.
- Takes a strong sense of ownership while working with large codebases and diverse suite of products.
- Embraces a collaborative mindset to partner with engineers, designers, and PMs from multiple teams to co-create impactful solutions while supporting system contributions.
- Communicates clearly, presents ideas well, and can influence key stakeholders at manager, director, and VP levels.
