People Data Labs (PDL) is looking to accelerate efforts to build standalone data products that enable data teams and independent developers to create innovative solutions at massive scale. The Platform Engineering Team needs to define tools and infrastructure that facilitate big data processing, primarily within AWS, to support these goals.
Requirements
- 5-7+ years of software development experience with a background in platform or cloud infrastructure engineering and clear examples of strategic technical problem-solving and implementation
- 3+ years of experience with Python in a production environment
- Strong software development fundamentals and system design experience
- Strong experience with our core technologies (AWS, ElasticSearch / OpenSearch, Python, Docker, scaled data processing technologies)
- AWS, including EC2, Lambda, OpenSearch, API Gateway, ALB, others
- Data stores, including Postgres/MySQL, Dynamo, Redis, S3
- Experience with Infrastructure-as-code (IaC) frameworks (e.g. Pulumi, Terraform, CloudFormation, or similar)
Responsibilities
- Manage and improve our growing AWS and data center infrastructures
- Design, implement, and maintain a CI/CD pipeline to improve developer workflows
- Utilize centralized monitoring and logging to improve visibility across the team
- Assist development teams in solving issues around scaling and bottlenecks
- Work with teammates to develop high-quality software, balancing security, reliability, and operational concerns
Other
- Balance high ownership and autonomy with a strong ability to collaborate
- Can work effectively remotely (able to be proactive about managing blockers, proactive on reaching out and asking questions, and participating in team activities)
- Strong written communication skills on Slack/Chat and in documents
- Are experienced in writing data design docs (pipeline design, dataflow, schema design)
- Can scope and breakdown projects, communicate and collaborate progress and blockers effectively with your manager, team, and stakeholders
