Optery is seeking an experienced Principal Software Engineer (Node.js) to drive the technical vision and execution of their Data Discovery and Removal Automation Team, responsible for developing automation workflows and web crawlers at scale. This role aims to enhance automation workflows using generative AI technologies for greater scalability and efficiency.
Requirements
- 8+ years of experience as a software engineer, with at least 3+ years of hands-on experience in Node.js.
- 2+ years of experience in a principal software engineer role, guiding architecture decisions.
- Expertise in building web crawlers, scrapers, and automation tools.
- Strong experience with Puppeteer for web automation and scraping.
- Strong experience with asynchronous programming, event-driven architecture, and message brokers (e.g., RabbitMQ, Kafka).
- Proficiency with databases such as PostgreSQL, SQL, and NoSQL technologies (e.g., Redis, Elasticsearch, MongoDB).
- Hands-on experience with Kubernetes and cloud services (AWS, GCP, or Azure).
Responsibilities
- Architect and develop scalable automation systems, web crawlers, and data-processing pipelines.
- Provide technical direction to the Automation Team, setting best practices for development, security, and performance.
- Collaborate with product and engineering teams to define roadmap and technical direction.
- Perform code reviews, mentor junior engineers, and foster a culture of high-quality software development.
- Optimize existing systems for performance, reliability, and scalability.
- Stay up to date on cutting-edge web automation and security trends.
- Lead troubleshooting efforts for complex technical issues and system failures.
Other
- This is a fully remote position, based in the United States.
- Strong problem-solving skills and ability to work autonomously.
- Experience in the consumer privacy or consumer data industries.
- Familiarity with Python and Django.
- Optery values diversity and is an equal opportunity employer.
