BuildOps is revolutionizing the commercial contracting industry with its software solution and is looking for a Senior Backend Engineer to lead complex data migration projects, ensuring the smooth transfer of large volumes of data from multiple source systems to a variety of target environments.
Requirements
- 5+ years of proficient experience developing backend solutions with Python and SQL
- Strong understanding of relational databases (MySQL, PostgreSQL, SQL Server); familiarity with NoSQL databases like MongoDB is a plus
- Experience implementing GraphQL mutations and/or REST APIs to process data into application databases
- Experience with cloud-based applications in AWS
- Familiarity with automation tools and techniques for ETL pipeline orchestration
- Experience using AI to generate code and troubleshoot issues
Responsibilities
- Design and maintain ETL pipelines to migrate data from various unknown or legacy source systems to target systems like MySQL, PostgreSQL, or SQL Server
- Own libraries of Python importers transforming batch files to CRUD API requests into the application layer
- Identify and resolve performance bottlenecks within ETL pipelines by leveraging query optimization, indexing, parallel processing, and partitioning
- Implement and maintain scalable data validation, cleansing, and reconciliation processes to ensure the integrity of the ETL pipelines
- Collaborate with product managers, software engineers, implementation, and customer success managers to grow offerings to scale for the future
- Document the full data migration process including pipeline configurations, transformations, data mappings, and known limitations; provide support and training to internal teams
- Continuously assess and improve ETL workflows by staying current on tools and technologies and applying best practices
Other
- Excellent communication skills and the ability to work effectively across technical and business teams
- Ability to work a hybrid schedule - Monday/Friday WFH, Tuesday - Thursday, in our new Raleigh office
- Experience working in SaaS companies or cloud-based environments
- Familiarity with multi-tenant architectures, scaling data systems, and migrating customer data in a SaaS context
