Quantiphi is looking to solve transformational problems at the heart of businesses by designing, building, and maintaining scalable data pipelines that power analytics, insights, and business decision-making.
Requirements
- Strong expertise in PySpark, SQL, and data modeling for high-volume datasets.
- Hands-on experience building and optimizing data pipelines in AWS or GCP environments.
- Track record of working with complex source systems and developing accurate extraction and transformation logic.
- Proven experience in mentoring engineers, performing code reviews, and leading technical design discussions.
- Solid understanding of distributed computing, data partitioning, and performance tuning.
- Expert-level knowledge of Azure and Databricks architecture, including Lakehouse patterns and the Medallion Framework.
- Familiarity with Delta Lake, orchestration tools, or Unity Catalog.
Responsibilities
- Design, develop, and maintain scalable batch and streaming data pipelines using PySpark, SQL, and modern data engineering frameworks.
- Perform deep-dive analysis into complex source systems to define extraction patterns, transformation logic, and integration workflows.
- Implement data models optimized for analytics, performance, and operational excellence.
- Build and manage data systems across AWS or GCP cloud environments, ensuring reliability, scalability, and cost efficiency.
- Lead and participate in design reviews, provide mentorship to junior engineers, and take ownership of code quality and engineering best practices.
- Collaborate with cross-functional teams including architects, analysts, product, and platform engineers to deliver high-quality data solutions.
- Troubleshoot performance bottlenecks, optimize data processing workflows, and improve pipeline robustness.
Other
- 8+ years of experience in data engineering or a related field.
- Work Location: Atlanta, GA (Preferred)/ Anywhere in USA or Canada
- Be part of a trailblazing team that’s shaping the future of AI, ML, and cloud innovation.
- If working in an environment that encourages you to innovate and excel, not just in professional but personal life, interests you- you would enjoy your career with Quantiphi!
- If you like wild growth and working with happy, enthusiastic over-achievers, you'll enjoy your career with us!
