The SMB & Financial Services (SMB&FS) Engineering team at PayPal aims to empower small and medium-sized businesses to grow by helping them adopt PayPal's financial services. The Data Engineer will be responsible for designing, building, and maintaining scalable data pipelines and ETL processes to support business insights and data-driven decisions for these financial products.
Requirements
- Familiarity in SQL and scripting languages such as Python, with experience working with relational databases.
- Familiarity in PySpark, Pandas or other data processing libraries.
- Familiarity with data warehousing concepts and tools, such as AWS Redshift, Google BigQuery, or Snowflake, and experience optimizing performance for large-scale data processing.
- Experience with data modeling, schema design, and optimization techniques for scalability.
Responsibilities
- design, build, and maintain scalable data pipelines and ETL processes that move and transform data from multiple sources into our data warehouse
- develop reliable, high-performance data solutions that enable business insights and data-driven decisions
- Ensure data accuracy and integrity through automated data quality checks and validation processes.
- Monitor system performance, identify bottlenecks, and implement optimizations to improve scalability and efficiency.
- Troubleshoot and resolve data-related issues quickly to minimize impact on downstream systems.
- Create and maintain clear documentation for pipeline design, workflows, and processes.
- Participate in design and code reviews to uphold best practices and coding standards.
Other
- Implements tasks within the Software Development Lifecycle (SDLC), receiving structure and oversight from more experienced staff
- Follows well-established internal conventions and standard procedures
- Understands internal standards & processes an applies them to make technical decisions
- Collaborates with peers, manager, and project lead to gain understanding of tasks and review solutions
- May contribute to code & design reviews
