JPMorgan Chase is seeking a seasoned Software Engineer III - Databricks and PySpark Developer to design and deliver trusted market-leading technology products in a secure, stable, and scalable way within Commercial and Investment Banking.
Requirements
- Formal training or certification on software engineering concepts and 3+ years of applied experience
- Proficiency in Databrick, AWS and PySpark for data processing and analytics and Databricks Cluster configuration, Unity catalog repository configuration
- Strong programming skills in Python with experience in writing complex SQL queries
- Advanced at SQL (e.g., joins and aggregations, window functions)
- Experience in data engineering and Cloud architecture specifically with Databricks and AWS
- Proven experience and ability to migrate the Data load models developed on ETL framework to the multi node Databricks compute
- Understanding of system architectures, and design patterns and should be able to design and develop applications using these principles.
Responsibilities
- Executes software solutions, design, development, and technical troubleshooting with ability to think beyond routine or conventional approaches to build solutions or break down technical problems
- Support review of controls to ensure sufficient protection of enterprise data and advise and makes custom configuration changes in one to two tools to generate a product at the business or customer request
- Update logical or physical data models based on new use case and use SQL and understands NoSQL databases and their niche in the marketplace
- Analyze, design, develop and drive performance enhancements, you will focus on significantly increasing default ingestion speeds to meet the substantial data demands, ensuring our systems operate at peak efficiency.
- Implement automation, optimization, performance tuning and scaling techniques to ensure efficient pipeline performance
- Creates secure and high-quality production code and maintains algorithms that run synchronously with appropriate systems
- Produces architecture and design artifacts for complex applications while being accountable for ensuring design constraints are met by software code development
Other
- Adds to team culture of diversity, opportunity, inclusion, and respect
- Gathers, analyzes, synthesizes, and develops visualizations and reporting from large, diverse data sets in service of continuous improvement of software applications and systems
- Proactively identifies hidden problems and patterns in data and uses these insights to drive improvements to coding hygiene and system architecture
- Demonstrated knowledge of software applications and technical processes within a technical discipline (e.g., cloud, artificial intelligence, machine learning, mobile, etc.)
- Solid understanding of agile methodologies such as CI/CD, Application Resiliency, and Security
