JPMorgan Chase is looking to hire a Software Engineer II-Big Data/Pyspark to join their Consumer and Community Banking-Customer Identity and Authentication team. The role involves enhancing, designing, and delivering software components for technology products in a secure, stable, and scalable manner. The engineer will be responsible for executing software solutions through design, development, and technical troubleshooting of various components within technical products, applications, or systems.
Requirements
- Strong programming skills in Python, with basic knowledge of Java
- Proficiency in data modeling techniques and best practices.
- Proficiency in understanding of graph databases and experience in modeling and querying graph data
- Experience in creating reports and dashboards using Tableau
- Hands-on experience with SPARK and managing large datasets.
- Experience in implementing ETL transformations on big data platforms, particularly with NoSQL databases (MongoDB, DynamoDB, Cassandra)
- Proficiency in understanding of Event-Driven Architecture (EDA) and Event Streaming, with exposure to Apache Kafka
Responsibilities
- Design, develop, and maintain scalable data pipelines and ETL processes to support data integration and analytics.
- Implement ETL transformations on big data platforms, utilizing NoSQL databases like MongoDB, DynamoDB, and Cassandra.
- Utilize Python for data processing and transformation tasks, ensuring efficient and reliable data workflows.
- Work hands-on with SPARK to manage and process large datasets efficiently.
- Implement data orchestration and workflow automation using Apache Airflow.
- Apply understanding of Event-Driven Architecture (EDA) and Event Streaming, with exposure to Apache Kafka.
- Use Terraform for infrastructure provisioning and management, ensuring a robust and scalable data infrastructure.
Other
- Formal training or certification on software engineering concepts and 2+ years applied experience
- Strong analytical and problem-solving skills, with attention to detail
- Ability to work independently and collaboratively in a team environment
- Good communication skills, with the ability to convey technical concepts to non-technical stakeholders
- A proactive approach to learning and adapting to new technologies and methodologies
