Filtr uses AI to scan 1000+ jobs and finds postings that perfectly matches your resume

The company is seeking a Senior Manager of Data Engineering to lead their Transaction and Position Master development team. The goal is to drive event-driven architecture, establish scalable and automated processes, and ensure data integrity and performance on their AWS-based platform within a high-impact financial data environment.

Requirements

• 7+ years of data engineering experience, with at least 5+ years in management, leading and mentoring hybrid onshore/offshore data engineering teams.
• Expertise in AWS Glue, including Glue ETL, Glue Catalog, and Glue workflows for large-scale data transformation and processing.
• Proven expertise in batch-triggered and event-driven architectures, including real-time data processing with services such as AWS Kinesis/ Kafka, and EventBridge/ SQS, etc..
• Strong experience with AWS data services, including S3, Glue, Lake Formation, Athena, and Aurora PostgreSQL.
• Hands-on experience with CI/CD, DevOps, and version control, including GitHub, CloudFormation, and AWS CodePipeline.
• Demonstrated ability to establish well-formed, high-performance complex engineering processes, governance, and monitoring frameworks to support a mission-critical, production environment.
• Python experience a plus.

Responsibilities

• Lead the design and implementation of batch-triggered and event-driven, cloud-based data pipelines, integrating structured and unstructured data sources.
• Establish and enforce data engineering best practices, including real-time data streaming, automation, monitoring, and process rigor to support a 24/7 operational environment.
• Drive efficiency in data storage, processing, and analytics, optimizing Aurora PostgreSQL, Redshift, and S3-based architectures.
• Develop and maintain automated deployment processes, leveraging GitHub, CI/CD pipelines, and infrastructure as code (Terraform, CloudFormation).
• Manage and develop a hybrid team of onshore and offshore data engineers, fostering a high-performance engineering culture.
• Work closely with business stakeholders, data analysts, and application teams to ensure data solutions align with company objectives.
• Ensure data integrity and performance across their AWS-based platform.

Other

• Lead & Mentor: Manage and develop a hybrid team of onshore and offshore data engineers, fostering a high-performance engineering culture.
• Collaborate Across Teams: Work closely with business stakeholders, data analysts, and application teams to ensure data solutions align with company objectives.
• This position offers a hybrid work schedule from any of our offices located in San Diego, CA; El Segundo, CA; Dallas, TX; Schaumburg, IL; Des Moines, IA; or Dubuque, IA.
• 2 to 5 years in the financial industry with experience in the brokerage industry preferred.
• Bachelor’s degree in Computer Science, Computer Information Systems or related area of expertise.
• AWS Professional Certifications such as AWS Certified Data Analytics or AWS Certified Big Data preferred
• Financial Industry certifications such as SIE (Securities Industry Essentials) or Series-99 a plus.