Fannie Mae is looking to solve the problem of making housing a possibility for millions of homeowners and renters by developing data infrastructure and pipelines to capture, integrate, organize, and centralize data, ensuring it is readily accessible and in a usable state with quality assurance.
Requirements
- 2+ years with Big Data Hadoop cluster (HDFS, Yarn, Hive, MapReduce frameworks), Spark, AWS EMR
- 2+ years of recent experience with building and deploying applications in AWS (S3, Hive, Glue, AWS Batch, Dynamo DB, Redshift, AWS EMR, Cloudwatch, RDS, Lambda, SNS, SWS etc.)
- 2+ years of Python, SQL, SparkSQL, PySpark
- Skilled in cloud technologies and cloud computing
- Programming including coding, debugging, and using relevant programming languages
- Skilled in creating and managing databases with the use of relevant software such as MySQL, Hadoop, or MongoDB
- Skilled in AWS Analytics such as Athena, EMR, or Glue
Responsibilities
- Contribute to developing data infrastructure and pipelines to capture, integrate, organize, and centralize data while testing and ensuring the data is readily accessible and in a usable state, including quality assurance.
- Identify customer needs and intended use of requested data in the development of database requirements and support the planning and engineering of enterprise databases.
- Maintain comprehensive knowledge of database technologies, complex coding languages, and computer system skills.
- Support the integration of data into readily available formats while maintaining existing structures and govern their use according to business requirements.
- Analyze new data sources and monitor the performance, scalability, and security of data.
- Create an initial analysis and deliver the user interface (UI) to the customer to enable further analysis.
Other
- Excellent problem-solving skills and strong verbal & written communication skills
- Ability to work independently as well as part of an agile team (Scrum / Kanban)
- Experience in working with agile development teams
- Working with people with different functional expertise respectfully and cooperatively to work toward a common goal
- Bachelor's Level Degree (Required)