IMO is looking to hire a Senior Data Engineer to support software developers, database architects, analysts, and data scientists on data initiatives. The goal is to ensure optimal data delivery architecture is consistent throughout ongoing projects and to optimize or improve the company's data architecture to support the next generation of products and data initiatives.
Requirements
- Ability to build end-to-end data platforms and collaborate on architecting sound solutions
- Experienced developer in multiple languages, including object-oriented/functional scripting languages (Python); able to train up on additional languages as needed
- Hands-on experience with big data tools (e.g., Spark, Kafka); familiarity with building and optimizing complex data pipelines and architectures
- Proficient in AWS services (EC2, EMR, RDS)
- Strong SQL knowledge, with experience in complex query authoring, relational databases (PostgreSQL), and NoSQL databases (DynamoDB, MongoDB, Elasticsearch)
- Strong analytical, troubleshooting, and problem-solving skills
- Experienced in data modeling and logical/physical database design
Responsibilities
- Update, analyze, fix, enhance, and build IMO products through direct interaction with code and data
- Assemble, analyze, and interpret large and complex data sets using both technical skills and a solid understanding of IMO’s terminology data
- Construct infrastructure for optimal ETL of data from varied sources using SQL and AWS ‘big data’ technologies
- Identify and implement improvements to automate processes, optimize data delivery and performance, implement orchestration frameworks, and redesign data pipeline infrastructure for scalability and reliability
- Design data platform components for bulk, transactional, and streaming access
- Create and maintain optimal data pipeline architecture
- Support application-specific availability, scalability, and monitoring of resources and costs
Other
- Demonstrate understanding and awareness of the critical role terminology data plays in IMO’s products – use this to consistently inform your work
- Work cooperatively within an Agile Scrum team to manage conflict and foster trust, commitment, and accountability
- Take ownership, be proactive, and anticipate impacts to take appropriate action
- Collaborate cross-functionally in a dynamic and agile environment to translate needs into requirements, assist with data/infrastructure, and partner on the creation of innovative products
- Seek out industry best practices and continuously develop new skills
