GoodLeap is looking for a Data Engineer to ingest production energy data and provide aggregated metrics to various teams within the company. The role will focus on creating secure and performant data pipelines and supporting the enterprise data warehouse to improve data accessibility and usability for analytics, reporting, origination platforms, and AI development.
Requirements
- Experience with DataBricks/Spark processing
- Expertise with relational databases (including functional SQL/stored procedures) and non-relational databases (MongoDB, DynamoDB, Elastic Search)
- Experience with orchestrating data pipelines with modern tools such as Airflow
- Strong knowledge and hands-on experience with open source web frameworks (e.g. Vue /React)
- Solid understanding of performance implications and scalability of code
- Experience with Amazon Web Services (IAM, Cognito, EC2, S3, RDS, Cloud Formation)
- Experience with messaging paradigms and serverless technologies (Lambda, SQS, SNS, SES)
Responsibilities
- Implement data integrations across the organization as well as with business applications
- Develop and maintain data oriented web applications with scalable web services
- Participate in the design and development of projects, either independently or in a team
- Utilize agile software development lifecycle and DevOps principles
- Be the data stewards of the organization upholding quality and availability standards for our downstream consumers
- Be self-sufficient and fully own the responsibility of executing projects from inception to delivery
- Provide mentorship to team members including pair programming and skills development
Other
- 6-10 years of full-time Data Analysis and/or Software Development experience
- Degree in Computer Science or related discipline
- thrives in a collaborative work culture and values a rewarding career
