Fullbay is looking for a Data Engineer to design, develop, and manage data systems, build and manage data infrastructure and transformation backend, integrate technologies like Snowflake and Redshift, and develop front-end data visualizations.
Requirements
- Proficiency in AWS, SQL, DynamoDB, and Python or Java.
- Expertise in designing, implementing, and supporting systems with clustering, replication, partitioning, encryption, and high availability/disaster recovery.
- Strong background in data management, architecture, and large-scale system implementations.
- Hands-on experience in deploying secure, high-performance database systems.
- Proficient in cloud-based database and analytics technologies, including AWS Glue, RDS, EC2, Spark, and similar technologies.
- Strong understanding of NoSQL, columnar, and big data analytics platforms like Redshift, Spark, Snowflake, and embedded analytics solutions like Looker, ThoughtSpot, AWS QuickSight.
Responsibilities
- Develop and manage the data backend integrating multiple sources such as SnowFlake, MySQL DB, Dynamo DB, and S3.
- Design and maintain ETL pipelines to support continuous updates to the backend infrastructure.
- Deliver data visualizations that provide insights, enable reporting, and meet customer needs through APIs and other access patterns.
- Lead incident management, overseeing critical incidents from inception through resolution, including conducting root cause analysis.
- Enhance system security and integrity, aligning with the company’s commitment to risk management by protecting system data and ensuring compliance with enterprise and departmental policies.
- Plan and execute system upgrades, focusing on compute and storage capacity expansion, database hardening, and patching.
- Translate business requirements into technical specifications that ensure data design and system architecture meet service level agreements (SLAs).
Other
- Serve as a thought leader and mid-senior expert in database engineering.
- Partner with leadership to develop strategies, set directions, and plan and execute database administration priorities.
- Document new technologies and facilitate knowledge transfer within the team.
- Drive change management, influencing cross-functional teams and fostering an environment conducive to progressive and strategic changes.
- Excellent communication skills with the ability to discuss technical details with various stakeholders.
