Awardco is looking for a Sr. Data Engineer to join their Product team to design, develop, and maintain their data infrastructure and pipelines, ensuring data is accurate, accessible, and reliable for product features and analytical insights. The role is crucial for building scalable solutions to support the company's rapidly growing data needs.
Requirements
- Strong proficiency in SQL and database management systems.
- Experience with programming language such as C or Python for data manipulation and automation.
- Demonstrated experience with Cloud Computing platforms (Azure, GCP, or AWS).
- Experience with Databricks, Trino, Snowflake, or other modern data warehousing solutions.
- Understanding of containerization technologies like Kubernetes and Docker.
- Experience with messaging systems such as Azure Event Hubs and Apache Kafka.
- Knowledge of infrastructure as code tools like Terraform and monitoring tools like Prometheus and Helm.
Responsibilities
- Design, develop, and maintain scalable and robust ETL/ELT pipelines to support product features and analytical requirements.
- Build and optimize data models and schemas within various databases for performance and efficiency.
- Collaborate with product managers and software engineers to understand data needs and implement solutions that drive product innovation.
- Develop and manage data ingestion processes from various sources into our data platform.
- Implement and maintain data quality checks and monitoring to ensure data accuracy and reliability.
- Utilize cloud computing platforms (Azure/GCP/AWS) to deploy and manage data infrastructure and services.
- Work with technologies like Spark and Databricks for large-scale data processing and transformation.
Other
- 5+ years of relevant technical experience in data engineering or a similar role.
- Participate in Agile development processes, including sprint planning, stand-ups, and retrospectives.
- Troubleshoot and resolve data-related issues, ensuring minimal disruption to data availability and integrity.
- All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, or protected veteran status and will not be discriminated against on the basis of disability.
