Benzinga is seeking a technical Data Engineer to join our team. In this role, you will be responsible for building out and improving the data platform that collects, stores, and processes our vast amount of web traffic, advertising, financial, and product usage data. Your expertise and collaboration with other members of our team will be crucial in ensuring the integrity, availability, and performance of our data platform, enabling analytics engineers and partners to make data-driven decisions.
Requirements
- Strong experience with cloud platforms like AWS, GCP, or Azure, and familiarity with data warehousing solutions like Snowflake, Redshift, or BigQuery.
- Knowledge of software design principles, programming best practices, proper code maintenance, and CI/CD pipelines
- Advanced Python skills
- Proficiency in SQL
- Solid understanding of database systems and experience with data modeling and schema design.
- Experience with Distributed Computing i.e. Spark
- Experience with Containerization i.e. Docker
Responsibilities
- Build and maintain efficient and reliable ETL software processes that ingest data from various sources into our data platform.
- Ensure data integrity, quality, and security across all data systems and processes.
- Monitor and troubleshoot data pipeline performance, addressing any issues that arise promptly.
- Innovate and collaborate with fellow Sr Data Engineer to help design, plan out, and improve the new data platform
- Implement best practices for data governance, including metadata management, data cataloging, and data privacy compliance.
- Stay current with emerging technologies and trends in data engineering and apply them to improve our data infrastructure.
Other
- Collaborate with stakeholders to understand data needs and deliver solutions that meet business requirements.
- 3+ years of experience in data engineering, software development, or a related role
- Exposure to web application, marketing, or advertising data
- Experience in the financial services or media industry.
