The partner company is looking for a Sr. Data Engineer to build scalable, high-quality data solutions, optimize and enhance data pipelines, ETL processes, and database architecture, and influence the next generation of data products.
Requirements
- Proficiency in multiple programming languages, including Python; ability to learn additional languages as needed.
- Hands-on experience with big data tools such as Spark, Kafka, and stream-processing systems (e.g., Storm, Spark-Streaming).
- Strong knowledge of SQL and experience with relational databases (PostgreSQL) and NoSQL databases (DynamoDB, MongoDB, Elasticsearch).
- Familiarity with cloud services (AWS EC2, EMR, RDS) and infrastructure-as-code tools (Terraform, Git).
- Experience in data modeling, logical/physical database design, and building/optimizing complex data pipelines.
- Strong analytical, problem-solving, and troubleshooting skills, with the ability to work independently.
- Experience with agile development, CI/CD processes, and markup languages such as XML and HTML.
Responsibilities
- Design, build, and maintain scalable data pipelines and ETL processes for structured and unstructured datasets.
- Collaborate with cross-functional teams to support software development, data analytics, and product initiatives.
- Optimize data delivery, performance, and infrastructure using SQL, AWS services, and big data technologies.
- Construct and maintain data models, database schemas, and platform components for bulk, transactional, and streaming access.
- Implement automated data quality management procedures and promote best practices across teams.
- Support application-specific availability, scalability, and cost monitoring of data resources.
- Analyze, troubleshoot, and resolve complex data-related technical challenges.
Other
- 5+ years of experience, or 7+ years of relevant professional experience.
- Participate in agile development processes, contributing to planning, code reviews, and team collaboration.
- Excellent communication skills and a collaborative mindset.
- Remote work with collaboration across teams in a supportive, innovative environment.
- The applicant acknowledges that Jobgether will process their personal data as necessary to evaluate their candidacy, provide feedback, and, when appropriate, share relevant information with potential employers.
