Filtr uses AI to scan 1000+ jobs and finds postings that perfectly matches your resume

CoBank is looking for a Principal Data Engineer to join their Data Engineering (DE) team to build and maintain their data lake, ingestion and consumption data pipelines/services, and facilitate the movement of large data daily. The role will support growth strategies by providing end-to-end data engineering solutions for key business initiatives.

Requirements

• Expertise in designing and implementing complex data pipelines and ETL processes, preferably using cloud-native technologies.
• In-depth knowledge of data architecture principles, including data modeling, schema design, and optimization techniques.
• Proficiency in programming languages commonly used in data engineering, such as Python, Scala, or Java.
• Strong understanding of distributed computing frameworks and big data technologies, such as Apache Spark, Hadoop, or Flink.
• Expertise with AWS development environment and services
• Prior Experience with cloud platforms, particularly AWS, and proficiency in leveraging AWS native services for data processing, storage, and analytics, required
• Familiarity with containerization and orchestration technologies, such as Docker and Kubernetes (preferred).

Responsibilities

• Lead the design and implementation of highly scalable data pipelines and ETL processes.
• Architect and optimize data storage and retrieval mechanisms, leveraging cloud-native solutions.
• Drive data governance, quality, and metadata management initiatives.
• Mentor junior engineers and promote innovation within the team.
• Collaborate with and across Agile teams to design, develop, test, implement, and support data engineering solutions in full-stack development tools and technologies.
• Share your passion for staying on top of tech trends, experimenting with and learning new technologies, participating in internal & external technology communities, mentoring other members of the engineering community.
• Play a pivotal role in driving the design, development, and optimization of our data infrastructure and architecture.

Other

• 8 years of relevant experience in data engineering, with a proven track record of designing and implementing scalable data solutions, required
• Prior Experience in a leadership or senior technical role within a data engineering team, required
• Communicate effectively with stakeholders at all levels to ensure alignment on data initiatives.
• Bachelor's Degree in Computer Science, Information Technology, or related field. required
• Applicants must be authorized to work for any employer in the U.S. We are unable to sponsor or take over sponsorship of an employment visa at this time.