Cru is looking for a Senior Data Engineer to design, build, and maintain powerful data pipelines that fuel the enterprise's data-driven decision-making, optimizing data systems and driving innovation to further the Kingdom.
Requirements
- A seasoned Data Engineer with extensive experience designing and optimizing data models, working with a variety of databases (Oracle, Postgres, MySQL), and leading ETL/ELT development.
- Skilled in data pipeline orchestration and automation, with a proven ability to build scalable, reliable, and high-performance data workflows.
- Expert in CI/CD practices and automated testing, ensuring seamless integration and continuous delivery of data solutions.
- Hands-on experience with Google BigQuery or cloud-based data warehouses, as well as strong SQL skills.
- Proven experience using dbt for data transformation, documentation, and modular modeling.
- Experience with data modeling and data warehousing
- Strong programming skills in languages such as Python, Java, or Scala
Responsibilities
- Craft High-Performance Data Models: Design and create dimensional data models, denormalize data from multiple sources, and optimize these models to ensure BI performance is top-tier, working closely with BI and data analysts.
- Map the Data Journey: Develop comprehensive cradle-to-grave process flowcharts, from data inputs and processes to outputs and architecture diagrams. You'll define the entire data journey to ensure clarity and efficiency.
- Lead ETL/ELT Development: Design and implement ETL/ELT processes and queries to seamlessly integrate data from a variety of sources, including Oracle, Postgres, and MySQL, into our enterprise data warehouse (EDW).
- Create and Optimize Data Pipelines: Build end-to-end data pipelines to automate data ingestion, transformation, and loading processes. You'll monitor performance, troubleshoot issues, and ensure scalability, reliability, and efficiency across all pipelines.
- Drive Data Orchestration: Design innovative solutions to orchestrate data flows, ensuring the smooth movement, combining, verification, and storage of data, making it ready for analysis and business insights.
- Manage High-Impact Projects: Operate at a senior level by leading data projects, reviewing team outputs, and keeping executives informed of progress. You'll be the go-to leader for complex data challenges.
- Lead CI/CD Initiatives: Develop and implement best practices for Continuous Integration and Continuous Deployment (CI/CD) for data integrations, ensuring smooth, automated workflows.
Other
- Bachelor's degree in Math, Statistics, Business, Computer Science, or Data Science.
- 5-7 years of Data Engineering experience preferred.
- A strong communicator who enjoys mentoring others and fostering a collaborative, results-driven team culture.
- A problem-solver who thrives in challenging environments and can quickly identify and resolve issues in complex data systems.
- Comfortable leading cross-functional projects, collaborating with BI teams and data analysts, and presenting your work to senior executives.