CapTech is looking to enable clients to build and maintain advanced data systems that bring together data from disparate sources to enable decision-makers
Requirements
- Experience building/operating highly available distributed systems of data extraction, ingestion, and processing large data sets
- 5+ years of experience delivering data engineering solutions on cloud platform
- 5+ years of experience implementing modern designs using at least one cloud-based solution/platform (AWS, Azure, GCP)
- Advanced level proficiency with at least one ETL / Data Orchestration technology (Azure Data Factory, SSIS, Informatica, Alteryx, Ab Initio, Pentaho, Talend, Matillion)
- Experience cloud-based data warehousing and data lake solutions like Snowflake, Redshift, Databricks
- 5+ years of experience with SQL or NoSQL database (PostgreSQL, MySQL, SQL server, Oracle, Aurora, Presto, BigQuery)
- Expertise with SQL, database design/structure and data structure (star, snowflake schemas, de/normalized designs)
Responsibilities
- Be trusted advisor to customers with best practices, methodologies, and technologies to implement data engineering solutions
- Design, implement, and maintain modern data pipelines to deliver optimal solutions utilizing appropriate cloud technologies
- Partner with product owners and business SMEs to analyze customer requirements and provide a supportable and sustainable engineered solution
- Provide technical leadership and collaborate within and across teams to ensure that the overall technical solution is aligned with the customer needs
- Stay current with the latest cloud technologies, patterns, and methodologies; share knowledge by clearly articulating results and ideas to key stakeholders
Other
- Ability to think strategically and provide recommendations utilizing traditional and modern architectural components based on business needs
- Experience providing technical leadership and mentoring other engineers in data engineering space
- Cloud certification on any platform a plus
- 5+ years of experience
- Collaborative environment and opportunities to learn from and share knowledge with other developers, architects, and clients
