VSP Vision is looking to solve the problem of creating and maintaining reliable data pipelines for key data and analytics capabilities in the enterprise.
Requirements
- SQL coding experience
- Familiarity with agile development environments (Scrum, Kanban) with a focus on Continuous Integration and Delivery
- Previous experience using a data integration platform (IBM InfoSphere DataStage, Oracle Data Integrator, Informatica PowerCenter, MS SSIS, AWS Glue, Denodo)
- Familiarity with data warehouse MPP platforms such Snowflake, Netezza, Teradata, Redshift, etc
- Familiarity with event store and stream processing (Apache Kafka and platforms like Confluent) and with API development and management platforms (MuleSoft, Axway)
- Strong experience in Snowflake, IBM DataStage, and SQL to design, build, and optimize scalable data solutions
- Experience in data warehousing, analytics enablement, and high-performance data pipelines using modern orchestration and security tools such as Apache Airflow and Vault
Responsibilities
- Document and analyze data requirements (functional and non-functional) to develop scalable, automated, fault-tolerant data pipeline solutions for business and technology initiatives
- Profile data to assess the accuracy and completeness of data sources and work with the business partners to mitigate issues
- Build and maintain data pipelines for using appropriate tools and practices in development, test, and production environments. Design with modularity to leverage code reuse wherever possible
- Create data mappings, programs, routines, and SQL to acquire data from legacy, web, cloud, and purchased package environments into the analytics environment
- Use a mix of ELT, ETL, data virtualization, and other methods to optimize the balance of minimal data movement against performance
- Maintain metadata management processes and documentation
- Monitor data quality to detect emerging issues and consult with the team to create transformation rules to cleanse against defined rules and standards
Other
- Bachelor’s degree in computer science, data science, statistics, economics, or related functional area; or equivalent experience
- Effective written and verbal communication skills with the ability to gather requirements and effectively collaborate with teammates and business partners
- 4+ years of experience working in a development team providing analytical capabilities
- 4+ years of hands-on experience in the data space, spanning data preparation, SQL, integration tools
- Capable of focusing on a specific set of tasks while also ensuring alignment to a broader strategic design
