Visa Technology & Operations LLC needs a Sr. Data Engineer to create and maintain optimal data pipeline architecture, assemble complex data sets, build analytics tools, and analyze data elements across multiple sources to provide actionable insights and build Data lineage for the Asset Management System.
Requirements
- Python
- Spark (pySpark)
- Unix
- SQL
- BigData / Hadoop technologies, including Hive, Presto, Tableau
- Time series forecasting
- Machine Learning
Responsibilities
- Create and maintain optimal data pipeline architecture.
- Assemble large, complex data sets that meet functional / non-functional business requirements.
- Build analytics tools that utilize the data automation pipeline to provide actionable insights.
- Analyze input Data elements across multiple sources and build Data lineage for the Asset Management System.
- Work on emerging technologies, building highly scalable, secure, reliable and fault tolerant distributed systems.
- Participate in design and code review sessions as appropriate.
- Provide third-level support to business users.
Other
- Position reports to the Foster City, California office and may allow for partial telecommuting.
- Present technical solutions, capabilities, considerations, and features in business terms.
- Effectively communicate status, issues, and risks in a precise and timely manner.
- Find opportunities to create, design and implement internal process improvements: automating manual processes and optimizing data delivery.
