Visa is seeking a Data Engineer to help design, enhance, and build data infrastructure and pipelines within an agile development environment to support the Value Added Services – Digital Marketing & Engagement organization.
Requirements
- Experience with programming languages such as Python, Java, Scala, C++, Rust, or Golang.
- Basic knowledge of Distributed Systems and Data Structures.
- Knowledge or experience with Big Data and ML platform services such as Apache Hadoop and Apache Spark.
- Basic knowledge in ETL, data pipelines using Python, Shell Scripts, Apache Airflow, and Apache Kafka,building and populating data warehouses, and querying with BI tools.
- Basic knowledge in RDBMS fundamentals- design and creation of databases, schemas, tables, DB administration, security, and working with MySQL and IBM Db2.
- Basic knowledge in SQL query language, database functions, stored procedures, working with multiple tables, joins, and transactions.
- Basic knowledge in NoSQL and Big Data concepts such as MongoDB and Cassandra.
Responsibilities
- Design, develop, and maintain robust and scalable data pipelines and ETL processes.
- Ensure data services are highly available, secure, scalable, and resilient.
- Drive innovation to differentiate our data products and accelerate time-to-market delivery.
- Utilize containerization technologies such as Docker and Kubernetes, and expertise in programming languages like Java and Python, along with both relational and non-relational databases.
- Apply your data engineering skills with Hadoop, Spark, and Scala.
- Represent the team in various technical forums and build deep partnerships with product management.
- Analyze business requirements to architect highly secure, robust, and scalable data solutions.
Other
- Work in a hybrid environment, alternating between remote and office work.
- Strong communication skills, including clear and concise written and spoken communications that demonstrate professional judgment.
- Ability to take on challenges and address problems head-on.
- Strong ability to collaborate.
- Highly driven, resourceful, and results-oriented.
