Walmart/VIZIO is looking to transform raw data into valuable insights to drive strategic decisions and innovation across the company
Requirements
- Proficiency in Python, Pyspark, SQL, and/or Scala
- Experience with relational SQL and NoSQL databases
- Strong understanding of in-memory processing and data formats
- Hands-on experience with AWS cloud services and stream-processing systems
- Knowledge of big data tools (Hadoop, Spark, Kafka)
- Familiarity with software engineering tools/practices (Github, VSCode, CI/CD)
- Background in data observability and monitoring
Responsibilities
- Design and implement efficient ETL processes to manage data pipelines
- Develop and maintain data pipelines for analytics and operational use
- Work with SQL, NoSQL databases, and cloud services like AWS
- Optimize in-memory processing and data formats (Avro, Parquet, Json)
- Utilize stream-processing systems (Storm, Spark-Structured-Streaming, Kafka)
- Manage data pipeline and workflow tools (Apache Airflow, AWS Data Pipeline)
- Lead projects and mentor junior team members
Other
- BS or MS in Computer Science or related field
- 5+ years of experience as a data engineer
- 2 years' experience in data engineering, database engineering, business intelligence, or business analytics
- Bachelor’s degree in Computer Science and 3 years' experience in software engineering or related field
- Option 2: 5 years’ experience in software engineering or related field
