Walmart/VIZIO's Data Lake Team is looking to hire a Senior Data Engineer to build robust data infrastructure and enable advanced analytics, harnessing the power of data to drive strategic decisions and innovation across the company.
Requirements
- Proficiency in Python, Pyspark, SQL, and/or Scala.
- Experience with relational SQL and NoSQL databases.
- Strong understanding of in-memory processing and data formats.
- Hands-on experience with AWS cloud services and stream-processing systems.
- Knowledge of big data tools (Hadoop, Spark, Kafka).
- Familiarity with software engineering tools/practices (Github, VSCode, CI/CD).
- Background in data observability and monitoring.
Responsibilities
- Design and implement efficient ETL processes to manage data pipelines.
- Develop and maintain data pipelines for analytics and operational use.
- Work with SQL, NoSQL databases, and cloud services like AWS.
- Optimize in-memory processing and data formats (Avro, Parquet, Json).
- Utilize stream-processing systems (Storm, Spark-Structured-Streaming, Kafka).
- Manage data pipeline and workflow tools (Apache Airflow, AWS Data Pipeline).
- Lead projects and mentor junior team members.
Other
- 5+ years of experience as a data engineer.
- BS or MS in Computer Science or related field.
- Option 1: Bachelor’s degree in Computer Science and 3 years' experience in software engineering or related field.
- Option 2: 5 years’ experience in software engineering or related field.
- Option 3: Master's degree in Computer Science and 1 year’s experience in software engineering or related field.
