AccuWeather is looking to enhance data accessibility, reliability, and documentation by developing and automating systems, driving innovation across its data infrastructure, and contributing to automation initiatives, improving data discoverability, and exploring AI-driven solutions.
Requirements
- Foundational knowledge of Python and SQL for data manipulation and analysis.
- Familiarity with ETL concepts and structured data formats such as CSV, JSON, and Parquet.
- Interest in cloud-based data platforms (Azure preferred) and modern data engineering tools.
- Exposure to Databricks, Apache Spark, or other distributed data frameworks.
- Familiarity with Git or version control practices.
- Interest in AI/LLM-based automation, data documentation, or metadata management.
- Prior project or internship experience in data engineering or cloud technologies.
Responsibilities
- Support the development and maintenance of data pipelines using Databricks, Spark, and similar technologies.
- Write and optimize SQL and Python scripts for data transformation, integration, and automation tasks.
- Develop automation scripts that populate metadata and comments across Databricks tables using structured definitions (e.g., CSV files).
- Assist in building a proof-of-concept (POC) for an automated data dictionary that can be maintained using existing Databricks metadata.
- Contribute to prototyping an AI-powered knowledge agent that leverages internal data and documentation to answer common questions.
- Collaborate with team members to enhance data quality, cataloging, and metadata management across the ecosystem.
- Participate in code reviews, design discussions, and sprint ceremonies to learn engineering best practices.
Other
- Actively pursuing a Bachelor’s or Master’s degree in Computer Science, Software Engineering, Information Systems, or a related technical field.
- Strong analytical and problem-solving skills with an eagerness to learn.
- Effective communication and teamwork skills.
- Curiosity, attention to detail, adaptability, clear communication, and collaboration in an agile setting.
- Commitment to equal employment opportunity and diversity and inclusion.
