Method is looking to solve the problem of ineffective data management and decision support by hiring a data engineer to assess and improve data systems.
Requirements
- Proven experience (5+ years) in data engineering
- Proficiency in database management systems (e.g., SQL, NoSQL databases)
- Experience with data warehousing and ETL (Extract, Transform, Load) processes
- Hands-on experience working with cloud data platforms, with a strong preference for Google Cloud Platform (GCP) tools like BigQuery, Cloud Functions, and Dataproc
- Skilled in Python programming with working knowledge of Pyspark
- Experience developing ELT processes within a medallion architecture (Bronze, Silver, Gold layers)
- Skilled in designing robust data validation and transformation processes to support downstream BI and analytics tools
Responsibilities
- Analyze and document existing data system processes to identify opportunities for improvement
- Develop detailed process maps that describe data flow and integration across multiple systems
- Create a catalog of data fields and data structures across various databases and systems
- Compare data fields and structures to identify inconsistencies and discrepancies
- Contribute towards gap analysis and recommend solutions for standardizing data fields and structures
- Recommend data directories to organize and manage data assets effectively
- Propose data standards and best practices
Other
- Strong problem-solving skills with attention to detail
- Experience in process mapping and optimization
- Understanding of data governance frameworks and practices
- Excellent verbal/written communication and presentation skills, with the ability to successfully articulate your work and its intent to your team and your client
- A unique point of view
- Ability to work on the East Coast
- Continuing education opportunities
- Flexible PTO and work-from-home policies
- 401K matching
- Health, Dental and Vision benefits, starting on day 1
