Arthur Grand Technologies is seeking a Lead Data Engineer (AWS) to design, develop, and implement data solutions for their client, focusing on AWS and Snowflake platforms.
Requirements
- Strong experience with SQL, python and Pyspark
- Good understanding of Data ingestion and data processing frameworks
- Good experience in Snowflake, SQL, AWS (glue, EMR, S3, Aurora, RDS, AWS architecture)
- Proven experience as a Data Engineer, with a focus on AWS and Snowflake.
- Strong understanding of data warehousing concepts and best practices.
- Proficiency in SQL, Python, and other relevant programming languages.
- Experience with data modeling and ETL processes.
Responsibilities
- Lead the design, development, and implementation of data solutions using AWS and Snowflake.
- Develop and maintain data pipelines, ensuring data quality, integrity, and security.
- Optimize data storage and retrieval processes to support data warehousing and analytics.
- Provide technical leadership and mentorship to junior data engineers.
- Ensure compliance with industry standards and best practices in data engineering.
- Utilize knowledge of insurance, particularly claims and loss, to enhance data solutions.
- Should be able to do coding, debugging, performance tuning, and deploying the apps to the Production environment.
Other
- Hybrid (4 days a week onsite)
- Full Time / Contract
- Good aptitude, strong problem-solving abilities, analytical skills, and ability to take ownership as appropriate.
- Experience working in Agile Methodology
- Excellent communication skills, with the ability to convey complex technical concepts to non-technical stakeholders.
