The Big Four accounting firm client needs a Data Engineer to build, deploy, and maintain mission-critical analytics solutions for digital transformation across Enterprise Products, utilizing GenAI solutions.
Requirements
- 6+ years of background in data engineering
- Experience coding in SQL/Python, with solid CS fundamentals including data structure and algorithm design
- Hands-on implementation experience working with a combination of the following technologies: Hadoop, Map Reduce, Kafka, Hive, Spark, SQL and NoSQL data warehouses
- Skills in working with vector databases (Milvus, Postgres, etc.)
- Knowledge of Data Warehousing, design, implementation and optimization
- Competency in Azure cloud data platform
- Knowledge of embedding models and retrieval-augmented generation (RAG) architectures
Responsibilities
- Responsible for the building, deployment, and maintenance of mission-critical analytics solutions that process terabytes of data quickly at big-data scales
- Prepare and process complex datasets ready to use by Data Science
- Process data for vector DBs
- Ensure real-time monitoring for data pipeline health and quality
- Implement AI-specific security protocols
- Collaborate with Data Science, DevOps and Security teams
Other
- Excellent organizational skills, including the capacity to self-manage, structure work, set priorities, and work to deadlines
- Excellent troubleshooting and communication skills
- Intermediate+ English level
- Reasonable accommodations are available to enable individuals with disabilities to perform essential functions
- Exadel is proud to be an Equal Opportunity Employer committed to inclusion across minority, gender identity, sexual orientation, disability, age, and more
