The company needs to design, develop, and maintain scalable data pipelines, ETL processes, and analytics solutions to support enterprise-wide, data-driven decision-making. This involves delivering impactful insights through collaboration with cross-functional teams and maintaining high standards for data quality, security, and compliance.
Requirements
- Advanced proficiency in Informatica PowerCenter for ETL design, scheduling, and workflow management.
- Expertise in Snowflake for cloud data warehousing, including SQL scripting, data sharing, and performance tuning.
- Hands-on experience with Hadoop ecosystem (HDFS, MapReduce, Hive, Spark) for big data processing and distributed computing.
- Expert-level SQL skills across multiple databases (e.g., Oracle, SQL Server, PostgreSQL), including query optimization, indexing, and data modeling.
- Strong experience with Power BI for dashboard development, DAX scripting, data modeling, and integration with APIs/ODBC sources.
- Proficiency in data analytics techniques using Python, R, or SQL for data cleaning, statistical analysis, and visualization.
- Solid experience with .NET (C-Sharp, ASP.NET) for building scalable backend services and APIs.
Responsibilities
- Architect and implement robust ETL workflows using tools like Informatica PowerCenter, AbInitio. Data mapping, transformation logic, error handling, and performance optimization for high-volume data processing.
- Design and develop data pipelines in Snowflake for efficient data warehousing, querying, and analytics, leveraging features such as Snowpark for custom processing and zero-copy cloning for cost-effective data sharing.
- Build and maintain distributed data processing systems on Hadoop ecosystems (e.g., Hive, Spark, HDFS), ensuring scalability, fault tolerance, and seamless integration with upstream and downstream systems.
- Develop advanced SQL queries, stored procedures, and optimizations for both relational and NoSQL databases to support complex data extraction, aggregation, and reporting needs.
- Create interactive dashboards, visualizations, and reports in Power BI, integrating multiple data sources to enable self-service analytics and real-time business intelligence.
- Perform data analytics tasks, including exploratory data analysis, statistical modeling, and trend identification to derive actionable insights and support predictive analytics initiatives.
- Collaborate on full-stack development using the .NET framework (C-Sharp) for backend services and JavaScript (including frameworks like React or Node.js) for frontend data visualization tools and user interfaces.
Other
- English (Required)
- Ability to plan and manage projects and solve complex problems by applying best practices
- Ability to provide direction and mentor less experienced teammates. Ability to interpret and convey complex, difficult, or sensitive information
- Minimal and up to 10% travel
- Able to work all hours scheduled, including overtime as directed by manager/supervisor and required by business need.
