The company is looking to build business intelligence and analytics applications within their big data platform and integrate these applications with the existing architecture.
Requirements
In-depth knowledge of SQL and experience using a variety of data stores (e.g. RDBMS, analytic database, scalable document stores).
Hands-on programming experience in Python with an emphasis towards building ETL workflows and data-driven solutions.
Experience with big data batch computing tools (e.g. Hadoop or Spark) and developing distributed data processing solutions.
Experience with cloud computing platforms (e.g. AWS, GCP, Azure)
Solid understanding of data modeling principles (e.g. dimensional modeling and star schemas).
Solid understanding of database internals, such as indexes, binary logging, and transactions.
Solid understanding of Infrastructure as Code (e.g. Docker, CloudFormation, Terraform, etc.).
Responsibilities
Performs exploratory data analysis to determine which questions can be answered effectively with a given dataset and has the ability to analyze new (possibly unstructured) data sources to determine what additional value they may bring.
Designs and develops highly scalable and extensible data pipelines from internal and external sources.
Works on cross-functional teams to design, develop, and deploy data-driven applications and products, particularly within the space of data science.
Prototypes emerging technologies involving data ingestion and transformation, distributed file systems, databases and frameworks.
Designs, builds, and maintains tools to increase the productivity of application development and client facing teams.
Partners with business analyst to define, develop, and automate data quality checks.
Designs and develops big data applications and data visualization tools.
Other
Demonstrated experience providing customer-driven solutions, support or service.
Good data understanding and business acumen in the data rich industries like insurance or financial
Solid understanding of software engineering tools and workflows (i.e. Jenkins, CI/CD, git).
Up to 10% travel.
Offer to selected candidate will be made contingent on the results of applicable background checks
