The Data Management and BI Team is seeking a Sr. Staff Data Engineer to join their team to build data pipelines to land, profile, and store multiple internal & external datasets, and build applications that surface this data to support business partners’ strategic decision-making.
Requirements
- 10+ Years of Experience in Data Modeling, Data architecture, Data Quality, Metadata, ETL, and Data Warehouse methodologies and technologies.
- 5+ years experience with AWS technologies.
- Strong experience using Python and Pandas in an AWS Lambda framework is highly desired. Experience using EMR and/or DataBricks or the ability to read EMR code and translate it into Lambdas.
- Proven experience (3+ years) in designing and managing CI/CD pipelines, specifically using GitHub Actions.
- Demonstrated experience with Python, APIs, Spark, and Scala.
- Experience with advanced SQL, Linux, MicroStrategy, Tableau, and Pandas.
- Strong problem-solving skills.
Responsibilities
- Designs, builds, and oversees the deployment and operation of technology architecture, solutions and software to capture, manage, store, and utilize structured and unstructured data from internal and external sources
- Contributor to the overall Data Product roadmap by working closely with our business partners to understand their challenges and develop analytical tools to help drive business decisions
- Develops technical tools and programming that leverage artificial intelligence, machine learning, and big-data techniques to cleanse, organize and transform data and to maintain, defend and update data structures and integrity on an automated basis
- Leverage prototyping methodologies to propose and design creative business solutions that exploit our broad toolset of technologies (Big Data, MicroStrategy, Tableau, Python, Spark etc).
- Creates and establishes design standards and assurance processes for software, systems, and applications development to ensure compatibility and operability of data connections, flow,s and storage requirements.
- Reviews internal and external business and product requirements for data operations and activity and suggests changes and upgrades to systems and storage to accommodate ongoing needs.
- Design, develop, and maintain CI/CD pipelines using GitHub Actions to automate deployment, testing, and monitoring of applications.
Other
- Strong oral and written communication and influencing skills, with the ability to communicate new concepts and drive change in processes and behaviors and to communicate complex technical topics to management and non-technical audiences.
- Bachelor’s degree in Engineering, Computer Science, Information Systems or related field with 10+ years of relevant experience.
- Fully Remote: This position has been designated as fully remote
- Strong analytical focus, results-oriented, and execution driven.
- Ability and desire to work within a cross-functional team environment with people from multiple business units, vendors, countries, and cultures.
