As a Senior Data Engineer on the Helios Data Engineering team at Caterpillar Inc., the business problem is to develop Python data pipelines that build business data objects used to support applications.
Requirements
- Extensive software development experience and solid working knowledge of OOP principles.
- Extensive experience working with Git version control
- Extensive experience deploying software using CI/CD tools such as Jenkins, Github Actions, Azure Devops etc.
- Extensive experience in designing and developing software applications in Python.
- Experience with AWS components such as Lambda, Dynamo, Fargate, S3, Sagemaker, IAM and RDS
- Experience with relational and/or noSQL databases such as PostgreSQL, DynamoDB, MongoDB, Oracle, etc.
- Knowledge and experience with AI technologies such as NLP, LLM, RAG, LangChain frameworks, etc is a plus
Responsibilities
- Competent to perform all programming, project management, and development assignments without close supervision; normally assigned the more complex aspects of systems work.
- Works directly on complex application/technical problem identification and resolution.
- Interpreting design requirements for engineering implementation
- Building and deploying CICD pipelines
- Implementing source to target mapping as pipeline code
- Responsibility for Unit and Integration testing
- Maintains high standards of software quality within the team by establishing good practices and habits
Other
- Exceptional communication skills with experience working on a cross functional teams.
- Demonstrated strong learning ability and a proactive approach to staying current with the latest technologies and industry trends.
- This position has the option to be based out of either our Chicago, IL, Peoria, IL, or Irving, TX (Dallas) offices.
- Relocation assistance is NOT available for this position
- Visa sponsorship is available for this position
