Cat Digital is looking to build industry-leading digital solutions for its customers and dealers by leveraging the latest technologies, data, advanced analytics, telematics, and AI capabilities to help customers build a better, more sustainable world. The Senior Data Engineer will be responsible for developing Python data pipelines that build business data objects used to support applications.
Requirements
- Extensive experience in designing and developing software applications in Python.
- Experience with AWS components such as Bedrock, Lambda, Dynamo, Fargate, S3, Sagemaker, IAM and RDS
- Experience with relational and/or noSQL databases such as PostgreSQL, DynamoDB, MongoDB, Oracle, etc.
- Extensive experience deploying software using CI/CD tools such as Jenkins, Github Actions, Azure Devops etc.
- Extensive software development experience and solid working knowledge of OOP principles.
- Extensive experience working with Git version control
- Knowledge and experience with AI technologies such as NLP, LLM, RAG, LangChain frameworks, etc
Responsibilities
- Developing Python data pipelines that build business data objects used to support applications.
- Competent to perform all programming, project management, and development assignments without close supervision; normally assigned the more complex aspects of systems work.
- Works directly on complex application/technical problem identification and resolution.
- Interpreting design requirements for engineering implementation
- Building and deploying CICD pipelines
- Implementing source to target mapping as pipeline code
- Responsibility for Unit and Integration testing
Other
- Responsibilities of the incumbents are across functional lines with individuals assigned in new program development.
- Maintains high standards of software quality within the team by establishing good practices and habits
- Identifies and encourage areas for growth and improvement within the team
- Employee is also responsible for performing other job duties as assigned by Caterpillar management from time to time.
- Exceptional communication skills with experience working on a cross functional teams.
