About the Position
We are looking for a Python Developer with experience in platform or backend engineering for AI and ML systems. You will contribute to automation for agent lifecycle operations, deployment workflows, rollback validation, and quality gate enforcement.
About the Project
This project is centered on managing AI agent deployments from development to production with strong validation and quality controls. It includes automation for promotions, rollbacks, endpoint management, and regression detection to improve release confidence.
Responsibilities
- Develop Python automation for agent lifecycle operations
- Plan and maintain environment progression workflows from development to production
- Implement evaluation gate enforcement for promotions to QA and production
- Develop rollback mechanisms for reverting production agents to previous versions
- Validate rollbacks with health checks and smoke tests
- Manage AWS AgentCore Runtime endpoints using default and named aliases
- Run evaluation suites against multiple agent versions to detect regression
- Collaborate on quality checks for PII safety and workflow accuracy
Requirements
- 3+ years of platform or backend engineering with AI and ML systems
- Experience with multi environment deployment and promotion workflows
- Experience with rollback automation and safety validation
- Experience with quality gate enforcement in deployment pipelines
- Experience with Python
Nice to Have
- Hands on experience with AWS AgentCore Evaluation API
- Experience with agent regression testing and version comparison
- Experience with blue green or canary deployment patterns for LLM agents
- Experience with agent health monitoring after deployment
Technologies
Python, AWS AgentCore Runtime, AWS AgentCore Evaluation API