We are looking for a Senior Site Reliability Engineer to join our team and help build an Enterprise Agent Development Platform — a production-grade, cloud-native ecosystem that enables engineering teams to define, orchestrate, deploy, and observe AI agents at scale. The platform standardizes agent development across the organization using LangGraph and Strands Agents on AWS AgentCore Runtime. The initiative spans agent framework design, runtime architecture, marketplace integration, CI/CD automation, and enterprise-grade observability — reducing agent development from months to days while enforcing consistent security, quality, and governance standards.
Responsibilities
- Build behavioral monitoring and auditability signal views across the agent estate
- Design dashboards and alert conditions using New Relic and NRQL for behavioral monitoring
- Develop behavioral monitoring signals such as anomaly detection, drift, safety signals, and policy denials
- Create auditability views that surface governance evidence for stakeholder consumption
- Maintain observability domain segregation between technical monitoring (CloudWatch/New Relic) and audit evidence (dedicated evidence/SIEM stores)
- Validate alerts and verify dashboard data accuracy across monitoring systems
- Implement metrics emission and validation using Python
- Collaborate with engineering teams to ensure consistent security, quality, and governance standards across the agent platform
Requirements
- 3+ years of experience in observability engineering
- Hands-on experience building behavioral monitoring or auditability signals for AI agents in production, such as anomaly/drift detection on agent telemetry, surfacing Cedar/policy-denial events as monitoring inputs, or audit-evidence dashboards for agent governance
- Experience working in environments with formal audit / compliance evidence requirements
- Skills in behavioral and anomaly monitoring with alert tuning on production telemetry
- Proficiency in New Relic and NRQL for building dashboards and alert conditions
- Knowledge of observability domain segregation across technical and audit evidence stores
- Expertise in Python for metrics emission and validation
Nice to have
- Familiarity with anomaly / drift detection techniques for agent telemetry
- Experience with PII redaction validation in traces surfaced through dashboards
- Understanding of Cedar policy decisions / Contract-Policy Engine denials as monitoring inputs
- Knowledge of enterprise security / compliance standards mapping