Lead Site Reliability Engineer

EPAM·United States·Удалённо·вчера

We are seeking a specialized Observability & Infrastructure Engineer to lead the monitoring, telemetry, and platform-as-code initiatives critical to our multi-region disaster recovery roadmap. You will architect and implement robust observability pipelines, ensure deep visibility across our distributed AWS footprint, and codify our monitoring infrastructure using modern tools like Terraform, AWS CDK, and TypeScript.

Req.#1080523852

Responsibilities

Disaster Recovery Observability: Design, deploy, and validate monitoring and telemetry strategies supporting our transition from single-region (us-east-1) to multi-region (us-east-2 pilot-light and future Active-Active) architectures
Platform-as-Code (PaC): Manage and automate Datadog configurations (Monitors, Dashboards, Synthetics, SLOs, and composite alerts) and AWS infrastructure using Terraform, AWS CDK, and TypeScript
Telemetry & Ingestion Pipelines: Architect and scale high-throughput telemetry ingest pipelines utilizing AWS Lambda, Amazon S3, Amazon Kinesis, and Firehose
Observability Pipelines & Routing: Implement and maintain log routing, enrichment, and redaction workflows using OP2 / Vector (Observability Pipelines Worker) alongside Splunk, GCP Pub/Sub sinks, and OpenTelemetry (OTel)
AWS-Native Monitoring & Incident Response: Configure comprehensive CloudWatch metrics and alarms for edge, ALB, CloudFront, Route 53, and VPC Lattice, alongside Lambda runtime monitoring and Datadog-to-PagerDuty alert routing

Requirements

AWS CDK & TypeScript for infrastructure provisioning and automation
Agent & Cluster Agent deployment/management
Monitors, Dashboards, Synthetics, and SLOs managed via Terraform
Advanced constructs: Composite monitors, cardinality management, and retention controls
OP2 / Vector (Observability Pipelines Worker)
Log routing, enrichment, and redaction
Splunk & GCP Pub/Sub sinks; OpenTelemetry standards
CloudWatch metrics and alarms (Edge, ALB, CloudFront, Route 53, VPC Lattice)
AWS Lambda runtime monitoring & performance tuning
PagerDuty integration and alert-to-page wiring from Datadog