# OPS10-BP07 - Automate responses to events

Best practice: OPS10-BP07
Pillar: Operational Excellence
Source: https://wellarchitected.cloudvisor.eu/docs/operational-excellence/ops10-bp07.html

## Implementation Guidance

"Automate responses to events" should be implemented through codified workflows, not ad hoc manual steps. Prioritize idempotent automation, failure handling, and rollback controls so teams can operate safely at scale.

For the question "How do you manage workload and operations events?", define measurable outcomes, assign owners, and review execution regularly. Integrate this practice into delivery and operations processes so improvements persist as workloads and requirements evolve.

### Key Steps

1. **Design automation boundaries**:
   - Identify which parts of "Automate responses to events" should be fully automated
   - Define pre-checks, post-checks, and approval controls
   - Specify rollback behavior and exception handling requirements

2. **Implement and integrate workflows**:
   - Codify automation in pipelines, runbooks, or event-driven handlers
   - Add telemetry, alerting, and audit trails for each automated action
   - Validate idempotency and safe re-execution under failure conditions

3. **Harden and continuously improve**:
   - Run failure simulations to validate automation behavior
   - Track error rates, execution time, and manual fallback frequency
   - Refine logic and controls based on incident and operations feedback

## Risk / Impact

**Level of risk if not implemented**: High

**Impact**: If this best practice is missing, teams are more likely to experience preventable incidents, delayed recovery, and inconsistent change outcomes. Control gaps and weak visibility can increase customer impact during high-pressure events.

**Benefits of implementation**:
- Reduced operational risk through repeatable controls
- Faster detection and response during incidents
- Stronger auditability and decision traceability

## AWS Services to Consider

<div class="aws-service">
  <div class="aws-service-content">
    <h4>Amazon EventBridge</h4>
    <p>Routes events and triggers automation workflows for rapid operational response.</p>
  </div>
</div>

<div class="aws-service">
  <div class="aws-service-content">
    <h4>AWS Systems Manager Incident Manager</h4>
    <p>Coordinates incident response with predefined plans, contacts, and timelines.</p>
  </div>
</div>

<div class="aws-service">
  <div class="aws-service-content">
    <h4>Amazon SNS</h4>
    <p>Sends notifications to people and systems for incidents and operational events.</p>
  </div>
</div>

<div class="aws-service">
  <div class="aws-service-content">
    <h4>AWS Lambda</h4>
    <p>Runs event-driven automation without managing servers, ideal for remediation workflows.</p>
  </div>
</div>

## Related Resources

<div class="related-resources">
  <h2>Related Resources</h2>
  <ul>
    <li><a href="https://docs.aws.amazon.com/wellarchitected/latest/framework/ops-10.html">OPS10: How do you manage workload and operations events?</a></li>
    <li><a href="https://docs.aws.amazon.com/wellarchitected/latest/operational-excellence-pillar/welcome.html">AWS Well-Architected Framework - Operational Excellence Pillar</a></li>
    <li><a href="https://docs.aws.amazon.com/wellarchitected/latest/operational-excellence-pillar/design-principles.html">Operational Excellence Design Principles</a></li>
  </ul>
</div>