Monitoring Jump Start: Elasticsearch domain

The search layer is an important component of each system that needs monitoring. Amazon Elasticsearch provides Elasticsearch as a Service. We created a CloudFormation template that you can use to monitor an Elasticsearch domain in a minute.

What do I have to monitor?

Each domain sends metrics to CloudWatch that we can observe with CloudWatch Alarms. We recommend to create alarms for the following metrics:

  • Cluster status
    • ClusterStatus.yellow
    • ClusterStatus.red
    • ClusterIndexWritesBlocked
    • AutomatedSnapshotFailure
    • KibanaHealthyNodes
    • KMSKeyError
    • KMSKeyInaccessible
  • Storage
    • FreeStorageSpace
  • CPU
    • CPUUtilization
    • CPUCreditBalance
    • MasterCPUUtilization
    • MasterCPUCreditBalance
  • Memory
    • JVMMemoryPressure
    • MasterJVMMemoryPressure

If a metric crosses the alarm’s threshold, you will receive an alert in Slack.

Set up instructions

  1. Create the CloudFormation stack with a single click
    1. Ensure that you selected the AWS region of your Elasticsearch monitoring target
    2. Set the EndpointId parameter to the ID of your endpoint. You can get this value by asking @marbot for it in your Slack channel.
    3. Set the DomainName parameter to the name of your Elasticsearch domain.
    4. Review the threshold parameters
    5. Save by clicking the Create button.
      Monitoring Jump Start: Elasticsearch domain

Published on