AWS Integration - OpenSearch Service
Mackerel supports obtaining and monitoring Amazon OpenSearch Service metrics in AWS Integration. When integrating with AWS Integration, billable targets are determined using the conversion 1 Domain = 1 Micro Host. In addition to this, depending on the number of metrics retrieved, you may be charged for exceeding the maximum number of metrics per micro host.
In response to Amazon Elasticsearch Service changing its name to Amazon OpenSearch Service in September 2021, Mackerel's AWS integration has also changed its name from Elasticsearch Service integration to OpenSearch Service integration.
Please refer to the following page for AWS Integration configuration methods and a list of supported AWS services.
AWS Integration
Obtaining metrics
The metrics obtainable with AWS Integration's support for OpenSearch Service are as follows. For Metric explanations, refer to the AWS help page.
The maximum number of metrics obtainable is 129.
| Graph name | Metric | Metric name in Mackerel | Unit | Statistics |
|---|---|---|---|---|
| Cluster Status | ClusterStatus.green ClusterStatus.yellow ClusterStatus.red | es.cluster_status.green es.cluster_status.yellow es.cluster_status.red | integer | Minimum Maximum Maximum |
| Shards | Shards.active Shards.unassigned Shards.delayedUnassigned Shards.activePrimary Shards.initializing Shards.relocating | es.shards.active es.shards.unassigned es.shards.delayedUnassigned es.shards.activePrimary es.shards.initializing es.shards.relocating | integer | Sum |
| Nodes | Nodes | es.nodes.count | integer | Minimum |
| Searchable Documents | SearchableDocuments | es.searchable_documents.count | float | Average |
| Deleted Documents | DeletedDocuments | es.deleted_documents.count | float | Average |
| CPU Utilization | CPUUtilization | es.cpu_utilization.maximum es.cpu_utilization.average | percentage | Maximum Average |
| Free Storage Space | FreeStorageSpace | es.free_storage_space.maximum es.free_storage_space.average es.free_storage_space.minimum es.free_storage_space.sum | bytes | Maximum Average Minimum Sum |
| Cluster Used Space | ClusterUsedSpace | es.cluster_used_space.maximum es.cluster_used_space.minimum | integer | Maximum Minimum |
| Cluster Index Writes Blocked | ClusterIndexWritesBlocked | es.cluster_index_writes_blocked.blocked | integer | Maximum |
| JVM Memory Pressure | JVMMemoryPressure | es.jvm_memory_pressure.maximum | percentage | Maximum |
| JVM Old Gen Memory Pressure | OldGenJVMMemoryPressure | es.jvm_old_gen_memory_pressure.maximum | percentage | Maximum |
| Automated Snapshot Failure | AutomatedSnapshotFailure | es.automated_snapshot_failure.failure | integer | Maximum |
| CPU Credit Balance | CPUCreditBalance | es.cpu_credit_balance.balance | float | Minimum |
| Health Check *1 | KibanaHealthyNodes MasterReachableFromNode | es.health_check.kibana es.health_check.master | integer | Minimum |
| OpenSearch Dashboards Healthy Nodes *2 | OpenSearchDashboardsHealthyNodes | es.opensearch_dashboards_healthy_nodes.minimum es.opensearch_dashboards_healthy_nodes.average es.opensearch_dashboards_healthy_nodes.maximum | integer | Minimum Average Maximum |
| OpenSearch Dashboards Reporting Count *2 | OpensearchDashboardsReportingFailedRequestSysErrCount OpensearchDashboardsReportingFailedRequestUserErrCount OpensearchDashboardsReportingRequestCount OpensearchDashboardsReportingSuccessCount | es.opensearch_dashboards_reporting_count.sys_err es.opensearch_dashboards_reporting_count.user_err es.opensearch_dashboards_reporting_count.request es.opensearch_dashboards_reporting_count.success | integer | Sum |
| KMS Key | KMSKeyError KMSKeyInaccessible | es.kms_key.error es.kms_key.inaccessible | integer | Maximum |
| Cluster Requests | ElasticsearchRequests *1 OpenSearchRequests *2 InvalidHostHeaderRequests | es.cluster_requests.count es.cluster_requests.opensearch_count es.cluster_requests.invalid_host_header | integer | Sum |
| Requests | 2xx 3xx 4xx 5xx | es.requests.2xx es.requests.3xx es.requests.4xx es.requests.5xx | integer | Sum |
| Throughput Throttle | ThroughputThrottle | es.throughput_throttle.minimum es.throughput_throttle.maximum | integer | Minimum Maximum |
| Master CPU Utilization | MasterCPUUtilization | es.master_cpu_utilization.master_cpu | percentage | Average |
| Master JVM Memory Pressure | MasterJVMMemoryPressure | es.master_jvm_memory_pressure.master_jvm | percentage | Maximum |
| Master JVM Old Gen Memory Pressure | MasterOldGenJVMMemoryPressure | es.master_jvm_old_gen_memory_pressure.master_jvm_old_gen | percentage | Maximum |
| Master CPU Credit Balance | MasterCPUCreditBalance | es.master_cpu_credit_balance.balance | float | Minimum |
| Master Sys Memory Utilization | MasterSysMemoryUtilization | es.master_sys_memory_utilization.maximum | percentage | Maximum |
| EBS Disk Queue Depth | DiskQueueDepth | es.ebs_disk_queue_depth.minimum es.ebs_disk_queue_depth.average es.ebs_disk_queue_depth.maximum | float | Minimum Average Maximum |
| EBS Burst Balance | BurstBalance | es.ebs_burst_balance.minimum es.ebs_burst_balance.average es.ebs_burst_balance.maximum | float | Minimum Average Maximum |
| EBS Latency | WriteLatency ReadLatency | es.ebs_latency.#.minimum es.ebs_latency.#.average es.ebs_latency.#.maximum | float | Minimum Average Maximum |
| EBS Throughput | WriteThroughput ReadThroughput | es.ebs_throughput.#.minimum es.ebs_throughput.#.average es.ebs_throughput.#.maximum | bytes/sec | Minimum Average Maximum |
| EBS Throughput Micro Bursting | WriteThroughputMicroBursting ReadThroughputMicroBursting | es.ebs_throughput_micro_bursting.#.minimum es.ebs_throughput_micro_bursting.#.average es.ebs_throughput_micro_bursting.#.maximum | bytes/sec | Minimum Average Maximum |
| EBS IOPS | WriteIOPS ReadIOPS | es.ebs_iops.#.minimum es.ebs_iops.#.average es.ebs_iops.#.maximum | iops | Minimum Average Maximum |
| EBS IOPS Micro Bursting | WriteIOPSMicroBursting ReadIOPSMicroBursting | es.ebs_iops_micro_bursting.#.minimum es.ebs_iops_micro_bursting.#.average es.ebs_iops_micro_bursting.#.maximum | iops | Minimum Average Maximum |
| Instance Latency | IndexingLatency SearchLatency | es.instance_latency.indexing es.instance_latency.search | float | Average |
| Instance Rate | IndexingRate SearchRate | es.instance_rate.indexing es.instance_rate.search | float | Average |
| Instance Segment Count | SegmentCount | es.instance_segment_count.maximum es.instance_segment_count.average | float | Maximum Average |
| Instance Sys Memory Utilization | SysMemoryUtilization | es.instance_sys_memory_utilization.minimum es.instance_sys_memory_utilization.average es.instance_sys_memory_utilization.maximum | percentage | Minimum Average Maximum |
| JVM GC Collection Count | JVMGCYoungCollectionCount JVMGCOldCollectionCount | es.jvm_gc_collection_count.young es.jvm_gc_collection_count.old | integer | Maximum |
| JVM GC Collection Time | JVMGCYoungCollectionTime JVMGCOldCollectionTime | es.jvm_gc_collection_time.young es.jvm_gc_collection_time.old | integer | Maximum |
| OpenSearch Dashboards Concurrent Connections *2 | OpenSearchDashboardsConcurrentConnections | es.opensearch_dashboards_concurrent_connections.count | integer | Maximum |
| OpenSearch Dashboards Heap *2 | OpenSearchDashboardsHeapTotal OpenSearchDashboardsHeapUsed | es.opensearch_dashboards_heap.total es.opensearch_dashboards_heap.used | integer | Maximum |
| OpenSearch Dashboards Heap Utilization *2 | OpenSearchDashboardsHeapUtilization | es.opensearch_dashboards_heap_utilization.heap | percentage | Maximum |
| OpenSearch Dashboards OS 1 Minute Load *2 | OpenSearchDashboardsOS1MinuteLoad | es.opensearch_dashboards_os_1_minute_load.load | float | Average |
| OpenSearch Dashboards Request Total *2 | OpenSearchDashboardsRequestTotal | es.opensearch_dashboards_request_total.total | integer | Sum |
| OpenSearch Dashboards Response Times Max In Millis *2 | OpenSearchDashboardsResponseTimesMaxInMillis | es.opensearch_dashboards_response_times_max_in_millis.time_ms | integer | Maximum |
| Search Task Cancelled | SearchTaskCancelled SearchShardTaskCancelled | es.search_task_cancelled.coordinator_node es.search_task_cancelled.data_node | integer | Sum |
| Threadpool Index Threads | ThreadpoolIndexQueue ThreadpoolIndexRejected ThreadpoolIndexThreads | es.threadpool_index_threads.queue es.threadpool_index_threads.rejected es.threadpool_index_threads.threads | integer | Maximum |
| Threadpool Search Threads | ThreadpoolSearchQueue ThreadpoolSearchRejected ThreadpoolSearchThreads | es.threadpool_search_threads.queue es.threadpool_search_threads.rejected es.threadpool_search_threads.threads | integer | Maximum |
| Threadpool Force_merge Threads | ThreadpoolForce_mergeQueue ThreadpoolForce_mergeRejected ThreadpoolForce_mergeThreads | es.threadpool_force_merge_threads.queue es.threadpool_force_merge_threads.rejected es.threadpool_force_merge_threads.threads | integer | Maximum |
| Threadpool sql-worker Threads | Threadpoolsql-workerQueue Threadpoolsql-workerRejected Threadpoolsql-workerThreads | es.threadpool_sql_worker_threads.queue es.threadpool_sql_worker_threads.rejected es.threadpool_sql_worker_threads.threads | integer | Maximum |
| Threadpool Bulk Threads | ThreadpoolBulkQueue ThreadpoolBulkRejected ThreadpoolBulkThreads | es.threadpool_bulk_threads.queue es.threadpool_bulk_threads.rejected es.threadpool_bulk_threads.threads | integer | Maximum |
| Threadpool Write Threads | ThreadpoolWriteQueue ThreadpoolWriteRejected ThreadpoolWriteThreads | es.threadpool_write_threads.queue es.threadpool_write_threads.rejected es.threadpool_write_threads.threads | integer | Maximum |
| Coordinating Write Rejected | CoordinatingWriteRejected | es.coordinating_write_rejected.rejected | integer | Maximum |
| Primary Write Rejected | PrimaryWriteRejected | es.primary_write_rejected.rejected | integer | Maximum |
| Replica Write Rejected | ReplicaWriteRejected | es.replica_write_rejected.rejected | integer | Maximum |
*1 Elasticsearch engine only
*2 OpenSearch engine only
- Enter either "Write" or "Read" for the # in "Metric name in Mackerel".
Notes
If you use General Purpose or Magnetic EBS volumes, the EBS volume metrics update only every 5 minutes.