Google Cloud Platform (GCP) GKE metrics
Collect gke metrics from Google Cloud Platform (GCP) with Elastic Agent
Version  | 2.33.2 (View all)  | 
Compatible Kibana version(s)  | 8.12.0 or higher  | 
Supported Serverless project types  | Security Observability  | 
Subscription level  | Basic  | 
Metrics
The gke dataset fetches metrics from GKE in Google Cloud Platform. It contains all GA metrics exported from the GCP GKE Monitoring API.
You can specify a single region to fetch metrics like us-central1. Be aware that GCP GKE does not use zones so us-central1-a will return nothing. If no region is specified, it will return metrics from all regions.
Sample Event
An example event for gke looks as following:
{
    "@timestamp": "2017-10-12T08:05:34.853Z",
    "cloud": {
        "account": {
            "id": "elastic-obs-integrations-dev",
            "name": "elastic-obs-integrations-dev"
        },
        "instance": {
            "id": "4751091017865185079",
            "name": "gke-cluster-1-default-pool-6617a8aa-5clh"
        },
        "machine": {
            "type": "e2-medium"
        },
        "provider": "gcp",
        "availability_zone": "us-central1-c",
        "region": "us-central1"
    },
    "event": {
        "dataset": "gcp.gke",
        "duration": 115000,
        "module": "gcp"
    },
    "gcp": {
        "gke": {
            "container": {
                "cpu": {
                    "core_usage_time": {
                        "sec": 15
                    }
                }
            }
        },
        "labels": {
            "user": {
                "goog-gke-node": ""
            }
        }
    },
    "host": {
        "id": "4751091017865185079",
        "name": "gke-cluster-1-default-pool-6617a8aa-5clh"
    },
    "metricset": {
        "name": "gke",
        "period": 10000
    },
    "service": {
        "type": "gcp"
    }
}Exported fields
Exported fields
| Field | Description | Type | Metric Type | 
|---|---|---|---|
@timestamp  | Event timestamp.  | date  | |
agent.id  | Unique identifier of this agent (if one exists). Example: For Beats this would be beat.id.  | keyword  | |
cloud  | Fields related to the cloud or infrastructure the events are coming from.  | group  | |
cloud.account.id  | The cloud account or organization id used to identify different entities in a multi-tenant environment. Examples: AWS account id, Google Cloud ORG Id, or other unique identifier.  | keyword  | |
cloud.account.name  | The cloud account name or alias used to identify different entities in a multi-tenant environment. Examples: AWS account name, Google Cloud ORG display name.  | keyword  | |
cloud.availability_zone  | Availability zone in which this host, resource, or service is located.  | keyword  | |
cloud.image.id  | Image ID for the cloud instance.  | keyword  | |
cloud.instance.id  | Instance ID of the host machine.  | keyword  | |
cloud.instance.name  | Instance name of the host machine.  | keyword  | |
cloud.machine.type  | Machine type of the host machine.  | keyword  | |
cloud.project.id  | Name of the project in Google Cloud.  | keyword  | |
cloud.provider  | Name of the cloud provider. Example values are aws, azure, gcp, or digitalocean.  | keyword  | |
cloud.region  | Region in which this host, resource, or service is located.  | keyword  | |
container.id  | Unique container id.  | keyword  | |
container.image.name  | Name of the image the container was built on.  | keyword  | |
container.labels  | Image labels.  | object  | |
container.name  | Container name.  | keyword  | |
data_stream.dataset  | Data stream dataset.  | constant_keyword  | |
data_stream.namespace  | Data stream namespace.  | constant_keyword  | |
data_stream.type  | Data stream type.  | constant_keyword  | |
ecs.version  | ECS version this event conforms to.  ecs.version is a required field and must exist in all events. When querying across multiple indices -- which may conform to slightly different ECS versions -- this field lets integrations adjust to the schema version of the events. | keyword  | |
error  | These fields can represent errors of any kind. Use them for errors that happen while fetching events or in cases where the event itself contains an error.  | group  | |
error.message  | Error message.  | match_only_text  | |
event.dataset  | Event dataset  | constant_keyword  | |
event.module  | Event module  | constant_keyword  | |
gcp.gke.container.cpu.core_usage_time.sec  | Cumulative CPU usage on all cores used by the container in seconds. Sampled every 60 seconds.  | double  | counter  | 
gcp.gke.container.cpu.limit_cores.value  | CPU cores limit of the container. Sampled every 60 seconds.  | double  | gauge  | 
gcp.gke.container.cpu.limit_utilization.pct  | The fraction of the CPU limit that is currently in use on the instance. This value cannot exceed 1 as usage cannot exceed the limit. Sampled every 60 seconds. After sampling, data is not visible for up to 240 seconds.  | double  | gauge  | 
gcp.gke.container.cpu.request_cores.value  | Number of CPU cores requested by the container. Sampled every 60 seconds. After sampling, data is not visible for up to 120 seconds.  | double  | gauge  | 
gcp.gke.container.cpu.request_utilization.pct  | The fraction of the requested CPU that is currently in use on the instance. This value can be greater than 1 as usage can exceed the request. Sampled every 60 seconds. After sampling, data is not visible for up to 240 seconds.  | double  | gauge  | 
gcp.gke.container.ephemeral_storage.limit.bytes  | Local ephemeral storage limit in bytes. Sampled every 60 seconds.  | long  | gauge  | 
gcp.gke.container.ephemeral_storage.request.bytes  | Local ephemeral storage request in bytes. Sampled every 60 seconds.  | long  | gauge  | 
gcp.gke.container.ephemeral_storage.used.bytes  | Local ephemeral storage usage in bytes. Sampled every 60 seconds.  | long  | gauge  | 
gcp.gke.container.memory.limit.bytes  | Memory limit of the container in bytes. Sampled every 60 seconds.  | long  | gauge  | 
gcp.gke.container.memory.limit_utilization.pct  | The fraction of the memory limit that is currently in use on the instance. This value cannot exceed 1 as usage cannot exceed the limit. Sampled every 60 seconds. After sampling, data is not visible for up to 120 seconds.  | double  | gauge  | 
gcp.gke.container.memory.page_fault.count  | Number of page faults, broken down by type, major and minor.  | long  | counter  | 
gcp.gke.container.memory.request.bytes  | Memory request of the container in bytes. Sampled every 60 seconds. After sampling, data is not visible for up to 120 seconds.  | long  | gauge  | 
gcp.gke.container.memory.request_utilization.pct  | The fraction of the requested memory that is currently in use on the instance. This value can be greater than 1 as usage can exceed the request. Sampled every 60 seconds. After sampling, data is not visible for up to 240 seconds.  | double  | gauge  | 
gcp.gke.container.memory.used.bytes  | Memory usage in bytes. Sampled every 60 seconds.  | long  | gauge  | 
gcp.gke.container.restart.count  | Number of times the container has restarted. Sampled every 60 seconds. After sampling, data is not visible for up to 120 seconds.  | long  | counter  | 
gcp.gke.container.uptime.sec  | Time in seconds that the container has been running. Sampled every 60 seconds.  | double  | gauge  | 
gcp.gke.node.cpu.allocatable_cores.value  | Number of allocatable CPU cores on the node. Sampled every 60 seconds.  | double  | gauge  | 
gcp.gke.node.cpu.allocatable_utilization.pct  | The fraction of the allocatable CPU that is currently in use on the instance. Sampled every 60 seconds. After sampling, data is not visible for up to 240 seconds.  | double  | gauge  | 
gcp.gke.node.cpu.core_usage_time.sec  | Cumulative CPU usage on all cores used on the node in seconds. Sampled every 60 seconds.  | double  | counter  | 
gcp.gke.node.cpu.total_cores.value  | Total number of CPU cores on the node. Sampled every 60 seconds.  | double  | gauge  | 
gcp.gke.node.ephemeral_storage.allocatable.bytes  | Local ephemeral storage bytes allocatable on the node. Sampled every 60 seconds.  | long  | gauge  | 
gcp.gke.node.ephemeral_storage.inodes_free.value  | Free number of inodes on local ephemeral storage. Sampled every 60 seconds.  | long  | gauge  | 
gcp.gke.node.ephemeral_storage.inodes_total.value  | Total number of inodes on local ephemeral storage. Sampled every 60 seconds.  | long  | gauge  | 
gcp.gke.node.ephemeral_storage.total.bytes  | Total ephemeral storage bytes on the node. Sampled every 60 seconds.  | long  | gauge  | 
gcp.gke.node.ephemeral_storage.used.bytes  | Local ephemeral storage bytes used by the node. Sampled every 60 seconds.  | long  | gauge  | 
gcp.gke.node.memory.allocatable.bytes  | Cumulative memory bytes used by the node. Sampled every 60 seconds.  | long  | gauge  | 
gcp.gke.node.memory.allocatable_utilization.pct  | The fraction of the allocatable memory that is currently in use on the instance. This value cannot exceed 1 as usage cannot exceed allocatable memory bytes. Sampled every 60 seconds. After sampling, data is not visible for up to 120 seconds.  | double  | gauge  | 
gcp.gke.node.memory.total.bytes  | Number of bytes of memory allocatable on the node. Sampled every 60 seconds.  | long  | gauge  | 
gcp.gke.node.memory.used.bytes  | Cumulative memory bytes used by the node. Sampled every 60 seconds.  | long  | gauge  | 
gcp.gke.node.network.received_bytes.count  | Cumulative number of bytes received by the node over the network. Sampled every 60 seconds.  | long  | counter  | 
gcp.gke.node.network.sent_bytes.count  | Cumulative number of bytes transmitted by the node over the network. Sampled every 60 seconds.  | long  | counter  | 
gcp.gke.node.pid_limit.value  | The max PID of OS on the node. Sampled every 60 seconds.  | long  | gauge  | 
gcp.gke.node.pid_used.value  | The number of running process in the OS on the node. Sampled every 60 seconds.  | long  | gauge  | 
gcp.gke.node_daemon.cpu.core_usage_time.sec  | Cumulative CPU usage on all cores used by the node level system daemon in seconds. Sampled every 60 seconds.  | double  | counter  | 
gcp.gke.node_daemon.memory.used.bytes  | Memory usage by the system daemon in bytes. Sampled every 60 seconds.  | long  | gauge  | 
gcp.gke.pod.network.received.bytes  | Cumulative number of bytes received by the pod over the network. Sampled every 60 seconds.  | long  | counter  | 
gcp.gke.pod.network.sent.bytes  | Cumulative number of bytes transmitted by the pod over the network. Sampled every 60 seconds.  | long  | counter  | 
gcp.gke.pod.volume.total.bytes  | Total number of disk bytes available to the pod. Sampled every 60 seconds. After sampling, data is not visible for up to 120 seconds.  | long  | gauge  | 
gcp.gke.pod.volume.used.bytes  | Number of disk bytes used by the pod. Sampled every 60 seconds.  | long  | gauge  | 
gcp.gke.pod.volume.utilization.pct  | The fraction of the volume that is currently being used by the instance. This value cannot be greater than 1 as usage cannot exceed the total available volume space. Sampled every 60 seconds. After sampling, data is not visible for up to 120 seconds.  | double  | gauge  | 
gcp.labels.metadata.*  | object  | ||
gcp.labels.metrics.*  | object  | ||
gcp.labels.resource.*  | object  | ||
gcp.labels.system.*  | object  | ||
gcp.labels.user.*  | object  | ||
gcp.labels_fingerprint  | Hashed value of the labels field.  | keyword  | |
gcp.metrics.*.*.*.*  | Metrics that returned from Google Cloud API query.  | object  | |
host.architecture  | Operating system architecture.  | keyword  | |
host.containerized  | If the host is a container.  | boolean  | |
host.domain  | Name of the domain of which the host is a member. For example, on Windows this could be the host's Active Directory domain or NetBIOS domain name. For Linux this could be the domain of the host's LDAP provider.  | keyword  | |
host.hostname  | Hostname of the host. It normally contains what the  hostname command returns on the host machine. | keyword  | |
host.id  | Unique host id. As hostname is not always unique, use values that are meaningful in your environment. Example: The current usage of  beat.name. | keyword  | |
host.ip  | Host ip addresses.  | ip  | |
host.mac  | Host mac addresses.  | keyword  | |
host.name  | Name of the host. It can contain what  hostname returns on Unix systems, the fully qualified domain name, or a name specified by the user. The sender decides which value to use. | keyword  | |
host.os.build  | OS build information.  | keyword  | |
host.os.codename  | OS codename, if any.  | keyword  | |
host.os.family  | OS family (such as redhat, debian, freebsd, windows).  | keyword  | |
host.os.kernel  | Operating system kernel version as a raw string.  | keyword  | |
host.os.name  | Operating system name, without the version.  | keyword  | |
host.os.name.text  | Multi-field of  host.os.name. | text  | |
host.os.platform  | Operating system platform (such centos, ubuntu, windows).  | keyword  | |
host.os.version  | Operating system version as a raw string.  | keyword  | |
host.type  | Type of host. For Cloud providers this can be the machine type like  t2.medium. If vm, this could be the container, for example, or other information meaningful in your environment. | keyword  | |
service.type  | The type of the service data is collected from. The type can be used to group and correlate logs and metrics from one service type. Example: If logs or metrics are collected from Elasticsearch,  service.type would be elasticsearch. | keyword  | 
Changelog
| Version | Details | Kibana version(s) | 
|---|---|---|
2.33.2  | Enhancement View pull request  | 8.12.0 or higher  | 
2.33.1  | Enhancement View pull request  | 8.12.0 or higher  | 
2.33.0  | Enhancement View pull request  | 8.12.0 or higher  | 
2.32.1  | Enhancement View pull request  | 8.12.0 or higher  | 
2.32.0  | Enhancement View pull request  | 8.12.0 or higher  | 
2.31.2  | Bug fix View pull request  | 8.7.1 or higher  | 
2.31.1  | Enhancement View pull request  | 8.7.1 or higher  | 
2.31.0  | Enhancement View pull request  | 8.7.1 or higher  | 
2.30.1  | Bug fix View pull request  | 8.7.1 or higher  | 
2.30.0  | Enhancement View pull request  | 8.7.1 or higher  | 
2.29.1  | Bug fix View pull request  | 8.7.1 or higher  | 
2.29.0  | Bug fix View pull request  | 8.7.1 or higher  | 
2.28.5  | Enhancement View pull request  | 8.7.1 or higher  | 
2.28.4  | Enhancement View pull request  | 8.7.1 or higher  | 
2.28.3  | Enhancement View pull request  | 8.7.1 or higher  | 
2.28.2  | Enhancement View pull request  | 8.7.1 or higher  | 
2.28.1  | Enhancement View pull request  | 8.7.1 or higher  | 
2.28.0  | Enhancement View pull request  | 8.7.1 or higher  | 
2.27.0  | Enhancement View pull request  | 8.7.1 or higher  | 
2.26.0  | Bug fix View pull request  | 8.7.1 or higher  | 
2.25.1  | Bug fix View pull request  | 8.7.1 or higher  | 
2.25.0  | Enhancement View pull request  | 8.7.1 or higher  | 
2.24.0  | Enhancement View pull request  | 8.7.1 or higher  | 
2.23.0  | Enhancement View pull request  | 8.7.1 or higher  | 
2.22.1  | Enhancement View pull request  | 8.6.0 or higher  | 
2.22.0  | Enhancement View pull request  | 8.6.0 or higher  | 
2.21.0  | Enhancement View pull request  | 8.6.0 or higher  | 
2.20.1  | Bug fix View pull request  | 8.6.0 or higher  | 
2.20.0  | Enhancement View pull request  | 8.6.0 or higher  | 
2.19.1  | Enhancement View pull request  | 8.6.0 or higher  | 
2.19.0  | Enhancement View pull request  | 8.6.0 or higher  | 
2.18.0  | Enhancement View pull request  | 8.6.0 or higher  | 
2.17.2  | Bug fix View pull request  | 8.6.0 or higher  | 
2.17.1  | Enhancement View pull request  | 8.6.0 or higher  | 
2.17.0  | Enhancement View pull request  | 8.6.0 or higher  | 
2.16.2  | Bug fix View pull request  | 8.5.0 or higher  | 
2.16.1  | Bug fix View pull request  | 8.5.0 or higher  | 
2.16.0  | Enhancement View pull request  | 8.5.0 or higher  | 
2.15.2  | Enhancement View pull request  | 8.5.0 or higher  | 
2.15.1  | Enhancement View pull request  | 8.5.0 or higher  | 
2.15.0  | Enhancement View pull request  | 8.5.0 or higher  | 
2.14.0  | Enhancement View pull request  | 8.3.0 or higher  | 
2.13.0  | Enhancement View pull request  | 8.3.0 or higher  | 
2.12.1  | Bug fix View pull request  | 7.17.6 or higher  | 
2.12.0  | Enhancement View pull request  | 7.17.6 or higher  | 
2.11.12  | Bug fix View pull request  | 7.17.6 or higher  | 
2.11.11  | Bug fix View pull request  | 7.17.6 or higher  | 
2.11.10  | Enhancement View pull request  | 7.17.6 or higher  | 
2.11.10-beta.6  | Enhancement View pull request  | —  | 
2.11.10-beta.5  | Enhancement View pull request  | —  | 
2.11.10-beta.4  | Enhancement View pull request  | —  | 
2.11.10-beta.3  | Enhancement View pull request  | —  | 
2.11.10-beta.2  | Enhancement View pull request  | —  | 
2.11.10-beta.1  | Enhancement View pull request  | —  | 
2.11.9  | Bug fix View pull request  | 7.17.6 or higher  | 
2.11.8  | Enhancement View pull request  | 7.17.6 or higher  | 
2.11.7  | Enhancement View pull request  | 7.17.6 or higher  | 
2.11.6  | Enhancement View pull request  | 7.17.6 or higher  | 
2.11.5  | Enhancement View pull request  | 7.17.6 or higher  | 
2.11.4  | Enhancement View pull request  | 7.17.6 or higher  | 
2.11.3  | Enhancement View pull request  | 7.17.6 or higher  | 
2.11.2  | Enhancement View pull request  | 7.17.6 or higher  | 
2.11.1  | Enhancement View pull request  | 7.17.6 or higher  | 
2.11.0  | Enhancement View pull request  | 7.17.6 or higher  | 
2.10.0  | Enhancement View pull request  | 7.17.6 or higher  | 
2.9.0  | Enhancement View pull request  | 7.17.6 or higher  | 
2.8.0  | Enhancement View pull request  | 7.17.6 or higher  | 
2.7.0  | Enhancement View pull request  | 7.17.6 or higher  | 
2.6.0  | Enhancement View pull request  | 7.17.6 or higher  | 
2.5.0  | Enhancement View pull request  | 7.17.6 or higher  | 
2.4.0  | Enhancement View pull request  | 7.17.6 or higher  | 
2.3.0  | Enhancement View pull request  | 7.17.6 or higher  | 
2.2.1  | Enhancement View pull request  | 7.17.6 or higher  | 
2.2.0  | Enhancement View pull request  | 7.17.6 or higher  | 
2.1.0  | Enhancement View pull request  | 7.17.6 or higher  | 
2.0.0  | Breaking change View pull request  | 8.3.0 or higher  | 
1.10.0  | Enhancement View pull request  | 7.17.0 or higher  | 
1.9.2  | Bug fix View pull request  | 7.17.0 or higher  | 
1.9.1  | Enhancement View pull request  | 7.17.0 or higher  | 
1.9.0  | Enhancement View pull request  | 7.17.0 or higher  | 
1.8.0  | Enhancement View pull request  | 7.17.0 or higher  | 
1.7.0  | Enhancement View pull request  | —  | 
1.6.1  | Enhancement View pull request  | 7.16.3 or higher  | 
1.6.0  | Enhancement View pull request  | —  | 
1.5.1  | Enhancement View pull request  | 7.16.3 or higher  | 
1.5.0  | Enhancement View pull request  | 7.16.3 or higher  | 
1.4.2  | Bug fix View pull request  | 7.16.3 or higher  | 
1.4.1  | Bug fix View pull request  | 7.16.3 or higher  | 
1.4.0  | Enhancement View pull request  | —  | 
1.3.1  | Bug fix View pull request  | 7.15.0 or higher  | 
1.3.0  | Enhancement View pull request  | 7.15.0 or higher  | 
1.2.2  | Bug fix View pull request  | 7.15.0 or higher  | 
1.2.1  | Bug fix View pull request  | —  | 
1.2.0  | Enhancement View pull request  | 7.15.0 or higher  | 
1.1.2  | Enhancement View pull request  | 7.15.0 or higher  | 
1.1.1  | Bug fix View pull request  | —  | 
1.1.0  | Enhancement View pull request  | 7.15.0 or higher  | 
1.0.0  | Enhancement View pull request  | —  | 
0.3.3  | Enhancement View pull request  | —  | 
0.3.2  | Enhancement View pull request  | —  | 
0.3.1  | Enhancement View pull request  | —  | 
0.3.0  | Enhancement View pull request  | —  | 
0.2.0  | Enhancement View pull request  | —  | 
0.1.0  | Enhancement View pull request  | —  | 
0.0.2  | Enhancement View pull request  | —  | 
0.0.1  | Enhancement View pull request  | —  |